Note: This is test shard 2 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/1
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250115 10:11:50.738998 2918 test_util.cc:274] Using random seed: -403370965
2025-01-15T10:11:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-01-15T10:11:50Z Disabled control of system clock
I20250115 10:11:50.749930 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.190:46859
--webserver_interface=127.2.217.190
--webserver_port=0
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250115 10:11:50.819635 2926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:50.819802 2926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:50.819824 2926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:50.820848 2926 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:50.820887 2926 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:50.820899 2926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:50.820910 2926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:50.820927 2926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:50.820937 2926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:50.822113 2926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.190:46859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.217.190
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:50.822252 2926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:50.822402 2926 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:50.826998 2934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:50.827695 2932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:50.828493 2931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:50.829205 2926 server_base.cc:1034] running on GCE node
I20250115 10:11:50.829378 2926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:50.829571 2926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:50.830685 2926 hybrid_clock.cc:648] HybridClock initialized: now 1736935910830666 us; error 32 us; skew 500 ppm
I20250115 10:11:50.836385 2926 webserver.cc:458] Webserver started at http://127.2.217.190:40155/ using document root <none> and password file <none>
I20250115 10:11:50.836555 2926 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:50.836599 2926 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:50.836678 2926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:50.837477 2926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/instance:
uuid: "88f5e7c003a641128acc22b394ab62c7"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.837729 2926 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal/instance:
uuid: "88f5e7c003a641128acc22b394ab62c7"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.838685 2926 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20250115 10:11:50.839210 2940 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:50.839346 2926 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:50.839409 2926 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
uuid: "88f5e7c003a641128acc22b394ab62c7"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.839458 2926 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:50.854665 2926 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:50.854960 2926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:50.855068 2926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:50.858590 2926 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.190:46859
I20250115 10:11:50.858631 2992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.190:46859 every 8 connection(s)
I20250115 10:11:50.858902 2926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
I20250115 10:11:50.859474 2993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:50.861135 2993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:50.863368 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 2926
I20250115 10:11:50.863447 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal/instance
I20250115 10:11:50.864205 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--webserver_interface=127.2.217.189
--webserver_port=0
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250115 10:11:50.865792 2993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } has no permanent_uuid. Determining permanent_uuid...
W20250115 10:11:50.866163 2943 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
W20250115 10:11:50.866546 2993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.189:36717: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
I20250115 10:11:50.915777 2993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } attempt: 1
W20250115 10:11:50.916576 2993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.189:36717: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
W20250115 10:11:50.934664 2997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:50.934827 2997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:50.934844 2997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:50.935986 2997 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:50.936019 2997 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:50.936031 2997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:50.936043 2997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:50.936065 2997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:50.936087 2997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:50.937359 2997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.217.189
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.2997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:50.937516 2997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:50.937705 2997 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:50.941758 3006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:50.942451 3003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:50.943259 3004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:50.944013 2997 server_base.cc:1034] running on GCE node
I20250115 10:11:50.944233 2997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:50.944413 2997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:50.945533 2997 hybrid_clock.cc:648] HybridClock initialized: now 1736935910945519 us; error 31 us; skew 500 ppm
I20250115 10:11:50.946545 2997 webserver.cc:458] Webserver started at http://127.2.217.189:38131/ using document root <none> and password file <none>
I20250115 10:11:50.946702 2997 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:50.946744 2997 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:50.946830 2997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:50.947583 2997 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/instance:
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.947858 2997 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal/instance:
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.948805 2997 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:50.949338 3012 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:50.949472 2997 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:50.949533 2997 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:50.949581 2997 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:50.959700 2997 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:50.959944 2997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:50.960036 2997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:50.963405 2997 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.189:36717
I20250115 10:11:50.963434 3064 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.189:36717 every 8 connection(s)
I20250115 10:11:50.963697 2997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
I20250115 10:11:50.964301 3065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:50.965847 3065 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:50.968518 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 2997
I20250115 10:11:50.968590 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal/instance
I20250115 10:11:50.968981 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.188:38283
--webserver_interface=127.2.217.188
--webserver_port=0
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250115 10:11:50.969566 3065 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:50.973202 3065 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } has no permanent_uuid. Determining permanent_uuid...
W20250115 10:11:50.973508 3015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
W20250115 10:11:50.973871 3065 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.188:38283: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
I20250115 10:11:50.984719 2993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } attempt: 2
I20250115 10:11:50.987445 2993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } has no permanent_uuid. Determining permanent_uuid...
W20250115 10:11:50.988022 2993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.188:38283: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
I20250115 10:11:51.023092 3065 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } attempt: 1
W20250115 10:11:51.023880 3065 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.188:38283: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
I20250115 10:11:51.031204 2993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } attempt: 1
W20250115 10:11:51.031934 2993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.188:38283: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
W20250115 10:11:51.041822 3068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:51.041977 3068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:51.041996 3068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:51.043243 3068 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:51.043279 3068 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:51.043291 3068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:51.043303 3068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:51.043313 3068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:51.043329 3068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:51.044828 3068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.188:38283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.217.188
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.3068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:51.045003 3068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:51.045172 3068 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:51.049407 3076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.050199 3075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.051002 3078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:51.051779 3068 server_base.cc:1034] running on GCE node
I20250115 10:11:51.051935 3068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:51.052103 3068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:51.053227 3068 hybrid_clock.cc:648] HybridClock initialized: now 1736935911053214 us; error 25 us; skew 500 ppm
I20250115 10:11:51.054364 3068 webserver.cc:458] Webserver started at http://127.2.217.188:35549/ using document root <none> and password file <none>
I20250115 10:11:51.054544 3068 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:51.054594 3068 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:51.054687 3068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:51.055534 3068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data/instance:
uuid: "cdb1ea5a27ca44baa3b0fe127143df0b"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.055842 3068 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal/instance:
uuid: "cdb1ea5a27ca44baa3b0fe127143df0b"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.056890 3068 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.057436 3084 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.057576 3068 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:51.057641 3068 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal
uuid: "cdb1ea5a27ca44baa3b0fe127143df0b"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.057691 3068 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:51.079093 2993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } attempt: 2
W20250115 10:11:51.079732 2993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.217.188:38283: Network error: Client connection negotiation failed: client connection to 127.2.217.188:38283: connect: Connection refused (error 111)
I20250115 10:11:51.080390 3068 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:51.080631 3068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:51.080710 3068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:51.084067 3068 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.188:38283
I20250115 10:11:51.084092 3136 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.188:38283 every 8 connection(s)
I20250115 10:11:51.084394 3068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/data/info.pb
I20250115 10:11:51.084951 3137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.086568 3137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:51.090248 3137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:51.092054 3065 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } attempt: 2
I20250115 10:11:51.092607 3137 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } has no permanent_uuid. Determining permanent_uuid...
I20250115 10:11:51.093233 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 3068
I20250115 10:11:51.093308 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-2/wal/instance
I20250115 10:11:51.096913 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Bootstrap starting.
I20250115 10:11:51.096922 3065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap starting.
I20250115 10:11:51.097590 3065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.097586 3137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.097893 3065 log.cc:826] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:51.098089 3137 log.cc:826] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:51.098579 3137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: No bootstrap required, opened a new log
I20250115 10:11:51.098698 3065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: No bootstrap required, opened a new log
I20250115 10:11:51.100242 3137 raft_consensus.cc:357] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.100387 3137 raft_consensus.cc:383] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.100423 3137 raft_consensus.cc:738] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb1ea5a27ca44baa3b0fe127143df0b, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.100498 3137 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.100721 3137 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:11:51.100674 3065 raft_consensus.cc:357] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.100772 3065 raft_consensus.cc:383] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.100803 3065 raft_consensus.cc:738] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4346420bb4a5abb9cf66799e35565, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.100880 3065 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.101147 3065 sys_catalog.cc:564] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:11:51.100718 3146 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.102290 3146 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:51.101135 3147 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
W20250115 10:11:51.102901 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20250115 10:11:51.102908 3147 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
W20250115 10:11:51.102993 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.103421 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.103518 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.102504 3068 master_runner.cc:186] Error getting master registration for 127.2.217.190:46859: OK, instance_id { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" instance_seqno: 1736935910857609 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250115 10:11:51.104465 3068 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250115 10:11:51.103179 2997 master_runner.cc:186] Error getting master registration for 127.2.217.190:46859: OK, instance_id { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" instance_seqno: 1736935910857609 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20250115 10:11:51.105083 2997 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250115 10:11:51.113226 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.113267 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.113803 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.113850 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.123461 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.123510 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.124032 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.124074 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.133713 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.133759 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.134263 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.134305 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.144006 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.144057 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.144487 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.144531 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.154285 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.154358 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.154771 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.154829 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.164608 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.164675 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.165057 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.165123 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.174914 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.174983 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.175352 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.175406 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.185228 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.185302 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.185603 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.185655 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.186897 2993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } attempt: 3
I20250115 10:11:51.191218 2993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Bootstrap starting.
I20250115 10:11:51.191944 2993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.192466 2993 log.cc:826] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:51.193117 2993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: No bootstrap required, opened a new log
I20250115 10:11:51.194816 2993 raft_consensus.cc:357] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.194934 2993 raft_consensus.cc:383] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.194967 2993 raft_consensus.cc:738] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f5e7c003a641128acc22b394ab62c7, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.195096 2993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.195430 2993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: configured and running, proceeding with master startup.
W20250115 10:11:51.195852 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.195899 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.197156 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.197239 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.198849 2926 master_runner.cc:263] No leader master found from master 88f5e7c003a641128acc22b394ab62c7
I20250115 10:11:51.198889 2926 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20250115 10:11:51.199091 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20250115 10:11:51.195384 3173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.199250 3173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: FOLLOWER
W20250115 10:11:51.199338 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.206140 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.206197 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.207530 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.207592 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.209632 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.209730 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.210511 3018 tablet.cc:2367] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20250115 10:11:51.216404 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.216454 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.217754 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.217801 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.219975 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.220064 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.226675 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.226729 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.228011 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.228057 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.230332 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.230419 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.236932 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.236979 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.238289 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.238334 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.240676 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.240778 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.247205 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.247259 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.248555 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.248600 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.251047 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.251149 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.257484 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.257534 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.258836 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.258882 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20250115 10:11:51.261402 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.261487 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.265919 3173 raft_consensus.cc:491] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.266008 3173 raft_consensus.cc:513] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.266273 3173 leader_election.cc:290] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:51.266556 3039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565" is_pre_election: true
I20250115 10:11:51.266571 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:11:51.266695 3111 raft_consensus.cc:2463] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 0.
I20250115 10:11:51.266693 3039 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 0.
I20250115 10:11:51.266933 2943 leader_election.cc:304] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88f5e7c003a641128acc22b394ab62c7, efd4346420bb4a5abb9cf66799e35565; no voters:
I20250115 10:11:51.267057 3173 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.267119 3173 raft_consensus.cc:491] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.267168 3173 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.268157 3173 raft_consensus.cc:513] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.268321 3173 leader_election.cc:290] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 1 election: Requested vote from peers efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
W20250115 10:11:51.268518 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.268559 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.268550 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b"
I20250115 10:11:51.268610 3111 raft_consensus.cc:3054] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.268672 3039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565"
I20250115 10:11:51.268724 3039 raft_consensus.cc:3054] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.269392 3111 raft_consensus.cc:2463] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 1.
I20250115 10:11:51.269483 3039 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 1.
I20250115 10:11:51.269593 2943 leader_election.cc:304] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b; no voters:
W20250115 10:11:51.269641 3184 catalog_manager.cc:1559] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.269691 3184 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.269654 3173 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.269850 3173 raft_consensus.cc:695] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 LEADER]: Becoming Leader. State: Replica: 88f5e7c003a641128acc22b394ab62c7, State: Running, Role: LEADER
I20250115 10:11:51.269987 3173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:51.270393 3186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.270514 3186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:51.270725 3188 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250115 10:11:51.270864 3188 catalog_manager.cc:1485] Initializing Kudu cluster ID...
W20250115 10:11:51.271749 3163 catalog_manager.cc:1559] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.271788 3163 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.272332 3111 raft_consensus.cc:1270] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Refusing update from remote peer 88f5e7c003a641128acc22b394ab62c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.272399 3039 raft_consensus.cc:1270] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Refusing update from remote peer 88f5e7c003a641128acc22b394ab62c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.272619 3186 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.272712 3173 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.273799 3146 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.273873 3146 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:51.273823 3147 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.273938 3147 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
W20250115 10:11:51.278733 3169 catalog_manager.cc:1559] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20250115 10:11:51.278776 3169 catalog_manager.cc:874] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.279670 3186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.279762 3186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:51.279968 3146 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.280038 3146 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:51.280124 3189 mvcc.cc:204] Tried to move back new op lower bound from 7114489492569550848 to 7114489492562489344. Current Snapshot: MvccSnapshot[applied={T|T < 7114489492569550848}]
I20250115 10:11:51.280203 3191 mvcc.cc:204] Tried to move back new op lower bound from 7114489492569550848 to 7114489492562489344. Current Snapshot: MvccSnapshot[applied={T|T < 7114489492569550848}]
I20250115 10:11:51.280735 3173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.280824 3173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:51.281158 3147 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:51.281226 3147 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:51.281237 3190 mvcc.cc:204] Tried to move back new op lower bound from 7114489492569550848 to 7114489492562489344. Current Snapshot: MvccSnapshot[applied={T|T < 7114489492569550848}]
I20250115 10:11:51.281771 3188 catalog_manager.cc:1348] Generated new cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:51.281816 3188 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250115 10:11:51.282040 3163 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:51.282073 3163 catalog_manager.cc:1553] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: loading cluster ID for follower catalog manager: success
W20250115 10:11:51.282116 3163 catalog_manager.cc:1577] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20250115 10:11:51.282132 3163 catalog_manager.cc:874] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.288496 3188 catalog_manager.cc:1371] Generated new certificate authority record
I20250115 10:11:51.289045 3169 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:51.289088 3169 catalog_manager.cc:1553] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: success
I20250115 10:11:51.289162 3188 catalog_manager.cc:1505] Loading token signing keys...
I20250115 10:11:51.289873 3169 catalog_manager.cc:1575] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: acquiring CA information for follower catalog manager: success
W20250115 10:11:51.289992 3169 catalog_manager.cc:874] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.293114 3163 catalog_manager.cc:1575] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: acquiring CA information for follower catalog manager: success
W20250115 10:11:51.293217 3163 catalog_manager.cc:874] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20250115 10:11:51.295058 3188 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Generated new TSK 0
I20250115 10:11:51.295212 3188 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250115 10:11:51.300338 3169 catalog_manager.cc:1603] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:11:51.303556 3163 catalog_manager.cc:1603] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:11:51.316051 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.217.129:0
--local_ip_for_outbound_sockets=127.2.217.129
--webserver_interface=127.2.217.129
--webserver_port=0
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20250115 10:11:51.389155 3198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:51.389309 3198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:51.389328 3198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:51.390491 3198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:51.390534 3198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.217.129
I20250115 10:11:51.391777 3198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.217.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.217.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--never_fsync=true
--heap_profile_path=/tmp/kudu.3198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.217.129
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:51.391948 3198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:51.392158 3198 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:51.396761 3204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.397482 3203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.398177 3206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:51.398857 3198 server_base.cc:1034] running on GCE node
I20250115 10:11:51.398979 3198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:51.399128 3198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:51.400245 3198 hybrid_clock.cc:648] HybridClock initialized: now 1736935911400236 us; error 24 us; skew 500 ppm
I20250115 10:11:51.401300 3198 webserver.cc:458] Webserver started at http://127.2.217.129:41689/ using document root <none> and password file <none>
I20250115 10:11:51.401479 3198 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:51.401522 3198 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:51.401644 3198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:51.402568 3198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data/instance:
uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.402941 3198 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/instance:
uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.404105 3198 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20250115 10:11:51.404732 3212 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.404894 3198 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:51.404961 3198 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal
uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.405017 3198 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:51.431282 3198 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:51.431505 3198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:51.431603 3198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:51.431797 3198 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 10:11:51.432068 3198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 10:11:51.432099 3198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.432127 3198 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 10:11:51.432145 3198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.437060 3198 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.129:46457
I20250115 10:11:51.437156 3325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.129:46457 every 8 connection(s)
I20250115 10:11:51.437386 3198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/data/info.pb
I20250115 10:11:51.440291 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 3198
I20250115 10:11:51.440371 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/instance
I20250115 10:11:51.441992 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.217.130:0
--local_ip_for_outbound_sockets=127.2.217.130
--webserver_interface=127.2.217.130
--webserver_port=0
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250115 10:11:51.442430 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:51.442512 3328 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.442698 3328 heartbeater.cc:509] Master 127.2.217.189:36717 requested a full tablet report, sending...
I20250115 10:11:51.443111 3327 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
I20250115 10:11:51.443166 3327 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.443177 3326 heartbeater.cc:346] Connected to a master server at 127.2.217.188:38283
I20250115 10:11:51.443212 3326 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.443197 3029 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.443255 3327 heartbeater.cc:509] Master 127.2.217.190:46859 requested a full tablet report, sending...
I20250115 10:11:51.443276 3326 heartbeater.cc:509] Master 127.2.217.188:38283 requested a full tablet report, sending...
I20250115 10:11:51.443526 2957 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.443607 3101 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.444511 2957 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.217.129:48387
W20250115 10:11:51.512774 3333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:51.512917 3333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:51.512935 3333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:51.513968 3333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:51.514007 3333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.217.130
I20250115 10:11:51.515362 3333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.217.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.217.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--never_fsync=true
--heap_profile_path=/tmp/kudu.3333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.217.130
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:51.515519 3333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:51.515683 3333 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:51.520107 3339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.520879 3338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.521625 3341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:51.522395 3333 server_base.cc:1034] running on GCE node
I20250115 10:11:51.522547 3333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:51.522724 3333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:51.523890 3333 hybrid_clock.cc:648] HybridClock initialized: now 1736935911523869 us; error 33 us; skew 500 ppm
I20250115 10:11:51.525004 3333 webserver.cc:458] Webserver started at http://127.2.217.130:46165/ using document root <none> and password file <none>
I20250115 10:11:51.525184 3333 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:51.525233 3333 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:51.525339 3333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:51.526100 3333 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data/instance:
uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.526381 3333 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/instance:
uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.527473 3333 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20250115 10:11:51.528086 3347 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.528236 3333 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.528321 3333 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal
uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.528388 3333 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:51.539726 3333 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:51.539968 3333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:51.540066 3333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:51.540221 3333 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 10:11:51.540477 3333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 10:11:51.540508 3333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.540539 3333 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 10:11:51.540565 3333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.545955 3333 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.130:35883
I20250115 10:11:51.546010 3460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.130:35883 every 8 connection(s)
I20250115 10:11:51.546241 3333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/data/info.pb
I20250115 10:11:51.546571 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 3333
I20250115 10:11:51.546658 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/instance
I20250115 10:11:51.548115 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.217.131:0
--local_ip_for_outbound_sockets=127.2.217.131
--webserver_interface=127.2.217.131
--webserver_port=0
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20250115 10:11:51.551638 3461 heartbeater.cc:346] Connected to a master server at 127.2.217.188:38283
I20250115 10:11:51.551743 3461 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.551898 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:51.551934 3463 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.551951 3461 heartbeater.cc:509] Master 127.2.217.188:38283 requested a full tablet report, sending...
I20250115 10:11:51.552134 3462 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
I20250115 10:11:51.552167 3463 heartbeater.cc:509] Master 127.2.217.189:36717 requested a full tablet report, sending...
I20250115 10:11:51.552184 3462 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.552278 3462 heartbeater.cc:509] Master 127.2.217.190:46859 requested a full tablet report, sending...
I20250115 10:11:51.552435 3101 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.552435 3029 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.552559 2957 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.552878 2957 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.217.130:44525
W20250115 10:11:51.620708 3468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:51.620865 3468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:51.620885 3468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:51.621963 3468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:51.622002 3468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.217.131
I20250115 10:11:51.623332 3468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.217.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.217.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--never_fsync=true
--heap_profile_path=/tmp/kudu.3468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.217.131
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:51.623489 3468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:51.623664 3468 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:51.628216 3474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.628942 3476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:51.629667 3473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:51.630393 3468 server_base.cc:1034] running on GCE node
I20250115 10:11:51.630528 3468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:51.630695 3468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:51.631822 3468 hybrid_clock.cc:648] HybridClock initialized: now 1736935911631804 us; error 34 us; skew 500 ppm
I20250115 10:11:51.632941 3468 webserver.cc:458] Webserver started at http://127.2.217.131:36853/ using document root <none> and password file <none>
I20250115 10:11:51.633126 3468 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:51.633173 3468 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:51.633268 3468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 10:11:51.634073 3468 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data/instance:
uuid: "89067c97cc1c45e699ee9f690cb3014f"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.634369 3468 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/instance:
uuid: "89067c97cc1c45e699ee9f690cb3014f"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.635493 3468 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20250115 10:11:51.636148 3482 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.636287 3468 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.636353 3468 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal
uuid: "89067c97cc1c45e699ee9f690cb3014f"
format_stamp: "Formatted at 2025-01-15 10:11:51 on dist-test-slave-lj0b"
I20250115 10:11:51.636404 3468 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:51.642216 3468 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:51.642413 3468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:51.642503 3468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:51.642644 3468 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 10:11:51.642961 3468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 10:11:51.642992 3468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.643023 3468 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 10:11:51.643049 3468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.648278 3468 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.131:38229
I20250115 10:11:51.648335 3595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.131:38229 every 8 connection(s)
I20250115 10:11:51.648566 3468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/data/info.pb
I20250115 10:11:51.652985 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 3468
I20250115 10:11:51.653057 2918 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/instance
I20250115 10:11:51.653925 3596 heartbeater.cc:346] Connected to a master server at 127.2.217.188:38283
I20250115 10:11:51.653941 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:51.654021 3596 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.654024 3598 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.653926 3597 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
I20250115 10:11:51.654237 3596 heartbeater.cc:509] Master 127.2.217.188:38283 requested a full tablet report, sending...
I20250115 10:11:51.654309 3597 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:51.654238 3598 heartbeater.cc:509] Master 127.2.217.189:36717 requested a full tablet report, sending...
I20250115 10:11:51.654381 3597 heartbeater.cc:509] Master 127.2.217.190:46859 requested a full tablet report, sending...
I20250115 10:11:51.654671 3100 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.654697 3029 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.654722 2957 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.655192 2957 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.217.131:55391
I20250115 10:11:51.666321 2918 external_mini_cluster.cc:934] 3 TS(s) registered with all masters
I20250115 10:11:51.673437 2918 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskjHaIeY/build/release/bin/kudu with pid 2997
I20250115 10:11:51.673274 2955 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_62a87ba638f04bfaad2cf4a2a08265ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.673430 2952 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_1441e59cd28446c9a103b30abf736c21"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.680034 2948 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_268e30df1e4e43faa7014bfa9ba9701e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.673079 2956 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_ec7282dfde9840be9b1134b011c7aa9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.673345 2954 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_a8d8619f67ed451eaf40f90281c93f55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.679802 2957 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_3f64767f24e640498de579f5277be624"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.681282 2948 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_268e30df1e4e43faa7014bfa9ba9701e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.681298 2955 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62a87ba638f04bfaad2cf4a2a08265ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.681358 2957 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f64767f24e640498de579f5277be624 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.673458 2951 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_769861840dc749e58284ff9920446f2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.681648 2951 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_769861840dc749e58284ff9920446f2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.679996 2949 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_282ebfe1234746ec8f8050ef95cb97a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.681764 2949 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_282ebfe1234746ec8f8050ef95cb97a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.673517 2950 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_365afed07b214f3a87cbf3028d8c2083"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.681903 2950 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_365afed07b214f3a87cbf3028d8c2083 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.682015 2954 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8d8619f67ed451eaf40f90281c93f55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.673374 2953 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_ca3b2f90d2314863b7d930b23f66b6b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.682164 2953 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca3b2f90d2314863b7d930b23f66b6b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.682229 2952 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1441e59cd28446c9a103b30abf736c21 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.682498 2956 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec7282dfde9840be9b1134b011c7aa9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.683046 2943 connection.cc:537] client connection to 127.2.217.189:36717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250115 10:11:51.683965 2943 consensus_peers.cc:487] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 -> Peer efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717): Couldn't send request to peer efd4346420bb4a5abb9cf66799e35565. Status: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:51.684957 2953 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_268e30df1e4e43faa7014bfa9ba9701e" } new_table_name: "default.Table_74e05b3f1a2249219804cdb8e819e545" modify_external_catalogs: true
I20250115 10:11:51.684964 2952 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_62a87ba638f04bfaad2cf4a2a08265ed" } new_table_name: "default.Table_deaace1173e04b83ba96f076133db764" modify_external_catalogs: true
I20250115 10:11:51.685472 2949 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_282ebfe1234746ec8f8050ef95cb97a8" } new_table_name: "default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a" modify_external_catalogs: true
I20250115 10:11:51.685509 2954 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_365afed07b214f3a87cbf3028d8c2083" } new_table_name: "default.Table_35d3d808bf4949f19a5129adb689c544" modify_external_catalogs: true
I20250115 10:11:51.685540 2957 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_a8d8619f67ed451eaf40f90281c93f55" } modify_external_catalogs: true
I20250115 10:11:51.685616 2955 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_ca3b2f90d2314863b7d930b23f66b6b7" } modify_external_catalogs: true
I20250115 10:11:51.685645 2950 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_1441e59cd28446c9a103b30abf736c21" } modify_external_catalogs: true
I20250115 10:11:51.685663 2955 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_ca3b2f90d2314863b7d930b23f66b6b7" } modify_external_catalogs: true
I20250115 10:11:51.685676 2950 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_1441e59cd28446c9a103b30abf736c21" } modify_external_catalogs: true
I20250115 10:11:51.685726 2948 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_3f64767f24e640498de579f5277be624" } modify_external_catalogs: true
I20250115 10:11:51.685758 2948 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_3f64767f24e640498de579f5277be624" } modify_external_catalogs: true
I20250115 10:11:51.685794 2957 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_a8d8619f67ed451eaf40f90281c93f55" } modify_external_catalogs: true
I20250115 10:11:51.687492 2951 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_ec7282dfde9840be9b1134b011c7aa9e" } modify_external_catalogs: true
I20250115 10:11:51.687536 2956 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_769861840dc749e58284ff9920446f2f" } new_table_name: "default.Table_7714ae6f7f524cc284951b61226ccfa0" modify_external_catalogs: true
I20250115 10:11:51.687551 2951 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_ec7282dfde9840be9b1134b011c7aa9e" } modify_external_catalogs: true
W20250115 10:11:51.688325 2952 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95a236fda8124147a057be51ecfff945 has no consensus state
W20250115 10:11:51.688393 2953 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ea2073842ad420ba398e16463395c7d consensus state has no leader
W20250115 10:11:51.688438 2954 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 01285bc3401243e9bcbba5062c80dbfa has no consensus state
W20250115 10:11:51.688473 2949 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db1eb078c2d74b0c8ebff56863717195 has no consensus state
I20250115 10:11:51.688942 3395 tablet_service.cc:1467] Processing CreateTablet for tablet 6ea2073842ad420ba398e16463395c7d (DEFAULT_TABLE table=default.Table_268e30df1e4e43faa7014bfa9ba9701e [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.689227 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea2073842ad420ba398e16463395c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.689595 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c (DEFAULT_TABLE table=default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.689678 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dea00fb185f4e669d3e359e3d596b8c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.689733 2956 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26762eb174a94121a04965f2c9ac0f26 has no consensus state
I20250115 10:11:51.689810 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 9d120757688e4233ba953bd2735bb354 (DEFAULT_TABLE table=default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.689880 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d120757688e4233ba953bd2735bb354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.690034 3392 tablet_service.cc:1467] Processing CreateTablet for tablet e6bff408085042bd8a266b844d007c97 (DEFAULT_TABLE table=default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.690055 2951 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet dc2d446a68bb4e9b9f00f0f007016ca6
I20250115 10:11:51.690091 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bff408085042bd8a266b844d007c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.690234 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 95a236fda8124147a057be51ecfff945 (DEFAULT_TABLE table=default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.690308 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a236fda8124147a057be51ecfff945. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.690989 2955 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet e6bff408085042bd8a266b844d007c97
I20250115 10:11:51.691267 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 01285bc3401243e9bcbba5062c80dbfa (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.691335 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01285bc3401243e9bcbba5062c80dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.692456 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 (DEFAULT_TABLE table=default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.692534 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bb6a726c304a3a99ef485a9a087cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693300 3527 tablet_service.cc:1467] Processing CreateTablet for tablet e6bff408085042bd8a266b844d007c97 (DEFAULT_TABLE table=default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693419 3388 tablet_service.cc:1467] Processing CreateTablet for tablet db1eb078c2d74b0c8ebff56863717195 (DEFAULT_TABLE table=default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693439 3523 tablet_service.cc:1467] Processing CreateTablet for tablet db1eb078c2d74b0c8ebff56863717195 (DEFAULT_TABLE table=default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693456 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c (DEFAULT_TABLE table=default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693493 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1eb078c2d74b0c8ebff56863717195. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693297 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 9d120757688e4233ba953bd2735bb354 (DEFAULT_TABLE table=default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693585 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dea00fb185f4e669d3e359e3d596b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693645 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d120757688e4233ba953bd2735bb354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693800 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 (DEFAULT_TABLE table=default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693511 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.693837 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1eb078c2d74b0c8ebff56863717195. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693300 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 95a236fda8124147a057be51ecfff945 (DEFAULT_TABLE table=default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.693915 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a236fda8124147a057be51ecfff945. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.694006 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 26762eb174a94121a04965f2c9ac0f26 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.694096 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26762eb174a94121a04965f2c9ac0f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.694205 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bb6a726c304a3a99ef485a9a087cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.693334 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 01285bc3401243e9bcbba5062c80dbfa (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.694339 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01285bc3401243e9bcbba5062c80dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.694612 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 6ea2073842ad420ba398e16463395c7d (DEFAULT_TABLE table=default.Table_268e30df1e4e43faa7014bfa9ba9701e [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.694676 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea2073842ad420ba398e16463395c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.695188 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bff408085042bd8a266b844d007c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.697209 2950 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9d120757688e4233ba953bd2735bb354
I20250115 10:11:51.697376 2957 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 45bb6a726c304a3a99ef485a9a087cc1
I20250115 10:11:51.697484 2948 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3dea00fb185f4e669d3e359e3d596b8c
I20250115 10:11:51.697798 3524 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.698822 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.698875 3528 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.698987 3657 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.699136 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.699548 3657 tablet_bootstrap.cc:654] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.699555 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
W20250115 10:11:51.699558 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3dea00fb185f4e669d3e359e3d596b8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dea00fb185f4e669d3e359e3d596b8c already in progress: creating tablet
I20250115 10:11:51.699626 3393 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.699712 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.699803 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 26762eb174a94121a04965f2c9ac0f26 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.699888 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26762eb174a94121a04965f2c9ac0f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.700028 3657 log.cc:826] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:51.700537 3657 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.700579 3657 ts_tablet_manager.cc:1397] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
W20250115 10:11:51.701309 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d120757688e4233ba953bd2735bb354 already in progress: creating tablet
W20250115 10:11:51.701362 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45bb6a726c304a3a99ef485a9a087cc1 already in progress: creating tablet
W20250115 10:11:51.701403 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet e6bff408085042bd8a266b844d007c97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bff408085042bd8a266b844d007c97 already in progress: creating tablet
I20250115 10:11:51.701447 3655 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.701565 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 6ea2073842ad420ba398e16463395c7d (DEFAULT_TABLE table=default.Table_268e30df1e4e43faa7014bfa9ba9701e [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.701819 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea2073842ad420ba398e16463395c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.701931 3655 tablet_bootstrap.cc:654] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.702364 3655 log.cc:826] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:51.702899 3655 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.702952 3655 ts_tablet_manager.cc:1397] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:51.703811 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c (DEFAULT_TABLE table=default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.703882 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.704083 3249 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
W20250115 10:11:51.704317 2943 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3dea00fb185f4e669d3e359e3d596b8c because the tablet was not found. No further retry: Not found: Tablet not found: 3dea00fb185f4e669d3e359e3d596b8c
I20250115 10:11:51.704336 3250 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
W20250115 10:11:51.704356 2943 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because the tablet was not found. No further retry: Not found: Tablet not found: 45bb6a726c304a3a99ef485a9a087cc1
I20250115 10:11:51.704445 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 26762eb174a94121a04965f2c9ac0f26 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:11:51.704501 2943 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because the tablet was not found. No further retry: Not found: Tablet not found: 9d120757688e4233ba953bd2735bb354
I20250115 10:11:51.704545 3662 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.704563 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.704666 3253 tablet_service.cc:1467] Processing CreateTablet for tablet db1eb078c2d74b0c8ebff56863717195 (DEFAULT_TABLE table=default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:11:51.704736 2943 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet e6bff408085042bd8a266b844d007c97 because the tablet was not found. No further retry: Not found: Tablet not found: e6bff408085042bd8a266b844d007c97
I20250115 10:11:51.704767 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 (DEFAULT_TABLE table=default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.704773 3655 raft_consensus.cc:357] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.704877 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 01285bc3401243e9bcbba5062c80dbfa (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.704901 3655 raft_consensus.cc:383] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.704931 3655 raft_consensus.cc:738] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.705032 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 95a236fda8124147a057be51ecfff945 (DEFAULT_TABLE table=default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.705049 3655 consensus_queue.cc:260] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.705171 3257 tablet_service.cc:1467] Processing CreateTablet for tablet e6bff408085042bd8a266b844d007c97 (DEFAULT_TABLE table=default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.705268 3655 ts_tablet_manager.cc:1428] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250115 10:11:51.705288 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 9d120757688e4233ba953bd2735bb354 (DEFAULT_TABLE table=default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.705560 3462 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
I20250115 10:11:51.703918 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dea00fb185f4e669d3e359e3d596b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.705688 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bff408085042bd8a266b844d007c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.705928 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d120757688e4233ba953bd2735bb354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.705991 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.706039 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.706061 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.706084 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.706106 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.706569 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.706640 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.706673 3393 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.706703 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.706840 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1eb078c2d74b0c8ebff56863717195. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.706952 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01285bc3401243e9bcbba5062c80dbfa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.707150 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet e6bff408085042bd8a266b844d007c97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bff408085042bd8a266b844d007c97 already in progress: creating tablet
I20250115 10:11:51.707177 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bb6a726c304a3a99ef485a9a087cc1. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.707202 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3dea00fb185f4e669d3e359e3d596b8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dea00fb185f4e669d3e359e3d596b8c already in progress: creating tablet
W20250115 10:11:51.707232 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45bb6a726c304a3a99ef485a9a087cc1 already in progress: creating tablet
W20250115 10:11:51.707268 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d120757688e4233ba953bd2735bb354 already in progress: creating tablet
W20250115 10:11:51.707631 3463 heartbeater.cc:646] Failed to heartbeat to 127.2.217.189:36717 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
I20250115 10:11:51.707700 3655 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.707769 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a236fda8124147a057be51ecfff945. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.708117 3655 tablet_bootstrap.cc:654] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.708328 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26762eb174a94121a04965f2c9ac0f26. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.708345 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet e6bff408085042bd8a266b844d007c97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bff408085042bd8a266b844d007c97 already in progress: creating tablet
W20250115 10:11:51.708492 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45bb6a726c304a3a99ef485a9a087cc1 already in progress: creating tablet
W20250115 10:11:51.708645 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d120757688e4233ba953bd2735bb354 already in progress: creating tablet
W20250115 10:11:51.708775 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3dea00fb185f4e669d3e359e3d596b8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dea00fb185f4e669d3e359e3d596b8c already in progress: creating tablet
I20250115 10:11:51.709134 3657 raft_consensus.cc:357] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.709266 3657 raft_consensus.cc:383] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.709297 3657 raft_consensus.cc:738] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.709379 3657 consensus_queue.cc:260] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.709453 3655 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.709489 3655 ts_tablet_manager.cc:1397] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:51.709638 3657 ts_tablet_manager.cc:1428] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20250115 10:11:51.709646 3655 raft_consensus.cc:357] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.709693 3655 raft_consensus.cc:383] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.709715 3655 raft_consensus.cc:738] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.709745 3597 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
I20250115 10:11:51.709859 3655 consensus_queue.cc:260] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.710016 3655 ts_tablet_manager.cc:1428] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:51.710053 3657 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.710266 2948 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.710320 2948 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.710340 2948 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.710358 2948 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.710374 2948 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.710471 3657 tablet_bootstrap.cc:654] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.710522 3662 tablet_bootstrap.cc:654] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.710719 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.710790 3662 log.cc:826] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Log is configured to *not* fsync() on all Append() calls
W20250115 10:11:51.710990 3598 heartbeater.cc:646] Failed to heartbeat to 127.2.217.189:36717 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
I20250115 10:11:51.711287 3662 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.711335 3655 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.711342 3662 ts_tablet_manager.cc:1397] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20250115 10:11:51.711337 3528 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.711418 3525 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.711488 3656 tablet_replica.cc:331] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:11:51.711498 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d120757688e4233ba953bd2735bb354 already in progress: creating tablet
I20250115 10:11:51.711546 3656 raft_consensus.cc:2238] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.711601 3656 raft_consensus.cc:2267] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.711905 3655 tablet_bootstrap.cc:654] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.711896 3656 ts_tablet_manager.cc:1905] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.712397 3655 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.712448 3655 ts_tablet_manager.cc:1397] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.712586 3655 raft_consensus.cc:357] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.712648 3655 raft_consensus.cc:383] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.712670 3655 raft_consensus.cc:738] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.712724 3655 consensus_queue.cc:260] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.712829 2948 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.712857 3655 ts_tablet_manager.cc:1428] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.712916 3655 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.713059 3662 raft_consensus.cc:357] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.713172 3662 raft_consensus.cc:383] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.713201 3662 raft_consensus.cc:738] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.713315 3655 tablet_bootstrap.cc:654] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.713271 3662 consensus_queue.cc:260] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.713522 3662 ts_tablet_manager.cc:1428] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250115 10:11:51.713585 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.713639 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.713678 3662 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.713748 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.713860 3658 tablet_replica.cc:331] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.713924 3658 raft_consensus.cc:2238] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.713986 3658 raft_consensus.cc:2267] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.714071 3662 tablet_bootstrap.cc:654] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.714244 3658 ts_tablet_manager.cc:1905] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.714365 3656 ts_tablet_manager.cc:1918] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.714390 3327 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
I20250115 10:11:51.714419 3656 log.cc:1198] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/e6bff408085042bd8a266b844d007c97
I20250115 10:11:51.714612 3656 ts_tablet_manager.cc:1939] T e6bff408085042bd8a266b844d007c97 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.714960 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet e6bff408085042bd8a266b844d007c97 (table default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]) successfully deleted
W20250115 10:11:51.715029 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45bb6a726c304a3a99ef485a9a087cc1 already in progress: creating tablet
W20250115 10:11:51.715075 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3dea00fb185f4e669d3e359e3d596b8c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dea00fb185f4e669d3e359e3d596b8c already in progress: creating tablet
W20250115 10:11:51.715258 3328 heartbeater.cc:646] Failed to heartbeat to 127.2.217.189:36717 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111)
I20250115 10:11:51.715516 3662 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.715559 3662 ts_tablet_manager.cc:1397] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:51.715653 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.715700 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.715693 3662 raft_consensus.cc:357] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.715771 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.715771 3662 raft_consensus.cc:383] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.715795 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.715796 3662 raft_consensus.cc:738] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.715826 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.715830 3662 consensus_queue.cc:260] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.715911 3658 ts_tablet_manager.cc:1918] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.715970 3658 log.cc:1198] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/45bb6a726c304a3a99ef485a9a087cc1
I20250115 10:11:51.715965 3662 ts_tablet_manager.cc:1428] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.716053 3662 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.716104 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.716147 3655 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.716162 3658 ts_tablet_manager.cc:1939] T 45bb6a726c304a3a99ef485a9a087cc1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.716184 3655 ts_tablet_manager.cc:1397] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:11:51.716176 3251 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.716248 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.716352 3655 raft_consensus.cc:357] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.716383 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.716408 3655 raft_consensus.cc:383] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.716429 3655 raft_consensus.cc:738] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.716467 3655 consensus_queue.cc:260] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.716545 3655 ts_tablet_manager.cc:1428] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.716565 3662 tablet_bootstrap.cc:654] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.716609 3655 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:11:51.716809 2944 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ea2073842ad420ba398e16463395c7d consensus state has no leader
I20250115 10:11:51.716981 3655 tablet_bootstrap.cc:654] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:51.717003 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet e6bff408085042bd8a266b844d007c97 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bff408085042bd8a266b844d007c97 already in progress: creating tablet
I20250115 10:11:51.717049 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 45bb6a726c304a3a99ef485a9a087cc1 (table default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]) successfully deleted
I20250115 10:11:51.717087 3661 tablet_replica.cc:331] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.717084 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.717161 3661 raft_consensus.cc:2238] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.717212 3661 raft_consensus.cc:2267] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.717558 3661 ts_tablet_manager.cc:1905] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.717561 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.717612 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.718775 3657 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.718828 3657 ts_tablet_manager.cc:1397] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:11:51.718900 3662 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.718931 3655 tablet_bootstrap.cc:492] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.718951 3662 ts_tablet_manager.cc:1397] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:11:51.718971 3655 ts_tablet_manager.cc:1397] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.718961 3657 raft_consensus.cc:357] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719023 3657 raft_consensus.cc:383] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.719058 3657 raft_consensus.cc:738] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.719121 3657 consensus_queue.cc:260] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719107 3662 raft_consensus.cc:357] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719157 3662 raft_consensus.cc:383] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.719130 3655 raft_consensus.cc:357] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719175 3662 raft_consensus.cc:738] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.719193 3655 raft_consensus.cc:383] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.719189 3657 ts_tablet_manager.cc:1428] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:51.719219 3655 raft_consensus.cc:738] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.719213 3662 consensus_queue.cc:260] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719259 3657 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.719255 3655 consensus_queue.cc:260] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.719295 3662 ts_tablet_manager.cc:1428] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:51.719322 3655 ts_tablet_manager.cc:1428] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.719358 3662 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.719383 3655 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.719798 3662 tablet_bootstrap.cc:654] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.719817 3657 tablet_bootstrap.cc:654] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.719924 3655 tablet_bootstrap.cc:654] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.720161 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.720232 3658 tablet_replica.cc:331] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.720265 3658 raft_consensus.cc:2238] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.720257 3661 ts_tablet_manager.cc:1918] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.720293 3658 raft_consensus.cc:2267] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.720304 3661 log.cc:1198] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3dea00fb185f4e669d3e359e3d596b8c
I20250115 10:11:51.720477 3661 ts_tablet_manager.cc:1939] T 3dea00fb185f4e669d3e359e3d596b8c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.720924 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.721000 3656 tablet_replica.cc:331] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.721027 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet e6bff408085042bd8a266b844d007c97 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.721050 3656 raft_consensus.cc:2238] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.721076 3656 raft_consensus.cc:2267] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.721112 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3dea00fb185f4e669d3e359e3d596b8c (table default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]) successfully deleted
I20250115 10:11:51.721127 3661 tablet_replica.cc:331] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
W20250115 10:11:51.721174 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 45bb6a726c304a3a99ef485a9a087cc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 45bb6a726c304a3a99ef485a9a087cc1 already in progress: creating tablet
I20250115 10:11:51.721180 3661 raft_consensus.cc:2238] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250115 10:11:51.721232 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 9d120757688e4233ba953bd2735bb354 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9d120757688e4233ba953bd2735bb354 already in progress: creating tablet
I20250115 10:11:51.721233 3661 raft_consensus.cc:2267] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.721360 3661 ts_tablet_manager.cc:1905] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.721638 3655 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.721653 3662 tablet_bootstrap.cc:492] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.721685 3655 ts_tablet_manager.cc:1397] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.721685 3662 ts_tablet_manager.cc:1397] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.721803 3662 raft_consensus.cc:357] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.721809 3655 raft_consensus.cc:357] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.721855 3662 raft_consensus.cc:383] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.721863 3655 raft_consensus.cc:383] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.721877 3662 raft_consensus.cc:738] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.721882 3655 raft_consensus.cc:738] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.721915 3662 consensus_queue.cc:260] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.721921 3656 ts_tablet_manager.cc:1905] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.721932 3655 consensus_queue.cc:260] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.721984 3662 ts_tablet_manager.cc:1428] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.722007 3655 ts_tablet_manager.cc:1428] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.722040 3662 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.722409 3662 tablet_bootstrap.cc:654] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.722644 3661 ts_tablet_manager.cc:1918] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.722681 3661 log.cc:1198] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/e6bff408085042bd8a266b844d007c97
I20250115 10:11:51.722898 3661 ts_tablet_manager.cc:1939] T e6bff408085042bd8a266b844d007c97 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.722990 3656 ts_tablet_manager.cc:1918] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.723024 3656 log.cc:1198] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/9d120757688e4233ba953bd2735bb354
I20250115 10:11:51.723115 3655 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.723134 3656 ts_tablet_manager.cc:1939] T 9d120757688e4233ba953bd2735bb354 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.723517 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.723588 3655 tablet_bootstrap.cc:654] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.723606 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 9d120757688e4233ba953bd2735bb354 (table default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]) successfully deleted
I20250115 10:11:51.723666 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet e6bff408085042bd8a266b844d007c97 (table default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]) successfully deleted
I20250115 10:11:51.723992 3658 ts_tablet_manager.cc:1905] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.723985 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d120757688e4233ba953bd2735bb354 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.724241 3661 tablet_replica.cc:331] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.724288 3661 raft_consensus.cc:2238] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.724321 3661 raft_consensus.cc:2267] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.724522 3662 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.724572 3662 ts_tablet_manager.cc:1397] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.724748 3662 raft_consensus.cc:357] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.724802 3662 raft_consensus.cc:383] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.724814 3662 raft_consensus.cc:738] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.724846 3662 consensus_queue.cc:260] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.724912 3662 ts_tablet_manager.cc:1428] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.724960 3662 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.725039 3658 ts_tablet_manager.cc:1918] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.725073 3658 log.cc:1198] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/e6bff408085042bd8a266b844d007c97
I20250115 10:11:51.725189 3658 ts_tablet_manager.cc:1939] T e6bff408085042bd8a266b844d007c97 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.725406 3662 tablet_bootstrap.cc:654] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.724519 3661 ts_tablet_manager.cc:1905] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.725808 3658 tablet_replica.cc:331] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.725864 3658 raft_consensus.cc:2238] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.725893 3658 raft_consensus.cc:2267] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.725898 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.725939 3662 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.725977 3662 ts_tablet_manager.cc:1397] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.725996 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet e6bff408085042bd8a266b844d007c97 (table default.Table_ca3b2f90d2314863b7d930b23f66b6b7 [id=26c31286f17043d78a85449c03e09d59]) successfully deleted
I20250115 10:11:51.726150 3662 raft_consensus.cc:357] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.726222 3662 raft_consensus.cc:383] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.726249 3662 raft_consensus.cc:738] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.726300 3662 consensus_queue.cc:260] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.726408 3662 ts_tablet_manager.cc:1428] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.726467 3662 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.726562 3657 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.726601 3657 ts_tablet_manager.cc:1397] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:11:51.726747 3657 raft_consensus.cc:357] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.726797 3657 raft_consensus.cc:383] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.726819 3657 raft_consensus.cc:738] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.726898 3662 tablet_bootstrap.cc:654] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.726890 3657 consensus_queue.cc:260] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.726974 3657 ts_tablet_manager.cc:1428] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:51.727041 3657 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.727041 3661 ts_tablet_manager.cc:1918] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.727082 3661 log.cc:1198] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/9d120757688e4233ba953bd2735bb354
I20250115 10:11:51.727248 3661 ts_tablet_manager.cc:1939] T 9d120757688e4233ba953bd2735bb354 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.727336 2948 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.727380 3657 tablet_bootstrap.cc:654] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.727541 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 9d120757688e4233ba953bd2735bb354 (table default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]) successfully deleted
I20250115 10:11:51.727686 3658 ts_tablet_manager.cc:1905] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.727698 3655 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.727795 3655 ts_tablet_manager.cc:1397] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:11:51.727946 3655 raft_consensus.cc:357] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.728005 3655 raft_consensus.cc:383] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.728029 3655 raft_consensus.cc:738] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.728075 3655 consensus_queue.cc:260] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.728170 3655 ts_tablet_manager.cc:1428] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.728224 3655 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.728570 3655 tablet_bootstrap.cc:654] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.728886 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.728947 3656 tablet_replica.cc:331] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.728967 3658 ts_tablet_manager.cc:1918] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.728977 3656 raft_consensus.cc:2238] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.728991 3662 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.729007 3656 raft_consensus.cc:2267] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.729009 3658 log.cc:1198] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/9d120757688e4233ba953bd2735bb354
I20250115 10:11:51.729024 3662 ts_tablet_manager.cc:1397] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:51.729171 3658 ts_tablet_manager.cc:1939] T 9d120757688e4233ba953bd2735bb354 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.729159 3662 raft_consensus.cc:357] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.729211 3662 raft_consensus.cc:383] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.729233 3662 raft_consensus.cc:738] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.729283 3662 consensus_queue.cc:260] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.729315 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.729393 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 9d120757688e4233ba953bd2735bb354 (table default.Table_1441e59cd28446c9a103b30abf736c21 [id=941c288cbfdd43e18f708cb2b9936cf4]) successfully deleted
I20250115 10:11:51.729449 2948 master_service.cc:946] ReplaceTablet: received request to replace tablet 26762eb174a94121a04965f2c9ac0f26 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.729525 3656 ts_tablet_manager.cc:1905] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.729796 3658 tablet_replica.cc:331] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.729843 3658 raft_consensus.cc:2238] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.729885 3658 raft_consensus.cc:2267] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.729986 2950 master_service.cc:946] ReplaceTablet: received request to replace tablet 26762eb174a94121a04965f2c9ac0f26 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.730078 3658 ts_tablet_manager.cc:1905] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.730088 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.730419 2957 master_service.cc:946] ReplaceTablet: received request to replace tablet 9d120757688e4233ba953bd2735bb354 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.730505 3656 ts_tablet_manager.cc:1918] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.730545 3656 log.cc:1198] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/45bb6a726c304a3a99ef485a9a087cc1
I20250115 10:11:51.730574 3662 ts_tablet_manager.cc:1428] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.730684 3656 ts_tablet_manager.cc:1939] T 45bb6a726c304a3a99ef485a9a087cc1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.730942 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 45bb6a726c304a3a99ef485a9a087cc1 (table default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]) successfully deleted
I20250115 10:11:51.731156 2957 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.731163 3658 ts_tablet_manager.cc:1918] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.731206 3658 log.cc:1198] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3dea00fb185f4e669d3e359e3d596b8c
I20250115 10:11:51.731343 3658 ts_tablet_manager.cc:1939] T 3dea00fb185f4e669d3e359e3d596b8c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.731468 2948 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 26762eb174a94121a04965f2c9ac0f26
I20250115 10:11:51.731539 2948 catalog_manager.cc:6596] ReplaceTablet: tablet 26762eb174a94121a04965f2c9ac0f26 deleted and replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588
I20250115 10:11:51.731729 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.731763 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:40126
W20250115 10:11:51.731899 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 26762eb174a94121a04965f2c9ac0f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26762eb174a94121a04965f2c9ac0f26 already in progress: creating tablet
W20250115 10:11:51.731956 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 26762eb174a94121a04965f2c9ac0f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26762eb174a94121a04965f2c9ac0f26 already in progress: creating tablet
I20250115 10:11:51.732144 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.732256 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3dea00fb185f4e669d3e359e3d596b8c (table default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]) successfully deleted
W20250115 10:11:51.732362 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 26762eb174a94121a04965f2c9ac0f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26762eb174a94121a04965f2c9ac0f26 already in progress: creating tablet
I20250115 10:11:51.732406 3655 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.732443 2950 master_service.cc:946] ReplaceTablet: received request to replace tablet 01285bc3401243e9bcbba5062c80dbfa from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.732455 3655 ts_tablet_manager.cc:1397] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:51.732460 2948 master_service.cc:946] ReplaceTablet: received request to replace tablet 6ea2073842ad420ba398e16463395c7d from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.732580 3662 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.732571 3655 raft_consensus.cc:357] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.732604 3657 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.732622 3655 raft_consensus.cc:383] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.732636 3657 ts_tablet_manager.cc:1397] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:51.732645 3655 raft_consensus.cc:738] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.732683 3655 consensus_queue.cc:260] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.732767 3655 ts_tablet_manager.cc:1428] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.732748 3657 raft_consensus.cc:357] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.732800 3657 raft_consensus.cc:383] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.732818 3657 raft_consensus.cc:738] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.732827 3655 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.732865 3657 consensus_queue.cc:260] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.732936 3662 tablet_bootstrap.cc:654] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.732944 3657 ts_tablet_manager.cc:1428] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.733002 3657 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.733197 3655 tablet_bootstrap.cc:654] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.733305 3657 tablet_bootstrap.cc:654] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.733615 3662 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.733649 3662 ts_tablet_manager.cc:1397] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.733780 3662 raft_consensus.cc:357] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.733835 3662 raft_consensus.cc:383] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.733855 3662 raft_consensus.cc:738] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.733893 3662 consensus_queue.cc:260] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.733968 3662 ts_tablet_manager.cc:1428] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.734030 3662 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.734208 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.734283 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.734315 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb801a1fbe74de0a66f1c07f63d5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.734385 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb801a1fbe74de0a66f1c07f63d5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.734448 3662 tablet_bootstrap.cc:654] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.735286 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.735482 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (DEFAULT_TABLE table=default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.735556 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb801a1fbe74de0a66f1c07f63d5588. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.735708 3656 tablet_replica.cc:331] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.735781 3656 raft_consensus.cc:2238] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.735783 3655 tablet_bootstrap.cc:492] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.735806 3656 raft_consensus.cc:2267] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.735823 3655 ts_tablet_manager.cc:1397] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.735834 3662 tablet_bootstrap.cc:492] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.735862 3662 ts_tablet_manager.cc:1397] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.735958 3655 raft_consensus.cc:357] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.735971 3662 raft_consensus.cc:357] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.736003 3655 raft_consensus.cc:383] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.736011 3662 raft_consensus.cc:383] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.736032 3662 raft_consensus.cc:738] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.736071 3662 consensus_queue.cc:260] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.736150 3662 ts_tablet_manager.cc:1428] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.736171 3656 ts_tablet_manager.cc:1905] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.736202 3662 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.736367 2948 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6ea2073842ad420ba398e16463395c7d
I20250115 10:11:51.736438 2948 catalog_manager.cc:6596] ReplaceTablet: tablet 6ea2073842ad420ba398e16463395c7d deleted and replaced by tablet 1d712e55f75b43e38f3e84d305dd9b3b
I20250115 10:11:51.736539 3662 tablet_bootstrap.cc:654] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.736564 2950 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 01285bc3401243e9bcbba5062c80dbfa
I20250115 10:11:51.736615 2950 catalog_manager.cc:6596] ReplaceTablet: tablet 01285bc3401243e9bcbba5062c80dbfa deleted and replaced by tablet bac5460ff8d848369760e64efeb62dfc
I20250115 10:11:51.737159 3656 ts_tablet_manager.cc:1918] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.737208 3656 log.cc:1198] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/26762eb174a94121a04965f2c9ac0f26
I20250115 10:11:51.737223 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ea2073842ad420ba398e16463395c7d with delete_type TABLET_DATA_DELETED (replaced by tablet 1d712e55f75b43e38f3e84d305dd9b3b) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.737314 3657 tablet_bootstrap.cc:492] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.737313 3393 tablet_service.cc:1514] Processing DeleteTablet for tablet 01285bc3401243e9bcbba5062c80dbfa with delete_type TABLET_DATA_DELETED (replaced by tablet bac5460ff8d848369760e64efeb62dfc) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.737349 3657 ts_tablet_manager.cc:1397] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:51.737361 3658 tablet_replica.cc:331] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.737401 3658 raft_consensus.cc:2238] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.737435 3658 raft_consensus.cc:2267] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.737619 3658 ts_tablet_manager.cc:1905] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.737618 3657 raft_consensus.cc:357] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.737671 3657 raft_consensus.cc:383] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.737695 3657 raft_consensus.cc:738] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.737686 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 01285bc3401243e9bcbba5062c80dbfa with delete_type TABLET_DATA_DELETED (replaced by tablet bac5460ff8d848369760e64efeb62dfc) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.737735 3657 consensus_queue.cc:260] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.737751 3251 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.737779 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 01285bc3401243e9bcbba5062c80dbfa with delete_type TABLET_DATA_DELETED (replaced by tablet bac5460ff8d848369760e64efeb62dfc) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.737802 3657 ts_tablet_manager.cc:1428] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:51.737869 3657 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.737922 3661 tablet_replica.cc:331] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.737969 3661 raft_consensus.cc:2238] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.738000 3661 raft_consensus.cc:2267] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.738126 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ea2073842ad420ba398e16463395c7d with delete_type TABLET_DATA_DELETED (replaced by tablet 1d712e55f75b43e38f3e84d305dd9b3b) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.736025 3655 raft_consensus.cc:738] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.738222 3657 tablet_bootstrap.cc:654] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.738209 3655 consensus_queue.cc:260] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.738514 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ea2073842ad420ba398e16463395c7d with delete_type TABLET_DATA_DELETED (replaced by tablet 1d712e55f75b43e38f3e84d305dd9b3b) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.738622 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.738651 3661 ts_tablet_manager.cc:1905] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.738696 3658 ts_tablet_manager.cc:1918] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.738734 3658 log.cc:1198] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6ea2073842ad420ba398e16463395c7d
I20250115 10:11:51.738873 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b (DEFAULT_TABLE table=default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.738952 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d712e55f75b43e38f3e84d305dd9b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.737357 3656 ts_tablet_manager.cc:1939] T 26762eb174a94121a04965f2c9ac0f26 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.739753 3661 ts_tablet_manager.cc:1918] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.739799 3661 log.cc:1198] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/01285bc3401243e9bcbba5062c80dbfa
I20250115 10:11:51.739899 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.739939 3657 tablet_bootstrap.cc:492] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.739940 3661 ts_tablet_manager.cc:1939] T 01285bc3401243e9bcbba5062c80dbfa P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
W20250115 10:11:51.739952 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 01285bc3401243e9bcbba5062c80dbfa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01285bc3401243e9bcbba5062c80dbfa already in progress: creating tablet
I20250115 10:11:51.739974 3657 ts_tablet_manager.cc:1397] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
W20250115 10:11:51.739988 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6ea2073842ad420ba398e16463395c7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ea2073842ad420ba398e16463395c7d already in progress: creating tablet
I20250115 10:11:51.740090 3657 raft_consensus.cc:357] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.740149 3657 raft_consensus.cc:383] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.740166 3657 raft_consensus.cc:738] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.740170 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b (DEFAULT_TABLE table=default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.740206 3657 consensus_queue.cc:260] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.740242 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d712e55f75b43e38f3e84d305dd9b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.740288 3657 ts_tablet_manager.cc:1428] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.740335 3657 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.740720 3657 tablet_bootstrap.cc:654] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.738883 3658 ts_tablet_manager.cc:1939] T 6ea2073842ad420ba398e16463395c7d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.740945 3655 ts_tablet_manager.cc:1428] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:11:51.741030 3655 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.741343 3525 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ea2073842ad420ba398e16463395c7d with delete_type TABLET_DATA_DELETED (replaced by tablet 1d712e55f75b43e38f3e84d305dd9b3b) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.741466 3655 tablet_bootstrap.cc:654] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.741482 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 45bb6a726c304a3a99ef485a9a087cc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.741529 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dea00fb185f4e669d3e359e3d596b8c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.741639 3661 tablet_replica.cc:331] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.741681 3661 raft_consensus.cc:2238] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.741714 3661 raft_consensus.cc:2267] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.741825 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 26762eb174a94121a04965f2c9ac0f26 with delete_type TABLET_DATA_DELETED (replaced by tablet 3cb801a1fbe74de0a66f1c07f63d5588) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.742029 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b (DEFAULT_TABLE table=default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.742086 3662 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.742122 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d712e55f75b43e38f3e84d305dd9b3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.742144 3662 ts_tablet_manager.cc:1397] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:51.742151 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:51.742151 3661 ts_tablet_manager.cc:1905] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.742273 3255 tablet_service.cc:1467] Processing CreateTablet for tablet bac5460ff8d848369760e64efeb62dfc (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.742290 3662 raft_consensus.cc:357] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.742342 3662 raft_consensus.cc:383] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.742373 3662 raft_consensus.cc:738] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.742410 3662 consensus_queue.cc:260] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.742506 3662 ts_tablet_manager.cc:1428] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.742475 3393 tablet_service.cc:1467] Processing CreateTablet for tablet bac5460ff8d848369760e64efeb62dfc (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.742569 3662 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.742576 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac5460ff8d848369760e64efeb62dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.742347 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac5460ff8d848369760e64efeb62dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.743247 3521 tablet_service.cc:1467] Processing CreateTablet for tablet bac5460ff8d848369760e64efeb62dfc (DEFAULT_TABLE table=default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.743324 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac5460ff8d848369760e64efeb62dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.743643 3661 ts_tablet_manager.cc:1918] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.743688 3661 log.cc:1198] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/26762eb174a94121a04965f2c9ac0f26
I20250115 10:11:51.743829 2957 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.743865 3661 ts_tablet_manager.cc:1939] T 26762eb174a94121a04965f2c9ac0f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
W20250115 10:11:51.743921 2957 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3cb801a1fbe74de0a66f1c07f63d5588 consensus state has no leader
I20250115 10:11:51.744158 3661 tablet_replica.cc:331] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.744220 3661 raft_consensus.cc:2238] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.744220 3658 tablet_replica.cc:331] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.744247 3661 raft_consensus.cc:2267] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.744267 3658 raft_consensus.cc:2238] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.744297 3658 raft_consensus.cc:2267] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.744412 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.744608 3661 ts_tablet_manager.cc:1905] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.744958 3658 ts_tablet_manager.cc:1905] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.744949 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.745100 3656 tablet_replica.cc:331] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.745155 3656 raft_consensus.cc:2238] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.745186 3656 raft_consensus.cc:2267] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.745347 3656 ts_tablet_manager.cc:1905] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.745678 3661 ts_tablet_manager.cc:1918] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.745731 3661 log.cc:1198] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6ea2073842ad420ba398e16463395c7d
I20250115 10:11:51.745868 3661 ts_tablet_manager.cc:1939] T 6ea2073842ad420ba398e16463395c7d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.746013 3658 ts_tablet_manager.cc:1918] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.746073 3658 log.cc:1198] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/01285bc3401243e9bcbba5062c80dbfa
I20250115 10:11:51.746284 3658 ts_tablet_manager.cc:1939] T 01285bc3401243e9bcbba5062c80dbfa P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.746376 3662 tablet_bootstrap.cc:654] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.746497 3661 tablet_replica.cc:331] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.746570 3657 tablet_bootstrap.cc:492] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.746575 3661 raft_consensus.cc:2238] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.746614 3661 raft_consensus.cc:2267] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.746609 3657 ts_tablet_manager.cc:1397] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:51.746611 3656 ts_tablet_manager.cc:1918] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.746670 3656 log.cc:1198] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6ea2073842ad420ba398e16463395c7d
I20250115 10:11:51.746717 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.746766 3657 raft_consensus.cc:357] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.746824 3658 tablet_replica.cc:331] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.746822 3657 raft_consensus.cc:383] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.746848 3657 raft_consensus.cc:738] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.746843 3661 ts_tablet_manager.cc:1905] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.746868 3658 raft_consensus.cc:2238] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.746897 3658 raft_consensus.cc:2267] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.746824 3656 ts_tablet_manager.cc:1939] T 6ea2073842ad420ba398e16463395c7d P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.747009 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:51.747078 3656 tablet_replica.cc:331] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.747112 3656 raft_consensus.cc:2238] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.747148 3656 raft_consensus.cc:2267] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.747148 3658 ts_tablet_manager.cc:1905] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.747179 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6ea2073842ad420ba398e16463395c7d (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.746884 3657 consensus_queue.cc:260] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.747287 3657 ts_tablet_manager.cc:1428] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.747334 3657 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.747529 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.747673 3657 tablet_bootstrap.cc:654] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.747874 3661 ts_tablet_manager.cc:1918] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.747913 3661 log.cc:1198] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/45bb6a726c304a3a99ef485a9a087cc1
I20250115 10:11:51.748051 3661 ts_tablet_manager.cc:1939] T 45bb6a726c304a3a99ef485a9a087cc1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.748126 3656 ts_tablet_manager.cc:1905] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.748342 3658 ts_tablet_manager.cc:1918] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.748379 3658 log.cc:1198] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/26762eb174a94121a04965f2c9ac0f26
I20250115 10:11:51.748515 3658 ts_tablet_manager.cc:1939] T 26762eb174a94121a04965f2c9ac0f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.748522 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 45bb6a726c304a3a99ef485a9a087cc1 (table default.Table_a8d8619f67ed451eaf40f90281c93f55 [id=8140f7c0eb85499ebbf21a4fd5b98431]) successfully deleted
I20250115 10:11:51.748868 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 26762eb174a94121a04965f2c9ac0f26 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.749100 3656 ts_tablet_manager.cc:1918] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.749150 3656 log.cc:1198] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3dea00fb185f4e669d3e359e3d596b8c
I20250115 10:11:51.749186 3655 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.749230 3655 ts_tablet_manager.cc:1397] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:11:51.749298 3656 ts_tablet_manager.cc:1939] T 3dea00fb185f4e669d3e359e3d596b8c P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.749347 3655 raft_consensus.cc:357] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.749401 3655 raft_consensus.cc:383] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.749416 3655 raft_consensus.cc:738] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.749470 3655 consensus_queue.cc:260] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.749559 3655 ts_tablet_manager.cc:1428] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.749608 3655 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.749594 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3dea00fb185f4e669d3e359e3d596b8c (table default.Table_3f64767f24e640498de579f5277be624 [id=7ab6d0f7f002449baf490cb9af89240b]) successfully deleted
I20250115 10:11:51.749814 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.750052 3655 tablet_bootstrap.cc:654] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.750487 3657 tablet_bootstrap.cc:492] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.750495 3655 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.750524 3657 ts_tablet_manager.cc:1397] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.750535 3655 ts_tablet_manager.cc:1397] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.750558 3662 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.750595 3662 ts_tablet_manager.cc:1397] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:11:51.750622 3657 raft_consensus.cc:357] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.750653 3657 raft_consensus.cc:383] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.750664 3657 raft_consensus.cc:738] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.750659 3655 raft_consensus.cc:357] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.750707 3655 raft_consensus.cc:383] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.750694 3657 consensus_queue.cc:260] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.750725 3655 raft_consensus.cc:738] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.750698 3662 raft_consensus.cc:357] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.750751 3662 raft_consensus.cc:383] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.750769 3662 raft_consensus.cc:738] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.750766 3657 ts_tablet_manager.cc:1428] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.750764 3655 consensus_queue.cc:260] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.750808 3657 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.750804 3662 consensus_queue.cc:260] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.750881 3655 ts_tablet_manager.cc:1428] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.750876 3662 ts_tablet_manager.cc:1428] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.750926 3655 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.750954 3662 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.751091 3657 tablet_bootstrap.cc:654] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.751331 3662 tablet_bootstrap.cc:654] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.751331 3655 tablet_bootstrap.cc:654] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.751569 3657 tablet_bootstrap.cc:492] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.751605 3657 ts_tablet_manager.cc:1397] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.751749 3657 raft_consensus.cc:357] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.751820 3657 raft_consensus.cc:383] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.751842 3657 raft_consensus.cc:738] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.751883 3657 consensus_queue.cc:260] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.751917 3662 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.751950 3662 ts_tablet_manager.cc:1397] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.751962 3657 ts_tablet_manager.cc:1428] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.751996 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.752012 3657 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:11:51.752066 2957 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1d712e55f75b43e38f3e84d305dd9b3b consensus state has no leader
I20250115 10:11:51.752113 3662 raft_consensus.cc:357] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.752182 3662 raft_consensus.cc:383] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.752205 3662 raft_consensus.cc:738] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.752251 3662 consensus_queue.cc:260] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.752328 3662 ts_tablet_manager.cc:1428] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.752396 3657 tablet_bootstrap.cc:654] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.752628 3655 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.752714 3655 ts_tablet_manager.cc:1397] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.752749 2957 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.752859 2955 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_deaace1173e04b83ba96f076133db764 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 1 got 0
I20250115 10:11:51.752871 3655 raft_consensus.cc:357] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.752921 3655 raft_consensus.cc:383] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.752938 3655 raft_consensus.cc:738] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.752990 3655 consensus_queue.cc:260] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.753259 3655 ts_tablet_manager.cc:1428] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.753279 2955 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
W20250115 10:11:51.753337 2955 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bac5460ff8d848369760e64efeb62dfc consensus state has no leader
I20250115 10:11:51.753423 2957 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.753655 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.753739 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 01285bc3401243e9bcbba5062c80dbfa with delete_type TABLET_DATA_DELETED (replaced by tablet bac5460ff8d848369760e64efeb62dfc) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.753803 3656 tablet_replica.cc:331] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.753841 3656 raft_consensus.cc:2238] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.753881 3656 raft_consensus.cc:2267] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.754014 3656 ts_tablet_manager.cc:1905] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.754336 3657 tablet_bootstrap.cc:492] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.754370 3657 ts_tablet_manager.cc:1397] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:51.754493 3657 raft_consensus.cc:357] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.754547 3657 raft_consensus.cc:383] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.754570 3657 raft_consensus.cc:738] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.754617 3657 consensus_queue.cc:260] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.754720 3657 ts_tablet_manager.cc:1428] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.754833 3657 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.755066 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.755241 3657 tablet_bootstrap.cc:654] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.755457 3656 ts_tablet_manager.cc:1918] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.755517 3656 log.cc:1198] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/01285bc3401243e9bcbba5062c80dbfa
I20250115 10:11:51.755667 3656 ts_tablet_manager.cc:1939] T 01285bc3401243e9bcbba5062c80dbfa P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.755649 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.755880 3657 tablet_bootstrap.cc:492] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.755909 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:51.755935 3657 ts_tablet_manager.cc:1397] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.756078 3657 raft_consensus.cc:357] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.756129 3657 raft_consensus.cc:383] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.756141 3657 raft_consensus.cc:738] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.756173 3657 consensus_queue.cc:260] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.756253 3657 ts_tablet_manager.cc:1428] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.756306 3657 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.756687 3657 tablet_bootstrap.cc:654] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.757234 3657 tablet_bootstrap.cc:492] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.757225 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.757268 3657 ts_tablet_manager.cc:1397] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.757403 3657 raft_consensus.cc:357] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.757462 3657 raft_consensus.cc:383] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.757486 3657 raft_consensus.cc:738] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.757531 3657 consensus_queue.cc:260] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.757601 3657 ts_tablet_manager.cc:1428] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.757834 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_35d3d808bf4949f19a5129adb689c544 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 1 got 0
I20250115 10:11:51.768450 3665 raft_consensus.cc:491] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.768543 3665 raft_consensus.cc:513] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.768833 3665 leader_election.cc:290] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.771574 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1eb078c2d74b0c8ebff56863717195" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:51.771705 3415 raft_consensus.cc:2463] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:51.771785 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1eb078c2d74b0c8ebff56863717195" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.771921 3280 raft_consensus.cc:2463] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:51.771939 3484 leader_election.cc:304] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.772044 3665 raft_consensus.cc:2798] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.772091 3665 raft_consensus.cc:491] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.772115 3665 raft_consensus.cc:3054] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.772625 3665 raft_consensus.cc:513] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.772718 3665 leader_election.cc:290] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.772856 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1eb078c2d74b0c8ebff56863717195" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:51.772930 3415 raft_consensus.cc:3054] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.772910 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "db1eb078c2d74b0c8ebff56863717195" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.772980 3280 raft_consensus.cc:3054] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.773525 3280 raft_consensus.cc:2463] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:51.773530 3415 raft_consensus.cc:2463] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:51.773682 3485 leader_election.cc:304] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.773769 3665 raft_consensus.cc:2798] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.773905 3665 raft_consensus.cc:695] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:51.773962 3665 consensus_queue.cc:237] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.774732 2957 catalog_manager.cc:5526] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:51.774890 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.788208 3415 raft_consensus.cc:1270] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.788203 3280 raft_consensus.cc:1270] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.788453 3665 consensus_queue.cc:1035] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.788574 3702 consensus_queue.cc:1035] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.789578 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.789667 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.790642 2955 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.790890 3706 mvcc.cc:204] Tried to move back new op lower bound from 7114489494682660864 to 7114489494626848768. Current Snapshot: MvccSnapshot[applied={T|T < 7114489494682660864}]
I20250115 10:11:51.790949 2955 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.790935 3704 mvcc.cc:204] Tried to move back new op lower bound from 7114489494682660864 to 7114489494626848768. Current Snapshot: MvccSnapshot[applied={T|T < 7114489494682660864}]
I20250115 10:11:51.790472 3710 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.791266 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 1 got 0
I20250115 10:11:51.791476 3711 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.791807 3712 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.793602 2955 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a [id=d483fefe2d154fefb3fce62fb5e56538] alter complete (version 1)
I20250115 10:11:51.793633 3666 raft_consensus.cc:491] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.793681 3666 raft_consensus.cc:513] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.793880 3666 leader_election.cc:290] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.796598 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb801a1fbe74de0a66f1c07f63d5588" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.796667 3280 raft_consensus.cc:2463] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.796718 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb801a1fbe74de0a66f1c07f63d5588" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:51.796818 3550 raft_consensus.cc:2463] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.796865 3350 leader_election.cc:304] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:51.796972 3663 raft_consensus.cc:491] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.797003 3666 raft_consensus.cc:2798] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.797044 3666 raft_consensus.cc:491] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.797024 3663 raft_consensus.cc:513] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.797072 3666 raft_consensus.cc:3054] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.797147 3663 leader_election.cc:290] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:11:51.797245 3464 tablet.cc:2367] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 10:11:51.797282 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d712e55f75b43e38f3e84d305dd9b3b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:51.797317 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d712e55f75b43e38f3e84d305dd9b3b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.797343 3550 raft_consensus.cc:2463] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.797370 3280 raft_consensus.cc:2463] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.797454 3350 leader_election.cc:304] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.797562 3663 raft_consensus.cc:2798] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.797603 3663 raft_consensus.cc:491] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.797633 3663 raft_consensus.cc:3054] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.798031 3666 raft_consensus.cc:513] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.798156 3666 leader_election.cc:290] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.798274 3663 raft_consensus.cc:513] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.798352 3663 leader_election.cc:290] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.798491 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb801a1fbe74de0a66f1c07f63d5588" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.798547 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d712e55f75b43e38f3e84d305dd9b3b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.798652 3279 raft_consensus.cc:3054] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.798727 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d712e55f75b43e38f3e84d305dd9b3b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:51.798786 3549 raft_consensus.cc:3054] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.799207 3279 raft_consensus.cc:2463] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.799291 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cb801a1fbe74de0a66f1c07f63d5588" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:51.799320 3549 raft_consensus.cc:2463] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.799340 3550 raft_consensus.cc:3054] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.799466 3350 leader_election.cc:304] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.799539 3663 raft_consensus.cc:2798] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.799576 3663 raft_consensus.cc:695] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:51.799628 3663 consensus_queue.cc:237] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.800050 3550 raft_consensus.cc:2463] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.798550 3280 raft_consensus.cc:3054] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.800227 2950 catalog_manager.cc:5526] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:51.800351 2950 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.800650 3280 raft_consensus.cc:2463] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.800809 3350 leader_election.cc:304] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:51.800884 3666 raft_consensus.cc:2798] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.800935 3666 raft_consensus.cc:695] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:51.800973 3666 consensus_queue.cc:237] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.801589 2950 catalog_manager.cc:5526] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:51.801687 2950 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.833192 3280 raft_consensus.cc:1270] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.833256 3550 raft_consensus.cc:1270] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.833477 3666 consensus_queue.cc:1035] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.833624 3663 consensus_queue.cc:1035] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.834748 2950 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.834867 2957 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.835566 3711 tablet.cc:1721] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.835784 2957 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.835842 3710 tablet.cc:1721] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.836561 2957 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.837363 2950 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]). Expected version 1 got 0
I20250115 10:11:51.837613 3712 tablet.cc:1721] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.838302 2957 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044] alter complete (version 1)
I20250115 10:11:51.841935 3280 raft_consensus.cc:1270] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.841966 3550 raft_consensus.cc:1270] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.842118 3670 consensus_queue.cc:1035] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.842228 3666 consensus_queue.cc:1035] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.843088 2950 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.843222 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.843425 3711 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.843674 2955 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.844940 2950 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 1 got 0
I20250115 10:11:51.845077 3710 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.845760 2955 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_74e05b3f1a2249219804cdb8e819e545 [id=7a251be119d54dd296cfc25f94278dd9] alter complete (version 1)
I20250115 10:11:51.846204 3712 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:51.884539 2950 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_297e114594f943baa50770c53a3887c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.884579 2955 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_57ec061e82db421da28031d2eba6f352"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.884714 2950 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_297e114594f943baa50770c53a3887c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.884752 2955 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57ec061e82db421da28031d2eba6f352 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.885248 2957 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_38f2486d33724fdfbbb0636e959c98cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.885324 2948 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_1b6ed4d9ef9f469e99aa7228e528b58e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.885375 2956 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_c7bde786768e44269c12f496480905a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.885435 2948 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b6ed4d9ef9f469e99aa7228e528b58e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.885454 2956 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7bde786768e44269c12f496480905a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.885603 2951 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_90d0d2feab864b7aab16307764878eb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.885713 2951 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_90d0d2feab864b7aab16307764878eb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:51.885376 2957 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38f2486d33724fdfbbb0636e959c98cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.885938 2949 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_9d0824e36a8a40b3ae72d1ca84787173"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.886032 2949 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d0824e36a8a40b3ae72d1ca84787173 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.886008 2954 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_b246b11edb424180a1767d2f56bcfb93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.886088 2954 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b246b11edb424180a1767d2f56bcfb93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.887549 2956 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_450dd25d44a54063b370d5edc85637ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:51.887655 2956 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_450dd25d44a54063b370d5edc85637ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.888177 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 62be20367fae41909b56cba45da826a2 (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.888192 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 62be20367fae41909b56cba45da826a2 (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.888247 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 62be20367fae41909b56cba45da826a2 (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.888329 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be20367fae41909b56cba45da826a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.888329 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be20367fae41909b56cba45da826a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.888360 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62be20367fae41909b56cba45da826a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.889302 3662 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.889573 3655 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.889755 3662 tablet_bootstrap.cc:654] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.890015 3655 tablet_bootstrap.cc:654] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.890305 2955 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_a86e019291994723927cb33be70e30b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:51.890352 3657 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:11:51.890409 2955 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a86e019291994723927cb33be70e30b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:51.890681 3655 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.890735 3655 ts_tablet_manager.cc:1397] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.890795 3657 tablet_bootstrap.cc:654] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.890882 2951 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_74e05b3f1a2249219804cdb8e819e545" } new_table_name: "default.Table_aad777aa179d4b2ba8bab5f224853a4c" modify_external_catalogs: true
I20250115 10:11:51.890947 2950 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_90d0d2feab864b7aab16307764878eb4" } modify_external_catalogs: true
I20250115 10:11:51.890944 3655 raft_consensus.cc:357] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.890992 2950 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_90d0d2feab864b7aab16307764878eb4" } modify_external_catalogs: true
I20250115 10:11:51.891005 3655 raft_consensus.cc:383] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.891024 3655 raft_consensus.cc:738] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.891067 3655 consensus_queue.cc:260] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.891077 2949 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_deaace1173e04b83ba96f076133db764" } new_table_name: "default.Table_b32dafab78104aeeb20db4f39dd3a820" modify_external_catalogs: true
I20250115 10:11:51.891167 3655 ts_tablet_manager.cc:1428] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.891168 2954 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_35d3d808bf4949f19a5129adb689c544" } new_table_name: "default.Table_15fcb62d8fc24406bc67064de58249e1" modify_external_catalogs: true
I20250115 10:11:51.891314 3662 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.891355 3662 ts_tablet_manager.cc:1397] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.891525 3657 tablet_bootstrap.cc:492] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.891506 3662 raft_consensus.cc:357] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.891563 3662 raft_consensus.cc:383] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.891566 3657 ts_tablet_manager.cc:1397] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.891587 3662 raft_consensus.cc:738] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.891597 2948 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_9d0824e36a8a40b3ae72d1ca84787173" } new_table_name: "default.Table_ac08bf67f62547f5b8c7a155b41512d0" modify_external_catalogs: true
I20250115 10:11:51.891626 3662 consensus_queue.cc:260] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.891742 3657 raft_consensus.cc:357] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.891800 3657 raft_consensus.cc:383] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.891819 3657 raft_consensus.cc:738] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.891703 3662 ts_tablet_manager.cc:1428] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.891850 3657 consensus_queue.cc:260] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.891933 3657 ts_tablet_manager.cc:1428] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:51.891978 2952 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_7714ae6f7f524cc284951b61226ccfa0" } modify_external_catalogs: true
I20250115 10:11:51.892032 2952 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_7714ae6f7f524cc284951b61226ccfa0" } modify_external_catalogs: true
I20250115 10:11:51.892630 2957 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_cdda6eeb9c0c4b28a7d92900ac1ccd0a" } new_table_name: "default.Table_9fb1073f070d419983294b0745c79ad1" modify_external_catalogs: true
I20250115 10:11:51.893658 3526 tablet_service.cc:1467] Processing CreateTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.893764 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe2e0c18a8f41fdb0c961511994c194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.893743 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 505058de7e084c2881c67bad44998074 (DEFAULT_TABLE table=default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.893818 3255 tablet_service.cc:1467] Processing CreateTablet for tablet c51335aaf7964147a652de9bc7a28605 (DEFAULT_TABLE table=default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.893863 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505058de7e084c2881c67bad44998074. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.893903 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51335aaf7964147a652de9bc7a28605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.894765 3657 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.894774 3525 tablet_service.cc:1467] Processing CreateTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.893755 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 4839f8e0539d468ea11077d48f8f8266 (DEFAULT_TABLE table=default.Table_c7bde786768e44269c12f496480905a2 [id=284816018979468d99f5a23274d90447]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.895008 3251 tablet_service.cc:1467] Processing CreateTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.895071 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2df56f3f4a473da33cc855eeb976e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.895085 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe2e0c18a8f41fdb0c961511994c194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.895154 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4839f8e0539d468ea11077d48f8f8266. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.895191 3657 tablet_bootstrap.cc:654] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.895988 3657 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.896026 3657 ts_tablet_manager.cc:1397] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.896173 3256 tablet_service.cc:1467] Processing CreateTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.896241 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2df56f3f4a473da33cc855eeb976e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.896271 3657 raft_consensus.cc:357] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.896330 3657 raft_consensus.cc:383] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.896348 3657 raft_consensus.cc:738] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.896375 3657 consensus_queue.cc:260] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.896462 3657 ts_tablet_manager.cc:1428] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.896514 3657 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.896952 3657 tablet_bootstrap.cc:654] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.897284 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 505058de7e084c2881c67bad44998074 (DEFAULT_TABLE table=default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.897362 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505058de7e084c2881c67bad44998074. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.897440 3657 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.897467 3657 ts_tablet_manager.cc:1397] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.897559 3657 raft_consensus.cc:357] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.897598 3657 raft_consensus.cc:383] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.897610 3657 raft_consensus.cc:738] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.897644 3657 consensus_queue.cc:260] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.897718 3657 ts_tablet_manager.cc:1428] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.897773 3657 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.898152 3657 tablet_bootstrap.cc:654] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.898195 2953 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_a86e019291994723927cb33be70e30b3" } modify_external_catalogs: true
I20250115 10:11:51.898252 2953 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_a86e019291994723927cb33be70e30b3" } modify_external_catalogs: true
I20250115 10:11:51.898257 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 856454f4db4d471d81af2ea784215030 (DEFAULT_TABLE table=default.Table_9d0824e36a8a40b3ae72d1ca84787173 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.898331 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856454f4db4d471d81af2ea784215030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.898350 2956 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_b246b11edb424180a1767d2f56bcfb93" } modify_external_catalogs: true
I20250115 10:11:51.898391 2956 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_b246b11edb424180a1767d2f56bcfb93" } modify_external_catalogs: true
I20250115 10:11:51.898658 3657 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.898694 3657 ts_tablet_manager.cc:1397] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.898823 3657 raft_consensus.cc:357] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.898905 3657 raft_consensus.cc:383] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.898929 3657 raft_consensus.cc:738] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.898955 3657 consensus_queue.cc:260] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.899032 3657 ts_tablet_manager.cc:1428] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.899075 3657 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:11:51.899231 3599 tablet.cc:2367] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 10:11:51.899444 3657 tablet_bootstrap.cc:654] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.893831 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 4839f8e0539d468ea11077d48f8f8266 (DEFAULT_TABLE table=default.Table_c7bde786768e44269c12f496480905a2 [id=284816018979468d99f5a23274d90447]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.899567 3393 tablet_service.cc:1467] Processing CreateTablet for tablet c51335aaf7964147a652de9bc7a28605 (DEFAULT_TABLE table=default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.899658 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4839f8e0539d468ea11077d48f8f8266. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.899669 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51335aaf7964147a652de9bc7a28605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.899730 3392 tablet_service.cc:1467] Processing CreateTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.899807 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2df56f3f4a473da33cc855eeb976e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.900189 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 505058de7e084c2881c67bad44998074 (DEFAULT_TABLE table=default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.900274 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 4839f8e0539d468ea11077d48f8f8266 (DEFAULT_TABLE table=default.Table_c7bde786768e44269c12f496480905a2 [id=284816018979468d99f5a23274d90447]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.900341 3390 tablet_service.cc:1467] Processing CreateTablet for tablet df8f572184684bef8d13ba26878d20f8 (DEFAULT_TABLE table=default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.900408 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 856454f4db4d471d81af2ea784215030 (DEFAULT_TABLE table=default.Table_9d0824e36a8a40b3ae72d1ca84787173 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.899674 3394 tablet_service.cc:1467] Processing CreateTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.901007 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4839f8e0539d468ea11077d48f8f8266. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.901363 3657 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.901391 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe2e0c18a8f41fdb0c961511994c194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.901398 3657 ts_tablet_manager.cc:1397] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.901497 3657 raft_consensus.cc:357] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.901537 3657 raft_consensus.cc:383] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.901552 3657 raft_consensus.cc:738] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.901598 3657 consensus_queue.cc:260] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.901713 3657 ts_tablet_manager.cc:1428] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.901873 3662 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.902218 3662 tablet_bootstrap.cc:654] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.902295 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8f572184684bef8d13ba26878d20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.902742 3662 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.902812 3662 ts_tablet_manager.cc:1397] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.902947 3523 tablet_service.cc:1467] Processing CreateTablet for tablet df8f572184684bef8d13ba26878d20f8 (DEFAULT_TABLE table=default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.902967 3662 raft_consensus.cc:357] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.903039 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8f572184684bef8d13ba26878d20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.903040 3662 raft_consensus.cc:383] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.903061 3662 raft_consensus.cc:738] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.903105 3662 consensus_queue.cc:260] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.903192 3662 ts_tablet_manager.cc:1428] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.903203 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856454f4db4d471d81af2ea784215030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.903261 3662 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.903821 3662 tablet_bootstrap.cc:654] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.904119 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505058de7e084c2881c67bad44998074. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.904249 3657 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.904536 3662 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.904577 3662 ts_tablet_manager.cc:1397] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.904711 3662 raft_consensus.cc:357] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.904769 3662 raft_consensus.cc:383] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.904793 3662 raft_consensus.cc:738] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.904795 3657 tablet_bootstrap.cc:654] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.904878 3662 consensus_queue.cc:260] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.904974 3662 ts_tablet_manager.cc:1428] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.905028 3662 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:11:51.905149 2949 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95a236fda8124147a057be51ecfff945 consensus state has no leader
I20250115 10:11:51.905196 2949 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_1b6ed4d9ef9f469e99aa7228e528b58e" } modify_external_catalogs: true
I20250115 10:11:51.905227 2949 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39756:
table { table_name: "default.Table_1b6ed4d9ef9f469e99aa7228e528b58e" } modify_external_catalogs: true
W20250115 10:11:51.905287 2954 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bac5460ff8d848369760e64efeb62dfc consensus state has no leader
I20250115 10:11:51.905349 2952 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3cb801a1fbe74de0a66f1c07f63d5588
I20250115 10:11:51.905587 3662 tablet_bootstrap.cc:654] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:51.905652 2948 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 856454f4db4d471d81af2ea784215030 consensus state has no leader
I20250115 10:11:51.906276 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.906543 3661 tablet_replica.cc:331] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.906720 3661 raft_consensus.cc:2238] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.906813 3661 raft_consensus.cc:2267] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.907104 3661 ts_tablet_manager.cc:1905] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.907099 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.907184 3656 tablet_replica.cc:331] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.907228 3656 raft_consensus.cc:2238] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.907297 3656 raft_consensus.cc:2267] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.907598 3656 ts_tablet_manager.cc:1905] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.907804 3253 tablet_service.cc:1467] Processing CreateTablet for tablet df8f572184684bef8d13ba26878d20f8 (DEFAULT_TABLE table=default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.907902 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8f572184684bef8d13ba26878d20f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.908422 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cb801a1fbe74de0a66f1c07f63d5588 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.908496 3658 tablet_replica.cc:331] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.908540 3658 raft_consensus.cc:2238] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:51.908542 3661 ts_tablet_manager.cc:1918] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:51.908555 3710 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.908596 3661 log.cc:1198] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3cb801a1fbe74de0a66f1c07f63d5588
I20250115 10:11:51.908653 3658 raft_consensus.cc:2267] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.908789 3661 ts_tablet_manager.cc:1939] T 3cb801a1fbe74de0a66f1c07f63d5588 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.908929 3658 ts_tablet_manager.cc:1905] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.909142 3656 ts_tablet_manager.cc:1918] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:51.909183 3656 log.cc:1198] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3cb801a1fbe74de0a66f1c07f63d5588
I20250115 10:11:51.909497 3656 ts_tablet_manager.cc:1939] T 3cb801a1fbe74de0a66f1c07f63d5588 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.909792 3711 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.909919 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 856454f4db4d471d81af2ea784215030 (DEFAULT_TABLE table=default.Table_9d0824e36a8a40b3ae72d1ca84787173 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.909998 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 856454f4db4d471d81af2ea784215030. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.910246 3658 ts_tablet_manager.cc:1918] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:51.910293 3658 log.cc:1198] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3cb801a1fbe74de0a66f1c07f63d5588
I20250115 10:11:51.910470 3658 ts_tablet_manager.cc:1939] T 3cb801a1fbe74de0a66f1c07f63d5588 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.910745 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.910992 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.911054 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3cb801a1fbe74de0a66f1c07f63d5588 (table default.Table_7714ae6f7f524cc284951b61226ccfa0 [id=b1d8fa7525404b90b0bf069732c38044]) successfully deleted
I20250115 10:11:51.911172 3521 tablet_service.cc:1467] Processing CreateTablet for tablet c51335aaf7964147a652de9bc7a28605 (DEFAULT_TABLE table=default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.911259 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c51335aaf7964147a652de9bc7a28605. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.911417 2956 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet df8f572184684bef8d13ba26878d20f8
I20250115 10:11:51.911592 3525 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
W20250115 10:11:51.911814 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet df8f572184684bef8d13ba26878d20f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df8f572184684bef8d13ba26878d20f8 already in progress: creating tablet
I20250115 10:11:51.911872 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
W20250115 10:11:51.912062 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet df8f572184684bef8d13ba26878d20f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df8f572184684bef8d13ba26878d20f8 already in progress: creating tablet
I20250115 10:11:51.912627 2950 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet c51335aaf7964147a652de9bc7a28605
I20250115 10:11:51.912659 3391 tablet_service.cc:1467] Processing CreateTablet for tablet f9c3726d8be14adeacea32fb82bf5913 (DEFAULT_TABLE table=default.Table_450dd25d44a54063b370d5edc85637ef [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.912735 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c3726d8be14adeacea32fb82bf5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.913025 3655 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.913427 3655 tablet_bootstrap.cc:654] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.913450 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet c51335aaf7964147a652de9bc7a28605 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.913434 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 782f1c8289804318a4e19fd896f4befd (DEFAULT_TABLE table=default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.913589 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f1c8289804318a4e19fd896f4befd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.913745 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.914032 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet c51335aaf7964147a652de9bc7a28605 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.914086 3258 tablet_service.cc:1467] Processing CreateTablet for tablet f9c3726d8be14adeacea32fb82bf5913 (DEFAULT_TABLE table=default.Table_450dd25d44a54063b370d5edc85637ef [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.914201 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c3726d8be14adeacea32fb82bf5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.914601 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 782f1c8289804318a4e19fd896f4befd (DEFAULT_TABLE table=default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.914695 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f1c8289804318a4e19fd896f4befd. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.914896 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet c51335aaf7964147a652de9bc7a28605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51335aaf7964147a652de9bc7a28605 already in progress: creating tablet
I20250115 10:11:51.915275 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet c51335aaf7964147a652de9bc7a28605 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
W20250115 10:11:51.915470 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet c51335aaf7964147a652de9bc7a28605 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c51335aaf7964147a652de9bc7a28605 already in progress: creating tablet
I20250115 10:11:51.915550 3661 tablet_replica.cc:331] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.915597 3661 raft_consensus.cc:2238] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.915628 3661 raft_consensus.cc:2267] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.915832 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 782f1c8289804318a4e19fd896f4befd (DEFAULT_TABLE table=default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.915922 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 782f1c8289804318a4e19fd896f4befd. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:51.916059 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet df8f572184684bef8d13ba26878d20f8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df8f572184684bef8d13ba26878d20f8 already in progress: creating tablet
I20250115 10:11:51.916366 2953 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.916778 2949 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 505058de7e084c2881c67bad44998074
I20250115 10:11:51.916901 2950 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_9fb1073f070d419983294b0745c79ad1 [id=d483fefe2d154fefb3fce62fb5e56538] alter complete (version 2)
I20250115 10:11:51.916923 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.917018 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.917038 3661 ts_tablet_manager.cc:1905] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.917202 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 505058de7e084c2881c67bad44998074 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.917485 3711 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.917498 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.917559 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 505058de7e084c2881c67bad44998074 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
W20250115 10:11:51.917729 2943 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 782f1c8289804318a4e19fd896f4befd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 782f1c8289804318a4e19fd896f4befd already in progress: creating tablet
W20250115 10:11:51.917776 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 782f1c8289804318a4e19fd896f4befd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 782f1c8289804318a4e19fd896f4befd already in progress: creating tablet
W20250115 10:11:51.917837 2942 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 505058de7e084c2881c67bad44998074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 505058de7e084c2881c67bad44998074 already in progress: creating tablet
I20250115 10:11:51.918262 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 505058de7e084c2881c67bad44998074 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.918401 3521 tablet_service.cc:1467] Processing CreateTablet for tablet f9c3726d8be14adeacea32fb82bf5913 (DEFAULT_TABLE table=default.Table_450dd25d44a54063b370d5edc85637ef [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.918426 3661 ts_tablet_manager.cc:1918] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.918481 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9c3726d8be14adeacea32fb82bf5913. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.918538 3661 log.cc:1198] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/c51335aaf7964147a652de9bc7a28605
I20250115 10:11:51.918741 3661 ts_tablet_manager.cc:1939] T c51335aaf7964147a652de9bc7a28605 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.918839 3710 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.919021 3702 raft_consensus.cc:491] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.919068 3702 raft_consensus.cc:513] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.919181 3702 leader_election.cc:290] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.919327 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac5460ff8d848369760e64efeb62dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:51.919390 3415 raft_consensus.cc:2463] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:51.919523 3484 leader_election.cc:304] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.919597 3702 raft_consensus.cc:2798] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.919626 3702 raft_consensus.cc:491] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.919646 3702 raft_consensus.cc:3054] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.919728 3731 tablet.cc:1721] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.919979 3656 tablet_replica.cc:331] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.920023 3656 raft_consensus.cc:2238] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.920044 3656 raft_consensus.cc:2267] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.920172 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet c51335aaf7964147a652de9bc7a28605 (table default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]) successfully deleted
W20250115 10:11:51.920218 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 782f1c8289804318a4e19fd896f4befd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 782f1c8289804318a4e19fd896f4befd already in progress: creating tablet
W20250115 10:11:51.920248 2943 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 505058de7e084c2881c67bad44998074 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 505058de7e084c2881c67bad44998074 already in progress: creating tablet
I20250115 10:11:51.920290 3702 raft_consensus.cc:513] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.920389 3656 ts_tablet_manager.cc:1905] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.920539 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac5460ff8d848369760e64efeb62dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:51.920596 3415 raft_consensus.cc:3054] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.920763 3731 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.921097 3415 raft_consensus.cc:2463] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:51.921392 3484 leader_election.cc:304] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.921468 3709 raft_consensus.cc:2798] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.921501 3709 raft_consensus.cc:695] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:51.921537 3709 consensus_queue.cc:237] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:51.920394 3702 leader_election.cc:290] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:51.921746 3656 ts_tablet_manager.cc:1918] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.921785 3656 log.cc:1198] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/505058de7e084c2881c67bad44998074
I20250115 10:11:51.921830 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac5460ff8d848369760e64efeb62dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.921890 3279 raft_consensus.cc:3054] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.921960 3656 ts_tablet_manager.cc:1939] T 505058de7e084c2881c67bad44998074 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.922300 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 505058de7e084c2881c67bad44998074 (table default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]) successfully deleted
I20250115 10:11:51.922327 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac5460ff8d848369760e64efeb62dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.922356 3279 raft_consensus.cc:2463] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:51.922729 2951 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9] alter complete (version 2)
I20250115 10:11:51.923084 3655 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.923134 3655 ts_tablet_manager.cc:1397] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.000s
I20250115 10:11:51.923146 2949 catalog_manager.cc:5526] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:51.923250 2949 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 2 got 0
I20250115 10:11:51.923300 3655 raft_consensus.cc:357] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.923357 3655 raft_consensus.cc:383] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.923386 3655 raft_consensus.cc:738] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.923424 3655 consensus_queue.cc:260] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.923516 3655 ts_tablet_manager.cc:1428] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.923585 3655 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.924026 3655 tablet_bootstrap.cc:654] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.924129 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet c51335aaf7964147a652de9bc7a28605 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.924244 3658 tablet_replica.cc:331] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.924299 3658 raft_consensus.cc:2238] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.924331 3658 raft_consensus.cc:2267] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.924767 3658 ts_tablet_manager.cc:1905] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.925810 3655 tablet_bootstrap.cc:492] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.925856 3658 ts_tablet_manager.cc:1918] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.925894 3662 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.925856 3655 ts_tablet_manager.cc:1397] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.925925 3658 log.cc:1198] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/c51335aaf7964147a652de9bc7a28605
I20250115 10:11:51.925933 3662 ts_tablet_manager.cc:1397] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:11:51.926035 3657 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.926079 3658 ts_tablet_manager.cc:1939] T c51335aaf7964147a652de9bc7a28605 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.926074 3657 ts_tablet_manager.cc:1397] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.001s
I20250115 10:11:51.926055 3655 raft_consensus.cc:357] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926060 3662 raft_consensus.cc:357] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926105 3655 raft_consensus.cc:383] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.926105 3662 raft_consensus.cc:383] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.926123 3655 raft_consensus.cc:738] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.926141 3662 raft_consensus.cc:738] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.926178 3655 consensus_queue.cc:260] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926191 3662 consensus_queue.cc:260] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926255 3655 ts_tablet_manager.cc:1428] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.926270 3657 raft_consensus.cc:357] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926318 3655 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.926324 3657 raft_consensus.cc:383] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.926343 3657 raft_consensus.cc:738] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.926385 3657 consensus_queue.cc:260] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.926469 3657 ts_tablet_manager.cc:1428] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:51.926523 3657 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.926694 3655 tablet_bootstrap.cc:654] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.926924 3657 tablet_bootstrap.cc:654] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.927073 3662 ts_tablet_manager.cc:1428] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.927350 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet c51335aaf7964147a652de9bc7a28605 (table default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]) successfully deleted
I20250115 10:11:51.927762 3657 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.927804 3657 ts_tablet_manager.cc:1397] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.927951 3657 raft_consensus.cc:357] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.928002 3657 raft_consensus.cc:383] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.928022 3657 raft_consensus.cc:738] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.928061 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.928054 3657 consensus_queue.cc:260] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.928223 3662 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.928231 3657 ts_tablet_manager.cc:1428] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.928237 3656 tablet_replica.cc:331] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.928310 3656 raft_consensus.cc:2238] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.928333 3657 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.928521 2949 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:51.928710 3657 tablet_bootstrap.cc:654] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.928802 3662 tablet_bootstrap.cc:654] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.928815 3655 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.928845 3655 ts_tablet_manager.cc:1397] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.928985 3655 raft_consensus.cc:357] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929035 3655 raft_consensus.cc:383] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.928334 3656 raft_consensus.cc:2267] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.929059 3655 raft_consensus.cc:738] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.929096 3655 consensus_queue.cc:260] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929155 3656 ts_tablet_manager.cc:1905] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.929170 3655 ts_tablet_manager.cc:1428] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.929231 3655 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.929354 3662 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.929389 3662 ts_tablet_manager.cc:1397] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.929446 3657 tablet_bootstrap.cc:492] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.929477 3657 ts_tablet_manager.cc:1397] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.929526 3662 raft_consensus.cc:357] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929581 3662 raft_consensus.cc:383] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.929598 3662 raft_consensus.cc:738] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.929590 3657 raft_consensus.cc:357] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929631 3657 raft_consensus.cc:383] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.929652 3657 raft_consensus.cc:738] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.929636 3662 consensus_queue.cc:260] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929701 3655 tablet_bootstrap.cc:654] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.929692 3657 consensus_queue.cc:260] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.929718 3662 ts_tablet_manager.cc:1428] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.929803 3662 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.929805 3657 ts_tablet_manager.cc:1428] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.929862 3657 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.930217 3662 tablet_bootstrap.cc:654] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.930238 3657 tablet_bootstrap.cc:654] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.930331 3656 ts_tablet_manager.cc:1918] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.930369 3656 log.cc:1198] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/df8f572184684bef8d13ba26878d20f8
I20250115 10:11:51.930506 3656 ts_tablet_manager.cc:1939] T df8f572184684bef8d13ba26878d20f8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.930536 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.930601 3658 tablet_replica.cc:331] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.930639 3658 raft_consensus.cc:2238] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.930667 3658 raft_consensus.cc:2267] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.930928 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet df8f572184684bef8d13ba26878d20f8 (table default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]) successfully deleted
I20250115 10:11:51.931306 3658 ts_tablet_manager.cc:1905] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.931370 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 505058de7e084c2881c67bad44998074 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.931437 3661 tablet_replica.cc:331] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.931475 3661 raft_consensus.cc:2238] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.931499 3661 raft_consensus.cc:2267] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.931502 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet c51335aaf7964147a652de9bc7a28605 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.931564 3656 tablet_replica.cc:331] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.931599 3656 raft_consensus.cc:2238] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.931622 3656 raft_consensus.cc:2267] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.931756 3656 ts_tablet_manager.cc:1905] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.931763 3661 ts_tablet_manager.cc:1905] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.932801 3662 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.932819 3656 ts_tablet_manager.cc:1918] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.932842 3662 ts_tablet_manager.cc:1397] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.932873 3656 log.cc:1198] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/c51335aaf7964147a652de9bc7a28605
I20250115 10:11:51.933014 3656 ts_tablet_manager.cc:1939] T c51335aaf7964147a652de9bc7a28605 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.932998 3662 raft_consensus.cc:357] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.933037 3662 raft_consensus.cc:383] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.933049 3662 raft_consensus.cc:738] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.933080 3662 consensus_queue.cc:260] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.933187 3662 ts_tablet_manager.cc:1428] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.933250 3658 ts_tablet_manager.cc:1918] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.933312 3658 log.cc:1198] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/df8f572184684bef8d13ba26878d20f8
I20250115 10:11:51.933467 3658 ts_tablet_manager.cc:1939] T df8f572184684bef8d13ba26878d20f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.933483 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet c51335aaf7964147a652de9bc7a28605 (table default.Table_90d0d2feab864b7aab16307764878eb4 [id=6e2012b63c224313bf9ae64c82886bc3]) successfully deleted
I20250115 10:11:51.933465 2949 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:51.933578 3655 tablet_bootstrap.cc:492] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.933615 3655 ts_tablet_manager.cc:1397] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:51.933641 3662 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.933745 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet df8f572184684bef8d13ba26878d20f8 (table default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]) successfully deleted
I20250115 10:11:51.933754 3655 raft_consensus.cc:357] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.933815 3655 raft_consensus.cc:383] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.933835 3655 raft_consensus.cc:738] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.933893 3655 consensus_queue.cc:260] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.934001 3655 ts_tablet_manager.cc:1428] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.934008 3662 tablet_bootstrap.cc:654] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.934056 3655 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.934288 2951 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:51.934479 3655 tablet_bootstrap.cc:654] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.934664 3662 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.934707 3662 ts_tablet_manager.cc:1397] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.934801 2951 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:51.934844 3662 raft_consensus.cc:357] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.934912 3662 raft_consensus.cc:383] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.934945 3662 raft_consensus.cc:738] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.934983 3662 consensus_queue.cc:260] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.935077 3662 ts_tablet_manager.cc:1428] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.935148 3662 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.935423 3657 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.935465 3657 ts_tablet_manager.cc:1397] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:51.935478 2950 master_service.cc:946] ReplaceTablet: received request to replace tablet 62be20367fae41909b56cba45da826a2 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.935586 3657 raft_consensus.cc:357] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.935606 2949 master_service.cc:946] ReplaceTablet: received request to replace tablet 1d712e55f75b43e38f3e84d305dd9b3b from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.935636 3657 raft_consensus.cc:383] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.935639 3662 tablet_bootstrap.cc:654] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.935653 3657 raft_consensus.cc:738] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.935686 3657 consensus_queue.cc:260] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.936532 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:51.936546 3657 ts_tablet_manager.cc:1428] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.936563 3655 tablet_bootstrap.cc:492] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.936595 3655 ts_tablet_manager.cc:1397] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:51.936620 3657 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.936709 3655 raft_consensus.cc:357] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.936779 3655 raft_consensus.cc:383] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.936806 3655 raft_consensus.cc:738] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.936844 3655 consensus_queue.cc:260] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.936919 3655 ts_tablet_manager.cc:1428] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.936966 3655 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.936986 3657 tablet_bootstrap.cc:654] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.937345 3655 tablet_bootstrap.cc:654] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.937381 2950 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 62be20367fae41909b56cba45da826a2
I20250115 10:11:51.937450 2950 catalog_manager.cc:6596] ReplaceTablet: tablet 62be20367fae41909b56cba45da826a2 deleted and replaced by tablet 670935dae51e4585920666a958c556ec
I20250115 10:11:51.937664 2949 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 1d712e55f75b43e38f3e84d305dd9b3b
I20250115 10:11:51.937726 2949 catalog_manager.cc:6596] ReplaceTablet: tablet 1d712e55f75b43e38f3e84d305dd9b3b deleted and replaced by tablet 9af13c18749940828dbe55ef2cdbf31c
I20250115 10:11:51.937768 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 62be20367fae41909b56cba45da826a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 670935dae51e4585920666a958c556ec) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.937794 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.937860 3656 tablet_replica.cc:331] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.937870 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b with delete_type TABLET_DATA_DELETED (replaced by tablet 9af13c18749940828dbe55ef2cdbf31c) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.937907 3656 raft_consensus.cc:2238] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.937937 3656 raft_consensus.cc:2267] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.937945 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 62be20367fae41909b56cba45da826a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 670935dae51e4585920666a958c556ec) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.938001 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b with delete_type TABLET_DATA_DELETED (replaced by tablet 9af13c18749940828dbe55ef2cdbf31c) from {username='slave'} at 127.0.0.1:40126
W20250115 10:11:51.938097 3329 tablet.cc:2367] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 10:11:51.938213 3657 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.938248 3657 ts_tablet_manager.cc:1397] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:51.938387 3657 raft_consensus.cc:357] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.938441 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 62be20367fae41909b56cba45da826a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 670935dae51e4585920666a958c556ec) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.938448 3657 raft_consensus.cc:383] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.938458 3655 tablet_bootstrap.cc:492] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.938481 3657 raft_consensus.cc:738] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.938491 3655 ts_tablet_manager.cc:1397] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.938515 3657 consensus_queue.cc:260] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.938611 3657 ts_tablet_manager.cc:1428] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.938621 2951 master_service.cc:946] ReplaceTablet: received request to replace tablet cb2df56f3f4a473da33cc855eeb976e4 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.938795 3655 raft_consensus.cc:357] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.938858 3655 raft_consensus.cc:383] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.938877 3655 raft_consensus.cc:738] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.938917 3655 consensus_queue.cc:260] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.939003 3655 ts_tablet_manager.cc:1428] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.939051 3655 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.938432 3656 ts_tablet_manager.cc:1905] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.939407 3655 tablet_bootstrap.cc:654] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.938496 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d712e55f75b43e38f3e84d305dd9b3b with delete_type TABLET_DATA_DELETED (replaced by tablet 9af13c18749940828dbe55ef2cdbf31c) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.939901 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 670935dae51e4585920666a958c556ec (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.940024 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 670935dae51e4585920666a958c556ec (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.940099 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670935dae51e4585920666a958c556ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.940147 3658 tablet_replica.cc:331] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.940199 3658 raft_consensus.cc:2238] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.940229 3658 raft_consensus.cc:2267] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.940445 3661 ts_tablet_manager.cc:1918] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.940485 3661 log.cc:1198] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/505058de7e084c2881c67bad44998074
I20250115 10:11:51.940634 3661 ts_tablet_manager.cc:1939] T 505058de7e084c2881c67bad44998074 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.940675 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 505058de7e084c2881c67bad44998074 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.941107 3655 tablet_bootstrap.cc:492] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.941146 3655 ts_tablet_manager.cc:1397] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.941247 2955 master_service.cc:946] ReplaceTablet: received request to replace tablet ebe2e0c18a8f41fdb0c961511994c194 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.941252 3655 raft_consensus.cc:357] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.941298 3655 raft_consensus.cc:383] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.941315 3655 raft_consensus.cc:738] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.941350 3655 consensus_queue.cc:260] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.941423 3655 ts_tablet_manager.cc:1428] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.941418 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 670935dae51e4585920666a958c556ec (DEFAULT_TABLE table=default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.941468 3655 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.941649 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670935dae51e4585920666a958c556ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.941841 3655 tablet_bootstrap.cc:654] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.942380 3415 raft_consensus.cc:1270] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.942443 3655 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.942479 3655 ts_tablet_manager.cc:1397] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.942497 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 9af13c18749940828dbe55ef2cdbf31c (DEFAULT_TABLE table=default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.942584 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af13c18749940828dbe55ef2cdbf31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.942559 3709 consensus_queue.cc:1035] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.942586 3655 raft_consensus.cc:357] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.942629 3655 raft_consensus.cc:383] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.942653 3655 raft_consensus.cc:738] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.942684 3655 consensus_queue.cc:260] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.942799 3655 ts_tablet_manager.cc:1428] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.942874 3655 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.942915 3279 raft_consensus.cc:1270] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.943133 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 9af13c18749940828dbe55ef2cdbf31c (DEFAULT_TABLE table=default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.943287 3655 tablet_bootstrap.cc:654] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.943442 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 670935dae51e4585920666a958c556ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.943549 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af13c18749940828dbe55ef2cdbf31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.943646 3658 ts_tablet_manager.cc:1905] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.943982 3655 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.944016 3655 ts_tablet_manager.cc:1397] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.944140 3655 raft_consensus.cc:357] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.944213 3655 raft_consensus.cc:383] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.944233 3655 raft_consensus.cc:738] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.944281 3655 consensus_queue.cc:260] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.944314 3709 consensus_queue.cc:1035] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.944376 3655 ts_tablet_manager.cc:1428] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.944427 3655 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.944566 2949 master_service.cc:946] ReplaceTablet: received request to replace tablet ebe2e0c18a8f41fdb0c961511994c194 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:51.944821 3655 tablet_bootstrap.cc:654] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.945030 3658 ts_tablet_manager.cc:1918] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.945078 3658 log.cc:1198] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/62be20367fae41909b56cba45da826a2
I20250115 10:11:51.945158 3657 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.945253 3658 ts_tablet_manager.cc:1939] T 62be20367fae41909b56cba45da826a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.945585 3657 tablet_bootstrap.cc:654] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.945916 2953 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 2 got 0
I20250115 10:11:51.946220 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 9af13c18749940828dbe55ef2cdbf31c (DEFAULT_TABLE table=default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.946220 3655 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.946316 3655 ts_tablet_manager.cc:1397] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.946336 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af13c18749940828dbe55ef2cdbf31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.946424 3656 ts_tablet_manager.cc:1918] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.946436 3657 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.946434 3655 raft_consensus.cc:357] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.946470 3657 ts_tablet_manager.cc:1397] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.946494 3655 raft_consensus.cc:383] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.946513 3655 raft_consensus.cc:738] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.946552 3655 consensus_queue.cc:260] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.946604 3657 raft_consensus.cc:357] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.946640 3655 ts_tablet_manager.cc:1428] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.946653 3657 raft_consensus.cc:383] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.946671 3657 raft_consensus.cc:738] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.946705 3657 consensus_queue.cc:260] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.946772 3657 ts_tablet_manager.cc:1428] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.946838 3657 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.947080 3655 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.947181 3657 tablet_bootstrap.cc:654] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.947336 2955 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ebe2e0c18a8f41fdb0c961511994c194
I20250115 10:11:51.947408 2955 catalog_manager.cc:6596] ReplaceTablet: tablet ebe2e0c18a8f41fdb0c961511994c194 deleted and replaced by tablet 7860f89c26334571a26351e2fd20c042
I20250115 10:11:51.947439 3655 tablet_bootstrap.cc:654] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.947463 2951 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cb2df56f3f4a473da33cc855eeb976e4
I20250115 10:11:51.947492 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 with delete_type TABLET_DATA_DELETED (replaced by tablet 7860f89c26334571a26351e2fd20c042) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.947508 2951 catalog_manager.cc:6596] ReplaceTablet: tablet cb2df56f3f4a473da33cc855eeb976e4 deleted and replaced by tablet 6c311eccc93b4388b7ea59531803a244
I20250115 10:11:51.947640 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c311eccc93b4388b7ea59531803a244) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.948127 3657 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.948169 3657 ts_tablet_manager.cc:1397] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.946465 3656 log.cc:1198] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.948302 3657 raft_consensus.cc:357] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.948354 3657 raft_consensus.cc:383] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.948375 3657 raft_consensus.cc:738] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.948410 3657 consensus_queue.cc:260] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.948490 3657 ts_tablet_manager.cc:1428] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.948518 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 with delete_type TABLET_DATA_DELETED (replaced by tablet 7860f89c26334571a26351e2fd20c042) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.948544 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c311eccc93b4388b7ea59531803a244) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.948724 3661 tablet_replica.cc:331] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.948779 3661 raft_consensus.cc:2238] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.948807 3661 raft_consensus.cc:2267] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.948904 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 505058de7e084c2881c67bad44998074 (table default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]) successfully deleted
I20250115 10:11:51.949090 3658 tablet_replica.cc:331] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.949154 3658 raft_consensus.cc:2238] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:51.949151 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 62be20367fae41909b56cba45da826a2 (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:51.949203 3658 raft_consensus.cc:2267] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.949365 3655 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.949373 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet ebe2e0c18a8f41fdb0c961511994c194 with delete_type TABLET_DATA_DELETED (replaced by tablet 7860f89c26334571a26351e2fd20c042) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.949412 3655 ts_tablet_manager.cc:1397] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:51.949458 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet cb2df56f3f4a473da33cc855eeb976e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6c311eccc93b4388b7ea59531803a244) from {username='slave'} at 127.0.0.1:40126
I20250115 10:11:51.949539 3662 tablet_bootstrap.cc:492] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.949533 3655 raft_consensus.cc:357] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.949584 3655 raft_consensus.cc:383] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.949582 3662 ts_tablet_manager.cc:1397] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:11:51.949611 3655 raft_consensus.cc:738] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.949661 3655 consensus_queue.cc:260] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.949738 3655 ts_tablet_manager.cc:1428] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.949707 3662 raft_consensus.cc:357] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.949769 3662 raft_consensus.cc:383] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.949792 3662 raft_consensus.cc:738] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.949787 3658 ts_tablet_manager.cc:1905] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.949844 3662 consensus_queue.cc:260] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.950202 3662 ts_tablet_manager.cc:1428] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.950453 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet df8f572184684bef8d13ba26878d20f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.950578 3662 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.951072 3662 tablet_bootstrap.cc:654] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.951280 2950 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 2 got 0
I20250115 10:11:51.951556 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 6c311eccc93b4388b7ea59531803a244 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.951589 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:33860
I20250115 10:11:51.951644 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c311eccc93b4388b7ea59531803a244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.951601 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 7860f89c26334571a26351e2fd20c042 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.951727 2951 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:51.951750 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 6c311eccc93b4388b7ea59531803a244 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:11:51.951781 2951 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 9af13c18749940828dbe55ef2cdbf31c consensus state has no leader
I20250115 10:11:51.951787 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 6c311eccc93b4388b7ea59531803a244 (DEFAULT_TABLE table=default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.951822 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c311eccc93b4388b7ea59531803a244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.951925 2951 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:51.952005 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 7860f89c26334571a26351e2fd20c042 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.952082 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7860f89c26334571a26351e2fd20c042. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.952162 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 7860f89c26334571a26351e2fd20c042 (DEFAULT_TABLE table=default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:51.952239 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7860f89c26334571a26351e2fd20c042. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.952600 3657 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.953061 3657 tablet_bootstrap.cc:654] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.949579 3661 ts_tablet_manager.cc:1905] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.953658 3657 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.953702 3657 ts_tablet_manager.cc:1397] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.953845 3657 raft_consensus.cc:357] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.953912 3657 raft_consensus.cc:383] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.953938 3657 raft_consensus.cc:738] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.953970 3657 consensus_queue.cc:260] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.953994 3662 tablet_bootstrap.cc:492] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.954032 3662 ts_tablet_manager.cc:1397] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:51.954041 3657 ts_tablet_manager.cc:1428] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.954088 3657 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:51.954181 3662 raft_consensus.cc:357] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.954236 3662 raft_consensus.cc:383] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.954257 3662 raft_consensus.cc:738] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.954300 3662 consensus_queue.cc:260] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.954396 3662 ts_tablet_manager.cc:1428] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.954442 3661 ts_tablet_manager.cc:1918] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.954479 3662 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.954504 3657 tablet_bootstrap.cc:654] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.954890 3662 tablet_bootstrap.cc:654] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.954490 3661 log.cc:1198] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/62be20367fae41909b56cba45da826a2
I20250115 10:11:51.955111 3661 ts_tablet_manager.cc:1939] T 62be20367fae41909b56cba45da826a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.955147 3710 tablet.cc:1721] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.955317 3661 tablet_replica.cc:331] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.955374 3661 raft_consensus.cc:2238] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.955631 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 62be20367fae41909b56cba45da826a2 (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:51.955925 3656 ts_tablet_manager.cc:1939] T 782f1c8289804318a4e19fd896f4befd P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.956060 3658 ts_tablet_manager.cc:1918] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:51.955578 3662 tablet_bootstrap.cc:492] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.956174 3661 raft_consensus.cc:2267] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.956064 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7860f89c26334571a26351e2fd20c042. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.956459 3658 log.cc:1198] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/1d712e55f75b43e38f3e84d305dd9b3b
I20250115 10:11:51.956375 3711 tablet.cc:1721] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.956565 2951 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 2 got 0
I20250115 10:11:51.956645 3658 ts_tablet_manager.cc:1939] T 1d712e55f75b43e38f3e84d305dd9b3b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.956185 3662 ts_tablet_manager.cc:1397] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.956887 3662 raft_consensus.cc:357] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.956945 3662 raft_consensus.cc:383] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.956966 3662 raft_consensus.cc:738] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.957000 3662 consensus_queue.cc:260] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.957367 3662 ts_tablet_manager.cc:1428] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.957430 3662 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.957525 3655 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.957907 3662 tablet_bootstrap.cc:654] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.958025 3655 tablet_bootstrap.cc:654] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.957983 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 782f1c8289804318a4e19fd896f4befd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:51 UTC) from {username='slave'} at 127.0.0.1:50452
I20250115 10:11:51.958201 2950 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]). Expected version 2 got 0
I20250115 10:11:51.958491 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c311eccc93b4388b7ea59531803a244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:51.958556 3656 tablet_replica.cc:331] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.958623 3656 raft_consensus.cc:2238] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.958658 3656 raft_consensus.cc:2267] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.958781 3661 ts_tablet_manager.cc:1905] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.958956 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 782f1c8289804318a4e19fd896f4befd (table default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]) successfully deleted
I20250115 10:11:51.959149 3666 raft_consensus.cc:491] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.959187 3666 raft_consensus.cc:513] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.959268 3666 leader_election.cc:290] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.959476 3657 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:51.959512 3657 ts_tablet_manager.cc:1397] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
W20250115 10:11:51.959561 3350 leader_election.cc:343] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.959662 3658 tablet_replica.cc:331] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.959632 3657 raft_consensus.cc:357] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.959693 3657 raft_consensus.cc:383] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.959726 3657 raft_consensus.cc:738] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.959769 3657 consensus_queue.cc:260] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.958845 3662 tablet_bootstrap.cc:492] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.959829 3662 ts_tablet_manager.cc:1397] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:51.959825 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.959882 3657 ts_tablet_manager.cc:1428] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.959967 3662 raft_consensus.cc:357] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.960011 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782f1c8289804318a4e19fd896f4befd" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.960073 3279 raft_consensus.cc:2463] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.960091 3656 ts_tablet_manager.cc:1905] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.960292 3350 leader_election.cc:304] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:51.960489 2951 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82] alter complete (version 2)
I20250115 10:11:51.959705 3658 raft_consensus.cc:2238] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.960693 3658 raft_consensus.cc:2267] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.960737 3666 raft_consensus.cc:2798] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.960018 3662 raft_consensus.cc:383] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.960773 3666 raft_consensus.cc:491] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.960793 3666 raft_consensus.cc:3054] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.960790 3662 raft_consensus.cc:738] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.960841 3662 consensus_queue.cc:260] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.961078 3662 ts_tablet_manager.cc:1428] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.961135 3662 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.961436 3666 raft_consensus.cc:513] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.961913 3666 leader_election.cc:290] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:51.962177 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "782f1c8289804318a4e19fd896f4befd" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.962239 3279 raft_consensus.cc:3054] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.962292 3731 tablet.cc:1721] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.962584 3662 tablet_bootstrap.cc:654] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.962679 3655 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.962735 3655 ts_tablet_manager.cc:1397] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:11:51.962896 3279 raft_consensus.cc:2463] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.962962 3655 raft_consensus.cc:357] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.963037 3655 raft_consensus.cc:383] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.963057 3655 raft_consensus.cc:738] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.963099 3655 consensus_queue.cc:260] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.963192 3655 ts_tablet_manager.cc:1428] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.963382 3655 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:51.963815 3655 tablet_bootstrap.cc:654] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.963999 3661 ts_tablet_manager.cc:1918] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:51.964044 3661 log.cc:1198] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/1d712e55f75b43e38f3e84d305dd9b3b
I20250115 10:11:51.964248 3661 ts_tablet_manager.cc:1939] T 1d712e55f75b43e38f3e84d305dd9b3b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.964354 3350 leader_election.cc:304] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:11:51.964447 3350 leader_election.cc:343] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.964536 3655 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:51.964560 3666 raft_consensus.cc:2798] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.964577 3655 ts_tablet_manager.cc:1397] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:51.964598 3666 raft_consensus.cc:695] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:51.964643 3656 ts_tablet_manager.cc:1918] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.964637 3666 consensus_queue.cc:237] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:51.964695 3656 log.cc:1198] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/62be20367fae41909b56cba45da826a2
I20250115 10:11:51.964711 3655 raft_consensus.cc:357] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.964784 3655 raft_consensus.cc:383] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.964821 3655 raft_consensus.cc:738] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.964857 3655 consensus_queue.cc:260] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.964984 3655 ts_tablet_manager.cc:1428] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:51.964928 3662 tablet_bootstrap.cc:492] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.965090 3662 ts_tablet_manager.cc:1397] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:51.961405 3658 ts_tablet_manager.cc:1905] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.965245 3662 raft_consensus.cc:357] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.965341 3662 raft_consensus.cc:383] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.965361 3662 raft_consensus.cc:738] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.965637 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.965813 3656 ts_tablet_manager.cc:1939] T 62be20367fae41909b56cba45da826a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.966022 3656 tablet_replica.cc:331] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.966097 3661 tablet_replica.cc:331] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.966102 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 62be20367fae41909b56cba45da826a2 (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:51.966150 3661 raft_consensus.cc:2238] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.966189 3661 raft_consensus.cc:2267] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.966240 3662 consensus_queue.cc:260] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.966315 3661 ts_tablet_manager.cc:1905] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.966323 3658 ts_tablet_manager.cc:1918] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.966578 3662 ts_tablet_manager.cc:1428] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.966599 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:51.966794 3658 log.cc:1198] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/505058de7e084c2881c67bad44998074
I20250115 10:11:51.966642 3662 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.967005 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:51.966961 3656 raft_consensus.cc:2238] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.967235 3656 raft_consensus.cc:2267] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.967295 3658 ts_tablet_manager.cc:1939] T 505058de7e084c2881c67bad44998074 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.967485 3658 tablet_replica.cc:331] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.967574 3658 raft_consensus.cc:2238] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.967572 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 505058de7e084c2881c67bad44998074 (table default.Table_1b6ed4d9ef9f469e99aa7228e528b58e [id=ffa1c5a22b3045368496ddf87f00f33d]) successfully deleted
I20250115 10:11:51.967662 3658 raft_consensus.cc:2267] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.967900 3658 ts_tablet_manager.cc:1905] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.968681 3656 ts_tablet_manager.cc:1905] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.968787 3658 ts_tablet_manager.cc:1918] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.968833 3658 log.cc:1198] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/ebe2e0c18a8f41fdb0c961511994c194
I20250115 10:11:51.968966 3658 ts_tablet_manager.cc:1939] T ebe2e0c18a8f41fdb0c961511994c194 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.969262 3658 tablet_replica.cc:331] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.969331 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet ebe2e0c18a8f41fdb0c961511994c194 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:51.969357 3658 raft_consensus.cc:2238] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.969441 3658 raft_consensus.cc:2267] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.969585 3658 ts_tablet_manager.cc:1905] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.969733 3656 ts_tablet_manager.cc:1918] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:51.969781 3656 log.cc:1198] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/1d712e55f75b43e38f3e84d305dd9b3b
I20250115 10:11:51.969982 3656 ts_tablet_manager.cc:1939] T 1d712e55f75b43e38f3e84d305dd9b3b P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.967701 3662 tablet_bootstrap.cc:654] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.967864 3661 ts_tablet_manager.cc:1918] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.970232 3661 log.cc:1198] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/ebe2e0c18a8f41fdb0c961511994c194
I20250115 10:11:51.970391 3661 ts_tablet_manager.cc:1939] T ebe2e0c18a8f41fdb0c961511994c194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.970573 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 1d712e55f75b43e38f3e84d305dd9b3b (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:51.970610 3661 tablet_replica.cc:331] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.970614 3662 tablet_bootstrap.cc:492] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.970728 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet ebe2e0c18a8f41fdb0c961511994c194 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:51.970746 3662 ts_tablet_manager.cc:1397] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:11:51.970799 3658 ts_tablet_manager.cc:1918] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.970808 3656 tablet_replica.cc:331] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.970750 3661 raft_consensus.cc:2238] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.970855 3656 raft_consensus.cc:2238] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.970846 3661 raft_consensus.cc:2267] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.970916 3658 log.cc:1198] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/cb2df56f3f4a473da33cc855eeb976e4
I20250115 10:11:51.971019 3656 raft_consensus.cc:2267] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.971030 3661 ts_tablet_manager.cc:1905] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.971004 3662 raft_consensus.cc:357] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.971061 3662 raft_consensus.cc:383] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.971087 3662 raft_consensus.cc:738] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.971112 3658 ts_tablet_manager.cc:1939] T cb2df56f3f4a473da33cc855eeb976e4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.971154 3662 consensus_queue.cc:260] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.971380 3656 ts_tablet_manager.cc:1905] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.971372 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet cb2df56f3f4a473da33cc855eeb976e4 (table default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:51.971453 3658 tablet_replica.cc:331] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:51.971529 3658 raft_consensus.cc:2238] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:51.971593 3658 pending_rounds.cc:62] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:11:51.971660 3658 pending_rounds.cc:69] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489495407370240 op_type: NO_OP noop_request { }
I20250115 10:11:51.971907 3658 raft_consensus.cc:2883] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:51.971968 3658 raft_consensus.cc:2267] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.972081 3662 ts_tablet_manager.cc:1428] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:51.972227 3661 ts_tablet_manager.cc:1918] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.972262 3661 log.cc:1198] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/cb2df56f3f4a473da33cc855eeb976e4
I20250115 10:11:51.972218 3658 ts_tablet_manager.cc:1905] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.972478 3661 ts_tablet_manager.cc:1939] T cb2df56f3f4a473da33cc855eeb976e4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.972853 3662 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:51.973039 3656 ts_tablet_manager.cc:1918] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.973091 3656 log.cc:1198] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/ebe2e0c18a8f41fdb0c961511994c194
I20250115 10:11:51.973276 3656 ts_tablet_manager.cc:1939] T ebe2e0c18a8f41fdb0c961511994c194 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.973307 3662 tablet_bootstrap.cc:654] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:51.973558 3658 ts_tablet_manager.cc:1918] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:51.973611 3658 log.cc:1198] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.973671 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet ebe2e0c18a8f41fdb0c961511994c194 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:51.973752 3662 tablet_bootstrap.cc:492] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:51.973753 3656 tablet_replica.cc:331] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:51.973800 3662 ts_tablet_manager.cc:1397] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.973810 3656 raft_consensus.cc:2238] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.973846 3656 raft_consensus.cc:2267] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.973995 3658 ts_tablet_manager.cc:1939] T 782f1c8289804318a4e19fd896f4befd P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:51.974079 3656 ts_tablet_manager.cc:1905] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.974092 3662 raft_consensus.cc:357] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.974165 3662 raft_consensus.cc:383] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:51.974215 3662 raft_consensus.cc:738] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:51.974282 3662 consensus_queue.cc:260] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.974298 2942 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 782f1c8289804318a4e19fd896f4befd (table default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]) successfully deleted
I20250115 10:11:51.974489 3661 tablet_replica.cc:331] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.974574 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet cb2df56f3f4a473da33cc855eeb976e4 (table default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:51.974608 3661 raft_consensus.cc:2238] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.974754 3661 raft_consensus.cc:2267] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.975085 3662 ts_tablet_manager.cc:1428] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:51.975080 3661 ts_tablet_manager.cc:1905] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.975346 3656 ts_tablet_manager.cc:1918] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.975430 3656 log.cc:1198] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/cb2df56f3f4a473da33cc855eeb976e4
I20250115 10:11:51.975579 3656 ts_tablet_manager.cc:1939] T cb2df56f3f4a473da33cc855eeb976e4 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:51.975915 2943 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet cb2df56f3f4a473da33cc855eeb976e4 (table default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:51.976531 3661 ts_tablet_manager.cc:1918] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.976593 3661 log.cc:1198] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/df8f572184684bef8d13ba26878d20f8
I20250115 10:11:51.976742 3661 ts_tablet_manager.cc:1939] T df8f572184684bef8d13ba26878d20f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.976977 3661 tablet_replica.cc:331] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:51.977042 3661 raft_consensus.cc:2238] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:51.977079 3661 raft_consensus.cc:2267] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:51.977079 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet df8f572184684bef8d13ba26878d20f8 (table default.Table_b246b11edb424180a1767d2f56bcfb93 [id=49ae0e80963c4528832ef0fa48f7fcde]) successfully deleted
I20250115 10:11:51.977237 3661 ts_tablet_manager.cc:1905] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:51.978139 3661 ts_tablet_manager.cc:1918] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:51.978205 3661 log.cc:1198] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/782f1c8289804318a4e19fd896f4befd
I20250115 10:11:51.978346 3661 ts_tablet_manager.cc:1939] T 782f1c8289804318a4e19fd896f4befd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:51.978602 2943 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 782f1c8289804318a4e19fd896f4befd (table default.Table_a86e019291994723927cb33be70e30b3 [id=f5204010b8994a779fa2a9b43ec44ad1]) successfully deleted
I20250115 10:11:51.982384 3670 raft_consensus.cc:491] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:51.982441 3670 raft_consensus.cc:513] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.982559 3670 leader_election.cc:290] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.982765 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a236fda8124147a057be51ecfff945" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:51.982795 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a236fda8124147a057be51ecfff945" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:51.982846 3279 raft_consensus.cc:2463] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.982870 3550 raft_consensus.cc:2463] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:51.983026 3350 leader_election.cc:304] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:51.983120 3670 raft_consensus.cc:2798] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:51.983162 3670 raft_consensus.cc:491] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:51.983184 3670 raft_consensus.cc:3054] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.983700 3670 raft_consensus.cc:513] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.983844 3670 leader_election.cc:290] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:51.983999 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a236fda8124147a057be51ecfff945" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:51.984051 3279 raft_consensus.cc:3054] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.984045 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95a236fda8124147a057be51ecfff945" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:51.984112 3550 raft_consensus.cc:3054] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:51.984521 3279 raft_consensus.cc:2463] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.984665 3550 raft_consensus.cc:2463] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:51.984709 3350 leader_election.cc:304] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:51.984802 3670 raft_consensus.cc:2798] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:51.984854 3670 raft_consensus.cc:695] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:51.984899 3670 consensus_queue.cc:237] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:51.985499 2955 catalog_manager.cc:5526] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:51.985597 2955 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 2 got 0
I20250115 10:11:51.994522 3279 raft_consensus.cc:1270] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.994524 3550 raft_consensus.cc:1270] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:51.994751 3670 consensus_queue.cc:1035] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.994839 3666 consensus_queue.cc:1035] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:51.995637 2955 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 2 got 0
I20250115 10:11:51.996256 3711 tablet.cc:1721] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.996332 3731 tablet.cc:1721] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:51.996503 3705 mvcc.cc:204] Tried to move back new op lower bound from 7114489495528017920 to 7114489495490461696. Current Snapshot: MvccSnapshot[applied={T|T < 7114489495528017920}]
I20250115 10:11:51.997390 2955 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]). Expected version 2 got 0
I20250115 10:11:51.998047 2950 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479] alter complete (version 2)
I20250115 10:11:51.998234 3710 tablet.cc:1721] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.005463 3671 raft_consensus.cc:491] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.005529 3671 raft_consensus.cc:513] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.005751 3671 leader_election.cc:290] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.008742 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7860f89c26334571a26351e2fd20c042" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.008773 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7860f89c26334571a26351e2fd20c042" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.008847 3415 raft_consensus.cc:2463] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.008847 3550 raft_consensus.cc:2463] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.009034 3215 leader_election.cc:304] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.009166 3671 raft_consensus.cc:2798] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.009235 3671 raft_consensus.cc:491] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.009250 3671 raft_consensus.cc:3054] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.009891 3671 raft_consensus.cc:513] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.010023 3671 leader_election.cc:290] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.010202 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7860f89c26334571a26351e2fd20c042" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.010236 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7860f89c26334571a26351e2fd20c042" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.010293 3550 raft_consensus.cc:3054] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.010299 3415 raft_consensus.cc:3054] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.010957 3415 raft_consensus.cc:2463] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.010957 3550 raft_consensus.cc:2463] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.011132 3214 leader_election.cc:304] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.011224 3671 raft_consensus.cc:2798] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.011314 3671 raft_consensus.cc:695] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.011368 3671 consensus_queue.cc:237] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.012058 2950 catalog_manager.cc:5526] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.084280 3665 raft_consensus.cc:491] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.084389 3665 raft_consensus.cc:513] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.084553 3665 leader_election.cc:290] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.084757 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c3726d8be14adeacea32fb82bf5913" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.084847 3415 raft_consensus.cc:2463] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.084815 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c3726d8be14adeacea32fb82bf5913" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.084913 3279 raft_consensus.cc:2463] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.085000 3484 leader_election.cc:304] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.085141 3665 raft_consensus.cc:2798] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.085186 3665 raft_consensus.cc:491] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.085203 3665 raft_consensus.cc:3054] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.085960 3665 raft_consensus.cc:513] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.086095 3665 leader_election.cc:290] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.086215 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c3726d8be14adeacea32fb82bf5913" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.086283 3415 raft_consensus.cc:3054] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.086308 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9c3726d8be14adeacea32fb82bf5913" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.086381 3279 raft_consensus.cc:3054] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.086969 3415 raft_consensus.cc:2463] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.086990 3279 raft_consensus.cc:2463] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.087141 3484 leader_election.cc:304] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.087236 3665 raft_consensus.cc:2798] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.087169 2950 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_43716352b9c4495ba22250ef039e268d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:52.087280 3665 raft_consensus.cc:695] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:11:52.087312 2950 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43716352b9c4495ba22250ef039e268d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.087316 3665 consensus_queue.cc:237] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.087822 2955 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_aebe1f2ba47642788e4a8e71dca5acad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.087967 2955 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aebe1f2ba47642788e4a8e71dca5acad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.087947 2949 catalog_manager.cc:5526] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.087996 2951 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_0ef656e644104941a603aa26c89f1772"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.088068 2951 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef656e644104941a603aa26c89f1772 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.088376 2953 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_b5eda0ed1b124fdabbb33656f6b3eece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.088465 2953 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5eda0ed1b124fdabbb33656f6b3eece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.090174 2957 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_32ddd52e4b2c40e3aeae38afe9c03eff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:52.090214 2956 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_df4a7240aebb4948b8f1f69966f5bd87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.090266 2957 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ddd52e4b2c40e3aeae38afe9c03eff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.090229 2948 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_55e9d5ef334a4d61a7708bd492211b40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.090380 2948 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55e9d5ef334a4d61a7708bd492211b40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.090255 2952 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_aa9bdbddbbff43aca427359974809b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.090318 2956 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df4a7240aebb4948b8f1f69966f5bd87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:52.090500 2952 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa9bdbddbbff43aca427359974809b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.092806 3671 raft_consensus.cc:491] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.092872 3671 raft_consensus.cc:513] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.093006 3671 leader_election.cc:290] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.093132 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "670935dae51e4585920666a958c556ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.093196 3415 raft_consensus.cc:2463] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.093178 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "670935dae51e4585920666a958c556ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.093235 3550 raft_consensus.cc:2463] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.093330 3214 leader_election.cc:304] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.093400 3671 raft_consensus.cc:2798] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.093447 3671 raft_consensus.cc:491] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.093469 3671 raft_consensus.cc:3054] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.093688 2954 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39756:
name: "default.Table_e5d23a5647e244c0b5dce7cb47f567da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.093772 2954 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5d23a5647e244c0b5dce7cb47f567da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.094159 3671 raft_consensus.cc:513] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.094292 3671 leader_election.cc:290] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.094460 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "670935dae51e4585920666a958c556ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.094477 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "670935dae51e4585920666a958c556ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.094524 3415 raft_consensus.cc:3054] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.094534 3550 raft_consensus.cc:3054] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.095033 3415 raft_consensus.cc:2463] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.095049 3550 raft_consensus.cc:2463] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.095194 3215 leader_election.cc:304] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.095278 3671 raft_consensus.cc:2798] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.095326 3671 raft_consensus.cc:695] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.095372 3671 consensus_queue.cc:237] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.182581 3666 raft_consensus.cc:491] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.182672 3666 raft_consensus.cc:513] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.182829 3666 leader_election.cc:290] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.183099 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856454f4db4d471d81af2ea784215030" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.183187 3279 raft_consensus.cc:2463] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.183135 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856454f4db4d471d81af2ea784215030" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.183260 3550 raft_consensus.cc:2463] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.183399 3350 leader_election.cc:304] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.183504 3666 raft_consensus.cc:2798] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.183549 3666 raft_consensus.cc:491] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.183575 3666 raft_consensus.cc:3054] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.184320 3666 raft_consensus.cc:513] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.184443 3666 leader_election.cc:290] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.184609 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856454f4db4d471d81af2ea784215030" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.184686 3279 raft_consensus.cc:3054] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.184650 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "856454f4db4d471d81af2ea784215030" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.184728 3550 raft_consensus.cc:3054] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.185314 3550 raft_consensus.cc:2463] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.185441 3279 raft_consensus.cc:2463] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.185513 3350 leader_election.cc:304] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.185652 3666 raft_consensus.cc:2798] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.185706 3666 raft_consensus.cc:695] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:52.185757 3666 consensus_queue.cc:237] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.191666 3671 raft_consensus.cc:491] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.191742 3671 raft_consensus.cc:513] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.191879 3671 leader_election.cc:290] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.192109 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c311eccc93b4388b7ea59531803a244" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.192112 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c311eccc93b4388b7ea59531803a244" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.192176 3550 raft_consensus.cc:2463] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.192176 3415 raft_consensus.cc:2463] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.192299 3215 leader_election.cc:304] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.192394 3671 raft_consensus.cc:2798] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.192440 3671 raft_consensus.cc:491] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.192453 3671 raft_consensus.cc:3054] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.192929 3671 raft_consensus.cc:513] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.193030 3671 leader_election.cc:290] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.193122 3671 raft_consensus.cc:491] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.193138 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c311eccc93b4388b7ea59531803a244" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.193154 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c311eccc93b4388b7ea59531803a244" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.193166 3671 raft_consensus.cc:513] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.193199 3550 raft_consensus.cc:3054] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.193199 3415 raft_consensus.cc:3054] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.193272 3671 leader_election.cc:290] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.193792 3415 raft_consensus.cc:2463] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.193823 3550 raft_consensus.cc:2463] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.193933 3215 leader_election.cc:304] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.193974 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4839f8e0539d468ea11077d48f8f8266" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.194006 3671 raft_consensus.cc:2798] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.194023 3550 raft_consensus.cc:2463] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.194015 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4839f8e0539d468ea11077d48f8f8266" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.194061 3415 raft_consensus.cc:2463] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.194144 3215 leader_election.cc:304] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.194151 3671 raft_consensus.cc:695] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.194233 3770 raft_consensus.cc:2798] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.194272 3770 raft_consensus.cc:491] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.194298 3770 raft_consensus.cc:3054] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.194865 3770 raft_consensus.cc:513] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.194976 3770 leader_election.cc:290] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.195055 3671 consensus_queue.cc:237] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.195091 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4839f8e0539d468ea11077d48f8f8266" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.195114 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4839f8e0539d468ea11077d48f8f8266" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.195147 3550 raft_consensus.cc:3054] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.195168 3415 raft_consensus.cc:3054] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.195652 3415 raft_consensus.cc:2463] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.195811 3550 raft_consensus.cc:2463] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.195806 3214 leader_election.cc:304] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.195885 3671 raft_consensus.cc:2798] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.195927 3671 raft_consensus.cc:695] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.196180 3671 consensus_queue.cc:237] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.211963 3665 raft_consensus.cc:491] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.212055 3665 raft_consensus.cc:513] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.212198 3665 leader_election.cc:290] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.212375 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af13c18749940828dbe55ef2cdbf31c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.212388 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af13c18749940828dbe55ef2cdbf31c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.212455 3279 raft_consensus.cc:2463] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.212456 3415 raft_consensus.cc:2463] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.212594 3484 leader_election.cc:304] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.212692 3665 raft_consensus.cc:2798] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.212743 3665 raft_consensus.cc:491] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.212770 3665 raft_consensus.cc:3054] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.213295 3665 raft_consensus.cc:513] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.213421 3665 leader_election.cc:290] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.213554 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af13c18749940828dbe55ef2cdbf31c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.213564 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9af13c18749940828dbe55ef2cdbf31c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.213624 3415 raft_consensus.cc:3054] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.213624 3279 raft_consensus.cc:3054] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.214123 3415 raft_consensus.cc:2463] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.214322 3279 raft_consensus.cc:2463] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.214326 3484 leader_election.cc:304] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.214409 3665 raft_consensus.cc:2798] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.214455 3665 raft_consensus.cc:695] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.214504 3665 consensus_queue.cc:237] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.322391 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--webserver_interface=127.2.217.189
--webserver_port=38131
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250115 10:11:52.392879 3671 consensus_queue.cc:1035] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.394996 3671 consensus_queue.cc:1035] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:11:52.411638 3778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:52.411851 3778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:52.411885 3778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:52.413319 3778 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:52.413370 3778 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:52.413393 3778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:52.413411 3778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:52.413432 3778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:52.413462 3778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:52.414877 3778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.217.189
--webserver_port=38131
--never_fsync=true
--heap_profile_path=/tmp/kudu.3778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:52.415084 3778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:52.415283 3778 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:52.420018 3785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:52.420750 3788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:52.421553 3786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:52.422353 3778 server_base.cc:1034] running on GCE node
I20250115 10:11:52.422595 3778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:52.422837 3778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:52.423981 3778 hybrid_clock.cc:648] HybridClock initialized: now 1736935912423967 us; error 26 us; skew 500 ppm
I20250115 10:11:52.425297 3778 webserver.cc:458] Webserver started at http://127.2.217.189:38131/ using document root <none> and password file <none>
I20250115 10:11:52.425510 3778 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:52.425566 3778 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:52.426822 3778 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.427448 3794 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.427606 3778 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:52.427672 3778 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:52.427979 3778 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:52.437565 3778 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:52.437779 3778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:52.437871 3778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:52.441668 3778 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.189:36717
I20250115 10:11:52.441705 3846 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.189:36717 every 8 connection(s)
I20250115 10:11:52.441996 3778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
I20250115 10:11:52.442943 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 3778
I20250115 10:11:52.443709 3847 sys_catalog.cc:263] Verifying existing consensus state
I20250115 10:11:52.444428 3847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap starting.
I20250115 10:11:52.445757 3847 log.cc:826] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:52.447063 3847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250115 10:11:52.447291 3847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap complete.
I20250115 10:11:52.448762 3847 raft_consensus.cc:357] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.449029 3847 raft_consensus.cc:738] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4346420bb4a5abb9cf66799e35565, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.449159 3847 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.449476 3847 sys_catalog.cc:564] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:11:52.449445 3852 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.449539 3852 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:52.451511 3863 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:52.451579 3863 catalog_manager.cc:1553] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: success
I20250115 10:11:52.452455 3863 catalog_manager.cc:1575] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: acquiring CA information for follower catalog manager: success
I20250115 10:11:52.452847 3863 catalog_manager.cc:1603] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:11:52.474033 3702 consensus_queue.cc:1035] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.476049 3665 consensus_queue.cc:1035] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.478397 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:52.479838 3806 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" instance_seqno: 1736935911544757) as {username='slave'} at 127.2.217.130:56631; Asking this server to re-register.
I20250115 10:11:52.480394 3463 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:52.480810 3806 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.480939 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:52.481364 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:52.481436 3811 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" instance_seqno: 1736935911435877) as {username='slave'} at 127.2.217.129:44619; Asking this server to re-register.
I20250115 10:11:52.481665 3328 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:52.481962 3811 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.481971 3806 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" instance_seqno: 1736935911647047) as {username='slave'} at 127.2.217.131:41849; Asking this server to re-register.
I20250115 10:11:52.482232 3598 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:52.482553 3811 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.522096 3870 raft_consensus.cc:491] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88f5e7c003a641128acc22b394ab62c7)
I20250115 10:11:52.522173 3870 raft_consensus.cc:513] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.522403 3870 leader_election.cc:290] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717)
I20250115 10:11:52.522768 2967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 87 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:52.525611 3821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 87 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565" is_pre_election: true
I20250115 10:11:52.525774 3821 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdb1ea5a27ca44baa3b0fe127143df0b in term 1.
I20250115 10:11:52.525964 3087 leader_election.cc:304] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cdb1ea5a27ca44baa3b0fe127143df0b, efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7
I20250115 10:11:52.526077 3870 raft_consensus.cc:2798] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:52.526126 3870 raft_consensus.cc:491] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88f5e7c003a641128acc22b394ab62c7)
I20250115 10:11:52.526150 3870 raft_consensus.cc:3054] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:52.526798 3870 raft_consensus.cc:513] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.526935 3870 leader_election.cc:290] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [CANDIDATE]: Term 2 election: Requested vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717)
I20250115 10:11:52.527073 2967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 87 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7"
I20250115 10:11:52.527139 3821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 87 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565"
I20250115 10:11:52.527204 3821 raft_consensus.cc:3054] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:52.528244 3821 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdb1ea5a27ca44baa3b0fe127143df0b in term 2.
I20250115 10:11:52.528451 3087 leader_election.cc:304] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cdb1ea5a27ca44baa3b0fe127143df0b, efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7
I20250115 10:11:52.528551 3870 raft_consensus.cc:2798] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 FOLLOWER]: Leader election won for term 2
I20250115 10:11:52.528637 3870 raft_consensus.cc:695] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 LEADER]: Becoming Leader. State: Replica: cdb1ea5a27ca44baa3b0fe127143df0b, State: Running, Role: LEADER
I20250115 10:11:52.528707 3870 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 1.87, Last appended by leader: 87, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.528947 3872 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdb1ea5a27ca44baa3b0fe127143df0b. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.529029 3872 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:52.529161 3873 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250115 10:11:52.529438 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_c7bde786768e44269c12f496480905a2 [id=284816018979468d99f5a23274d90447]
I20250115 10:11:52.529495 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb]
I20250115 10:11:52.529539 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]
I20250115 10:11:52.529577 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_450dd25d44a54063b370d5edc85637ef [id=86dc03ca83b14d698f499bb19dd94763]
I20250115 10:11:52.529611 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]
I20250115 10:11:52.529655 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]
I20250115 10:11:52.529748 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]
I20250115 10:11:52.529789 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]
I20250115 10:11:52.529822 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_9fb1073f070d419983294b0745c79ad1 [id=d483fefe2d154fefb3fce62fb5e56538]
I20250115 10:11:52.529858 3873 catalog_manager.cc:670] Loaded metadata for table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]
I20250115 10:11:52.530055 3873 tablet_loader.cc:96] loaded metadata for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_c7bde786768e44269c12f496480905a2 [id=284816018979468d99f5a23274d90447])
I20250115 10:11:52.530102 3873 tablet_loader.cc:96] loaded metadata for tablet 670935dae51e4585920666a958c556ec (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018])
I20250115 10:11:52.530157 3873 tablet_loader.cc:96] loaded metadata for tablet 6c311eccc93b4388b7ea59531803a244 (table default.Table_57ec061e82db421da28031d2eba6f352 [id=72870ee419d64f87a3c24c163a7202cb])
I20250115 10:11:52.530193 3873 tablet_loader.cc:96] loaded metadata for tablet 7860f89c26334571a26351e2fd20c042 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15])
I20250115 10:11:52.530249 3873 tablet_loader.cc:96] loaded metadata for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874])
I20250115 10:11:52.530283 3873 tablet_loader.cc:96] loaded metadata for tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479])
I20250115 10:11:52.530319 3873 tablet_loader.cc:96] loaded metadata for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9])
I20250115 10:11:52.530372 3873 tablet_loader.cc:96] loaded metadata for tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82])
I20250115 10:11:52.530405 3873 tablet_loader.cc:96] loaded metadata for tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_9fb1073f070d419983294b0745c79ad1 [id=d483fefe2d154fefb3fce62fb5e56538])
I20250115 10:11:52.530440 3873 tablet_loader.cc:96] loaded metadata for tablet f9c3726d8be14adeacea32fb82bf5913 (table default.Table_450dd25d44a54063b370d5edc85637ef [id=86dc03ca83b14d698f499bb19dd94763])
I20250115 10:11:52.530474 3873 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250115 10:11:52.530563 3873 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:52.530591 3873 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250115 10:11:52.530761 3873 catalog_manager.cc:1505] Loading token signing keys...
I20250115 10:11:52.530850 3873 catalog_manager.cc:5910] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Loaded TSK: 0
I20250115 10:11:52.530980 3873 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250115 10:11:52.541085 3770 consensus_queue.cc:1035] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.541852 3101 catalog_manager.cc:5526] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } }
I20250115 10:11:52.542757 3671 consensus_queue.cc:1035] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.544610 3821 raft_consensus.cc:1270] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Refusing update from remote peer cdb1ea5a27ca44baa3b0fe127143df0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 89. (index mismatch)
I20250115 10:11:52.544788 2967 raft_consensus.cc:3049] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 LEADER]: Stepping down as leader of term 1
I20250115 10:11:52.544847 2967 raft_consensus.cc:738] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88f5e7c003a641128acc22b394ab62c7, State: Running, Role: LEADER
I20250115 10:11:52.544921 2967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 1.97, Last appended by leader: 97, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:52.545027 2967 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:52.545634 2967 raft_consensus.cc:1270] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Refusing update from remote peer cdb1ea5a27ca44baa3b0fe127143df0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 97. Preceding OpId from leader: term: 2 index: 89. (term mismatch)
I20250115 10:11:52.545668 2967 pending_rounds.cc:77] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting all ops after (but not including) 88
I20250115 10:11:52.545691 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.89
I20250115 10:11:52.545774 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.90
W20250115 10:11:52.545807 2955 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
E20250115 10:11:52.545850 2949 catalog_manager.cc:5681] Error updating tablets from 89067c97cc1c45e699ee9f690cb3014f: Aborted: Op aborted by new leader. Tablet report was: is_incremental: true updated_tablets { tablet_id: "f9c3726d8be14adeacea32fb82bf5913" state: RUNNING consensus_state { current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { } } sequence_number: 44
I20250115 10:11:52.545825 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.91
I20250115 10:11:52.546150 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.92
I20250115 10:11:52.546223 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.93
I20250115 10:11:52.546267 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.94
I20250115 10:11:52.546319 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.95
W20250115 10:11:52.546342 2948 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250115 10:11:52.546363 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.96
I20250115 10:11:52.546406 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.97
W20250115 10:11:52.546494 2954 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:11:52.546545 2951 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250115 10:11:52.546728 2954 master_service.cc:946] ReplaceTablet: received request to replace tablet db1eb078c2d74b0c8ebff56863717195 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:52.546754 2951 master_service.cc:946] ReplaceTablet: received request to replace tablet bac5460ff8d848369760e64efeb62dfc from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:52.546784 2954 master_service.cc:946] ReplaceTablet: received request to replace tablet 856454f4db4d471d81af2ea784215030 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:52.546824 2951 master_service.cc:946] ReplaceTablet: received request to replace tablet f9c3726d8be14adeacea32fb82bf5913 from {username='slave'} at 127.0.0.1:39756
I20250115 10:11:52.546826 2954 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c311eccc93b4388b7ea59531803a244 from {username='slave'} at 127.0.0.1:39756
W20250115 10:11:52.546964 2953 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:11:52.547042 2957 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:11:52.547115 2956 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:11:52.547173 2952 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:11:52.548632 3603 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.217.190:46859)
W20250115 10:11:52.548769 3603 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.217.190:46859)
W20250115 10:11:52.548843 3603 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.217.190:46859)
W20250115 10:11:52.549012 3603 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.2.217.190:46859)
I20250115 10:11:52.550691 3872 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 4, Time since last communication: 0.000s
I20250115 10:11:52.551260 3872 consensus_queue.cc:1035] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20250115 10:11:52.551386 3872 consensus_queue.cc:1225] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [LEADER]: Peer 88f5e7c003a641128acc22b394ab62c7 log is divergent from this leader: its last log entry 1.88 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 87
I20250115 10:11:52.551699 2967 pending_rounds.cc:77] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting all ops after (but not including) 87
I20250115 10:11:52.551766 2967 pending_rounds.cc:99] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Aborting uncommitted WRITE_OP operation due to leader change: 1.88
W20250115 10:11:52.552009 2950 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250115 10:11:52.552115 3641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdb1ea5a27ca44baa3b0fe127143df0b. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.552170 3641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:52.552198 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_55e9d5ef334a4d61a7708bd492211b40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.552410 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55e9d5ef334a4d61a7708bd492211b40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.552680 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e5d23a5647e244c0b5dce7cb47f567da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.552793 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5d23a5647e244c0b5dce7cb47f567da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.552951 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ac08bf67f62547f5b8c7a155b41512d0" } new_table_name: "default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566" modify_external_catalogs: true
I20250115 10:11:52.553151 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0ef656e644104941a603aa26c89f1772"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.553237 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ef656e644104941a603aa26c89f1772 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.553349 3641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.553392 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_38f2486d33724fdfbbb0636e959c98cf" } modify_external_catalogs: true
I20250115 10:11:52.553416 3641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:52.553438 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_38f2486d33724fdfbbb0636e959c98cf" } modify_external_catalogs: true
I20250115 10:11:52.553633 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_57ec061e82db421da28031d2eba6f352" } new_table_name: "default.Table_9634080873be4b1298b25849dbebdbee" modify_external_catalogs: true
I20250115 10:11:52.553932 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_aebe1f2ba47642788e4a8e71dca5acad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.554021 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aebe1f2ba47642788e4a8e71dca5acad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.554682 3101 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_450dd25d44a54063b370d5edc85637ef" } new_table_name: "default.Table_48062bcffb944b3195686962decc74eb" modify_external_catalogs: true
I20250115 10:11:52.554946 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9fb1073f070d419983294b0745c79ad1" } new_table_name: "default.Table_dc259fc343564cada5bc183e3a1781b0" modify_external_catalogs: true
I20250115 10:11:52.555234 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c7bde786768e44269c12f496480905a2" } new_table_name: "default.Table_d5311d6b627d473a9b80c77f756569f1" modify_external_catalogs: true
I20250115 10:11:52.555981 3461 heartbeater.cc:501] Master 127.2.217.188:38283 was elected leader, sending a full tablet report...
I20250115 10:11:52.556543 3184 catalog_manager.cc:1603] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:11:52.556913 3852 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdb1ea5a27ca44baa3b0fe127143df0b. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.557000 3852 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:52.557376 3596 heartbeater.cc:501] Master 127.2.217.188:38283 was elected leader, sending a full tablet report...
I20250115 10:11:52.553936 3872 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.559175 3872 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:52.560106 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aad777aa179d4b2ba8bab5f224853a4c" } modify_external_catalogs: true
I20250115 10:11:52.560163 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aad777aa179d4b2ba8bab5f224853a4c" } modify_external_catalogs: true
I20250115 10:11:52.560639 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_297e114594f943baa50770c53a3887c8" } modify_external_catalogs: true
I20250115 10:11:52.560708 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_297e114594f943baa50770c53a3887c8" } modify_external_catalogs: true
I20250115 10:11:52.563473 3096 catalog_manager.cc:5526] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.563581 3096 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:52.563652 3096 catalog_manager.cc:5526] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.563743 3096 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
I20250115 10:11:52.564914 3097 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]). Expected version 2 got 0
I20250115 10:11:52.564989 3097 catalog_manager.cc:5526] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.565068 3097 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_ac08bf67f62547f5b8c7a155b41512d0 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 1 got 0
W20250115 10:11:52.565261 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4839f8e0539d468ea11077d48f8f8266 consensus state has no leader
I20250115 10:11:52.565351 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b32dafab78104aeeb20db4f39dd3a820" } modify_external_catalogs: true
I20250115 10:11:52.565405 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b32dafab78104aeeb20db4f39dd3a820" } modify_external_catalogs: true
W20250115 10:11:52.565491 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c311eccc93b4388b7ea59531803a244 consensus state has no leader
I20250115 10:11:52.565546 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_15fcb62d8fc24406bc67064de58249e1" } modify_external_catalogs: true
I20250115 10:11:52.565577 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_15fcb62d8fc24406bc67064de58249e1" } modify_external_catalogs: true
I20250115 10:11:52.565704 3101 master_service.cc:946] ReplaceTablet: received request to replace tablet db1eb078c2d74b0c8ebff56863717195 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:52.565773 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 856454f4db4d471d81af2ea784215030 consensus state has no leader
I20250115 10:11:52.565821 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet bac5460ff8d848369760e64efeb62dfc from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.565869 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 7860f89c26334571a26351e2fd20c042
I20250115 10:11:52.565986 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet 856454f4db4d471d81af2ea784215030 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.566035 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 670935dae51e4585920666a958c556ec
I20250115 10:11:52.566123 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet f9c3726d8be14adeacea32fb82bf5913 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.566218 3100 master_service.cc:946] ReplaceTablet: received request to replace tablet 6c311eccc93b4388b7ea59531803a244 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.569775 3886 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.569823 3852 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:52.569905 3886 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: LEADER
I20250115 10:11:52.569914 3852 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:52.570147 3100 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6c311eccc93b4388b7ea59531803a244
I20250115 10:11:52.570214 3100 catalog_manager.cc:6596] ReplaceTablet: tablet 6c311eccc93b4388b7ea59531803a244 deleted and replaced by tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:52.570267 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b5eda0ed1b124fdabbb33656f6b3eece"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.570343 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5eda0ed1b124fdabbb33656f6b3eece in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.570473 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 856454f4db4d471d81af2ea784215030
I20250115 10:11:52.570513 3093 catalog_manager.cc:6596] ReplaceTablet: tablet 856454f4db4d471d81af2ea784215030 deleted and replaced by tablet fd018dc2d7f644339b5feba799d3bdd7
I20250115 10:11:52.570550 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_32ddd52e4b2c40e3aeae38afe9c03eff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.570621 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ddd52e4b2c40e3aeae38afe9c03eff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.570811 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 9af13c18749940828dbe55ef2cdbf31c
I20250115 10:11:52.570897 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_df4a7240aebb4948b8f1f69966f5bd87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.570960 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df4a7240aebb4948b8f1f69966f5bd87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.571067 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet bac5460ff8d848369760e64efeb62dfc
I20250115 10:11:52.571146 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_aa9bdbddbbff43aca427359974809b8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.571216 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa9bdbddbbff43aca427359974809b8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.571197 3878 mvcc.cc:204] Tried to move back new op lower bound from 7114489497779380224 to 7114489497717948416. Current Snapshot: MvccSnapshot[applied={T|T < 7114489495602388992}]
I20250115 10:11:52.571321 3101 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet db1eb078c2d74b0c8ebff56863717195
I20250115 10:11:52.571357 3101 catalog_manager.cc:6596] ReplaceTablet: tablet db1eb078c2d74b0c8ebff56863717195 deleted and replaced by tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:11:52.571391 3101 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3a6dc1067d51493e8d19f1a5ac37abfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.571437 3101 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a6dc1067d51493e8d19f1a5ac37abfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.571765 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 95a236fda8124147a057be51ecfff945
I20250115 10:11:52.572795 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f9c3726d8be14adeacea32fb82bf5913
I20250115 10:11:52.572868 3098 catalog_manager.cc:6596] ReplaceTablet: tablet f9c3726d8be14adeacea32fb82bf5913 deleted and replaced by tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:52.573834 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 5a789dbdecae4df287752bc6bac1f84e (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.573889 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 66cf94364ef34cfab28e355f42229305 (DEFAULT_TABLE table=default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.573930 3395 tablet_service.cc:1514] Processing DeleteTablet for tablet 856454f4db4d471d81af2ea784215030 with delete_type TABLET_DATA_DELETED (replaced by tablet fd018dc2d7f644339b5feba799d3bdd7) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.573972 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a789dbdecae4df287752bc6bac1f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.574026 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf94364ef34cfab28e355f42229305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.574043 3390 tablet_service.cc:1514] Processing DeleteTablet for tablet 7860f89c26334571a26351e2fd20c042 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.573910 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 670935dae51e4585920666a958c556ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574110 3393 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c311eccc93b4388b7ea59531803a244 with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbfcedc2f5447a1acb095066d131d52) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574143 3387 tablet_service.cc:1514] Processing DeleteTablet for tablet 9af13c18749940828dbe55ef2cdbf31c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574074 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 777cc4bb380a4b53942b2c978325146e (DEFAULT_TABLE table=default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.574225 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet bac5460ff8d848369760e64efeb62dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574278 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777cc4bb380a4b53942b2c978325146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.574294 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet db1eb078c2d74b0c8ebff56863717195 with delete_type TABLET_DATA_DELETED (replaced by tablet 86d086cd94664d40a653d64d06438bda) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574349 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a236fda8124147a057be51ecfff945 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574419 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c3726d8be14adeacea32fb82bf5913 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ba4b779b29841f69fe72527763ab7a1) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.574959 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 777cc4bb380a4b53942b2c978325146e (DEFAULT_TABLE table=default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.575070 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777cc4bb380a4b53942b2c978325146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.575399 3521 tablet_service.cc:1467] Processing CreateTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (DEFAULT_TABLE table=default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.575526 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.575873 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c3726d8be14adeacea32fb82bf5913 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ba4b779b29841f69fe72527763ab7a1) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576071 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a236fda8124147a057be51ecfff945 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576134 3518 tablet_service.cc:1514] Processing DeleteTablet for tablet db1eb078c2d74b0c8ebff56863717195 with delete_type TABLET_DATA_DELETED (replaced by tablet 86d086cd94664d40a653d64d06438bda) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576185 3519 tablet_service.cc:1514] Processing DeleteTablet for tablet bac5460ff8d848369760e64efeb62dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576231 3520 tablet_service.cc:1514] Processing DeleteTablet for tablet 9af13c18749940828dbe55ef2cdbf31c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576278 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c311eccc93b4388b7ea59531803a244 with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbfcedc2f5447a1acb095066d131d52) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576339 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 670935dae51e4585920666a958c556ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576390 3529 tablet_service.cc:1514] Processing DeleteTablet for tablet 7860f89c26334571a26351e2fd20c042 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.576581 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 66cf94364ef34cfab28e355f42229305 (DEFAULT_TABLE table=default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.576665 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf94364ef34cfab28e355f42229305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.576850 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 856454f4db4d471d81af2ea784215030 with delete_type TABLET_DATA_DELETED (replaced by tablet fd018dc2d7f644339b5feba799d3bdd7) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.577057 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 5a789dbdecae4df287752bc6bac1f84e (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.577157 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 66cf94364ef34cfab28e355f42229305 (DEFAULT_TABLE table=default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.577188 3258 tablet_service.cc:1467] Processing CreateTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (DEFAULT_TABLE table=default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.577211 3251 tablet_service.cc:1514] Processing DeleteTablet for tablet 7860f89c26334571a26351e2fd20c042 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577263 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c311eccc93b4388b7ea59531803a244 with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbfcedc2f5447a1acb095066d131d52) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577333 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet db1eb078c2d74b0c8ebff56863717195 with delete_type TABLET_DATA_DELETED (replaced by tablet 86d086cd94664d40a653d64d06438bda) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577344 3255 tablet_service.cc:1514] Processing DeleteTablet for tablet 670935dae51e4585920666a958c556ec with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577172 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a789dbdecae4df287752bc6bac1f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.574050 3391 tablet_service.cc:1467] Processing CreateTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (DEFAULT_TABLE table=default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.577418 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 856454f4db4d471d81af2ea784215030 with delete_type TABLET_DATA_DELETED (replaced by tablet fd018dc2d7f644339b5feba799d3bdd7) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577476 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 9af13c18749940828dbe55ef2cdbf31c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577479 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.577531 3250 tablet_service.cc:1514] Processing DeleteTablet for tablet bac5460ff8d848369760e64efeb62dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577565 3249 tablet_service.cc:1514] Processing DeleteTablet for tablet 95a236fda8124147a057be51ecfff945 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577615 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet f9c3726d8be14adeacea32fb82bf5913 with delete_type TABLET_DATA_DELETED (replaced by tablet 2ba4b779b29841f69fe72527763ab7a1) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.577697 3415 raft_consensus.cc:1270] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.577786 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 5a789dbdecae4df287752bc6bac1f84e (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.577862 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a789dbdecae4df287752bc6bac1f84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.578059 3279 raft_consensus.cc:1270] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.578627 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cf94364ef34cfab28e355f42229305. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.578727 3665 consensus_queue.cc:1035] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.579005 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 777cc4bb380a4b53942b2c978325146e (DEFAULT_TABLE table=default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.579087 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777cc4bb380a4b53942b2c978325146e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.579237 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.579878 3665 consensus_queue.cc:1035] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.580757 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_43716352b9c4495ba22250ef039e268d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.580878 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43716352b9c4495ba22250ef039e268d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.580957 3917 tablet.cc:1721] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.582345 3907 tablet_replica.cc:331] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.582425 3907 raft_consensus.cc:2238] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.582520 3907 pending_rounds.cc:62] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:11:52.582541 3907 pending_rounds.cc:69] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489496313143296 op_type: NO_OP noop_request { }
I20250115 10:11:52.582589 3907 raft_consensus.cc:2883] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.582633 3907 raft_consensus.cc:2267] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.582847 3907 ts_tablet_manager.cc:1905] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.582998 3326 heartbeater.cc:501] Master 127.2.217.188:38283 was elected leader, sending a full tablet report...
I20250115 10:11:52.583787 3909 tablet_replica.cc:331] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.583863 3909 raft_consensus.cc:2238] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.583950 3909 raft_consensus.cc:2267] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.584053 3914 tablet_replica.cc:331] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.584102 3914 raft_consensus.cc:2238] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.584187 3914 raft_consensus.cc:2267] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.584163 3921 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.584417 3907 ts_tablet_manager.cc:1918] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.584434 3914 ts_tablet_manager.cc:1905] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.584465 3907 log.cc:1198] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/856454f4db4d471d81af2ea784215030
I20250115 10:11:52.584695 3907 ts_tablet_manager.cc:1939] T 856454f4db4d471d81af2ea784215030 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.584957 3907 tablet_replica.cc:331] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.585011 3907 raft_consensus.cc:2238] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.585042 3907 raft_consensus.cc:2267] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.585034 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 856454f4db4d471d81af2ea784215030 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:52.585250 3907 ts_tablet_manager.cc:1905] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.585814 3921 tablet.cc:1721] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.585882 3914 ts_tablet_manager.cc:1918] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.585927 3914 log.cc:1198] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/7860f89c26334571a26351e2fd20c042
I20250115 10:11:52.586140 3914 ts_tablet_manager.cc:1939] T 7860f89c26334571a26351e2fd20c042 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.586331 3915 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.586752 3915 tablet_bootstrap.cc:654] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.586894 3907 ts_tablet_manager.cc:1918] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.586953 3907 log.cc:1198] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/7860f89c26334571a26351e2fd20c042
I20250115 10:11:52.587131 3908 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.587159 3907 ts_tablet_manager.cc:1939] T 7860f89c26334571a26351e2fd20c042 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.587381 3907 tablet_replica.cc:331] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.587443 3907 raft_consensus.cc:2238] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.587616 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 7860f89c26334571a26351e2fd20c042 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:52.588500 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 86d086cd94664d40a653d64d06438bda (DEFAULT_TABLE table=default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.588547 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbfcedc2f5447a1acb095066d131d52 (DEFAULT_TABLE table=default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.588595 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d086cd94664d40a653d64d06438bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.588642 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbfcedc2f5447a1acb095066d131d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.589457 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 86d086cd94664d40a653d64d06438bda (DEFAULT_TABLE table=default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.589542 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d086cd94664d40a653d64d06438bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.589814 3253 tablet_service.cc:1467] Processing CreateTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.589922 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd018dc2d7f644339b5feba799d3bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.590704 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbfcedc2f5447a1acb095066d131d52 (DEFAULT_TABLE table=default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.587494 3907 raft_consensus.cc:2267] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.590790 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbfcedc2f5447a1acb095066d131d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.590891 3915 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.590938 3915 ts_tablet_manager.cc:1397] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:11:52.590952 3907 ts_tablet_manager.cc:1905] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.591085 3915 raft_consensus.cc:357] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.591157 3915 raft_consensus.cc:383] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.591181 3915 raft_consensus.cc:738] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.590592 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 86d086cd94664d40a653d64d06438bda (DEFAULT_TABLE table=default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.591342 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d086cd94664d40a653d64d06438bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.591491 3914 tablet_replica.cc:331] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.591540 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 7860f89c26334571a26351e2fd20c042 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:52.591562 3914 raft_consensus.cc:2238] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.591624 3914 pending_rounds.cc:62] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:11:52.591688 3914 pending_rounds.cc:69] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489496350289920 op_type: NO_OP noop_request { }
I20250115 10:11:52.591789 3914 raft_consensus.cc:2883] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.591827 3522 tablet_service.cc:1467] Processing CreateTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.591846 3914 raft_consensus.cc:2267] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.591915 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd018dc2d7f644339b5feba799d3bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.592097 3914 ts_tablet_manager.cc:1905] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.590618 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 8cbfcedc2f5447a1acb095066d131d52 (DEFAULT_TABLE table=default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.590641 3392 tablet_service.cc:1467] Processing CreateTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.592554 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd018dc2d7f644339b5feba799d3bdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.592558 3907 ts_tablet_manager.cc:1918] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.592622 3907 log.cc:1198] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/670935dae51e4585920666a958c556ec
I20250115 10:11:52.592660 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cbfcedc2f5447a1acb095066d131d52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.592801 3907 ts_tablet_manager.cc:1939] T 670935dae51e4585920666a958c556ec P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.593071 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 670935dae51e4585920666a958c556ec (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:52.593159 3907 tablet_replica.cc:331] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.593205 3907 raft_consensus.cc:2238] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.593230 3907 raft_consensus.cc:2267] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.593313 3907 ts_tablet_manager.cc:1905] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.594064 3914 ts_tablet_manager.cc:1918] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.594168 3914 log.cc:1198] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6c311eccc93b4388b7ea59531803a244
I20250115 10:11:52.594569 3914 ts_tablet_manager.cc:1939] T 6c311eccc93b4388b7ea59531803a244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.594713 3907 ts_tablet_manager.cc:1918] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.594764 3907 log.cc:1198] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6c311eccc93b4388b7ea59531803a244
I20250115 10:11:52.587549 3908 tablet_bootstrap.cc:654] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.594975 3914 tablet_replica.cc:331] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.595072 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6c311eccc93b4388b7ea59531803a244 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:52.595058 3914 raft_consensus.cc:2238] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.595144 3907 ts_tablet_manager.cc:1939] T 6c311eccc93b4388b7ea59531803a244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.595175 3914 raft_consensus.cc:2267] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.595274 3915 consensus_queue.cc:260] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.595374 3907 tablet_replica.cc:331] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.595398 3915 ts_tablet_manager.cc:1428] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:11:52.595507 3915 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.595744 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6c311eccc93b4388b7ea59531803a244 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:52.595454 3907 raft_consensus.cc:2238] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.595858 3907 raft_consensus.cc:2267] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.595988 3915 tablet_bootstrap.cc:654] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:52.596972 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4839f8e0539d468ea11077d48f8f8266 consensus state has no leader
I20250115 10:11:52.597412 3919 tablet.cc:1721] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.597270 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 97c0f8da38d84482b284a628714e67d0 (DEFAULT_TABLE table=default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.597354 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba4b779b29841f69fe72527763ab7a1 (DEFAULT_TABLE table=default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.597682 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c0f8da38d84482b284a628714e67d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.597761 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba4b779b29841f69fe72527763ab7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.597937 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 (DEFAULT_TABLE table=default.Table_df4a7240aebb4948b8f1f69966f5bd87 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.598049 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863d2fe8ea6648beb42458fc501cccb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.598671 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba4b779b29841f69fe72527763ab7a1 (DEFAULT_TABLE table=default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.598763 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba4b779b29841f69fe72527763ab7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.598798 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 97c0f8da38d84482b284a628714e67d0 (DEFAULT_TABLE table=default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.598891 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c0f8da38d84482b284a628714e67d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.599851 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 (DEFAULT_TABLE table=default.Table_df4a7240aebb4948b8f1f69966f5bd87 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.599936 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863d2fe8ea6648beb42458fc501cccb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.600129 3908 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.600189 3908 ts_tablet_manager.cc:1397] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:11:52.600203 3915 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.600241 3915 ts_tablet_manager.cc:1397] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:11:52.600354 3908 raft_consensus.cc:357] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.600385 3915 raft_consensus.cc:357] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.600420 3908 raft_consensus.cc:383] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.600446 3915 raft_consensus.cc:383] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.600446 3908 raft_consensus.cc:738] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.600469 3915 raft_consensus.cc:738] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.600499 3908 consensus_queue.cc:260] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.600550 3915 consensus_queue.cc:260] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.600597 3908 ts_tablet_manager.cc:1428] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:52.600677 3908 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.600966 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 2ba4b779b29841f69fe72527763ab7a1 (DEFAULT_TABLE table=default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.601023 3909 ts_tablet_manager.cc:1905] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.601047 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba4b779b29841f69fe72527763ab7a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.601109 3908 tablet_bootstrap.cc:654] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.601253 3915 ts_tablet_manager.cc:1428] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.601346 3915 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.601701 3925 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.601666 3098 catalog_manager.cc:5526] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.601794 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.601998 3915 tablet_bootstrap.cc:654] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.602145 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 97c0f8da38d84482b284a628714e67d0 (DEFAULT_TABLE table=default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.602226 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c0f8da38d84482b284a628714e67d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.602520 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4f559e7cafb04ae39af12e7681bbaf24 (DEFAULT_TABLE table=default.Table_b5eda0ed1b124fdabbb33656f6b3eece [id=cfbe9a43f4cb404c90f893f1fc3c40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.602573 3388 tablet_service.cc:1467] Processing CreateTablet for tablet e3a4b1b801c84cbcae634a965be09734 (DEFAULT_TABLE table=default.Table_32ddd52e4b2c40e3aeae38afe9c03eff [id=dc0b1482ff3849cebb7afb525dc04264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.602672 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 (DEFAULT_TABLE table=default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.603086 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 4f559e7cafb04ae39af12e7681bbaf24 (DEFAULT_TABLE table=default.Table_b5eda0ed1b124fdabbb33656f6b3eece [id=cfbe9a43f4cb404c90f893f1fc3c40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.603137 3256 tablet_service.cc:1467] Processing CreateTablet for tablet e3a4b1b801c84cbcae634a965be09734 (DEFAULT_TABLE table=default.Table_32ddd52e4b2c40e3aeae38afe9c03eff [id=dc0b1482ff3849cebb7afb525dc04264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.603174 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f559e7cafb04ae39af12e7681bbaf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.603237 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4b1b801c84cbcae634a965be09734. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.604204 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 (DEFAULT_TABLE table=default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.604329 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f6f7a7dde84fe2917afb423d0306e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.602607 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f559e7cafb04ae39af12e7681bbaf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.605226 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f6f7a7dde84fe2917afb423d0306e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.605880 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 (DEFAULT_TABLE table=default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.605986 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f6f7a7dde84fe2917afb423d0306e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.606117 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4b1b801c84cbcae634a965be09734. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.607486 3908 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.607539 3908 ts_tablet_manager.cc:1397] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:11:52.607549 3253 tablet_service.cc:1467] Processing CreateTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (DEFAULT_TABLE table=default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.607636 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.607689 3908 raft_consensus.cc:357] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.607769 3908 raft_consensus.cc:383] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.607790 3908 raft_consensus.cc:738] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.607846 3908 consensus_queue.cc:260] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.607929 3908 ts_tablet_manager.cc:1428] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.607995 3908 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.608125 3392 tablet_service.cc:1467] Processing CreateTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (DEFAULT_TABLE table=default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.608214 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.608563 3908 tablet_bootstrap.cc:654] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.609431 3253 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c311eccc93b4388b7ea59531803a244 with delete_type TABLET_DATA_DELETED (replaced by tablet 8cbfcedc2f5447a1acb095066d131d52) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.609757 3908 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.609844 3908 ts_tablet_manager.cc:1397] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.610098 3528 tablet_service.cc:1467] Processing CreateTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (DEFAULT_TABLE table=default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.609984 3908 raft_consensus.cc:357] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.610286 3908 raft_consensus.cc:383] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.610473 3908 raft_consensus.cc:738] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.610512 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.610556 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 4f559e7cafb04ae39af12e7681bbaf24 (DEFAULT_TABLE table=default.Table_b5eda0ed1b124fdabbb33656f6b3eece [id=cfbe9a43f4cb404c90f893f1fc3c40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.610648 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f559e7cafb04ae39af12e7681bbaf24. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.610661 3908 consensus_queue.cc:260] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.611011 3908 ts_tablet_manager.cc:1428] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.611088 3908 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.611675 3908 tablet_bootstrap.cc:654] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.611948 3909 ts_tablet_manager.cc:1918] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.612011 3909 log.cc:1198] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f9c3726d8be14adeacea32fb82bf5913
I20250115 10:11:52.612067 3522 tablet_service.cc:1467] Processing CreateTablet for tablet e3a4b1b801c84cbcae634a965be09734 (DEFAULT_TABLE table=default.Table_32ddd52e4b2c40e3aeae38afe9c03eff [id=dc0b1482ff3849cebb7afb525dc04264]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.612157 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a4b1b801c84cbcae634a965be09734. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.612255 3909 ts_tablet_manager.cc:1939] T f9c3726d8be14adeacea32fb82bf5913 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.612571 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f9c3726d8be14adeacea32fb82bf5913 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]) successfully deleted
I20250115 10:11:52.612654 3908 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.612761 3908 ts_tablet_manager.cc:1397] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.612783 3914 ts_tablet_manager.cc:1905] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.612968 3908 raft_consensus.cc:357] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.613094 3908 raft_consensus.cc:383] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.613179 3908 raft_consensus.cc:738] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.613240 3908 consensus_queue.cc:260] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.613354 3909 tablet_replica.cc:331] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.613459 3909 raft_consensus.cc:2238] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.613524 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet 7860f89c26334571a26351e2fd20c042 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.613538 3908 ts_tablet_manager.cc:1428] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.613552 3909 raft_consensus.cc:2267] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.597256 3923 tablet.cc:1721] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.597316 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 (DEFAULT_TABLE table=default.Table_df4a7240aebb4948b8f1f69966f5bd87 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.613730 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 863d2fe8ea6648beb42458fc501cccb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.613936 3909 ts_tablet_manager.cc:1905] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.613615 3908 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.615432 3923 tablet.cc:1721] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.616063 3908 tablet_bootstrap.cc:654] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.597559 3922 tablet.cc:1721] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.617843 3909 ts_tablet_manager.cc:1918] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.617911 3909 log.cc:1198] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/95a236fda8124147a057be51ecfff945
I20250115 10:11:52.617005 3914 ts_tablet_manager.cc:1918] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250115 10:11:52.618675 3914 log.cc:1198] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/db1eb078c2d74b0c8ebff56863717195
I20250115 10:11:52.618839 3907 ts_tablet_manager.cc:1905] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.618913 3919 tablet.cc:1721] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.618997 3914 ts_tablet_manager.cc:1939] T db1eb078c2d74b0c8ebff56863717195 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.619256 3914 tablet_replica.cc:331] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.619315 3914 raft_consensus.cc:2238] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.619323 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:52.619374 3914 raft_consensus.cc:2267] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.619455 3909 ts_tablet_manager.cc:1939] T 95a236fda8124147a057be51ecfff945 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.619681 3909 tablet_replica.cc:331] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.619768 3909 raft_consensus.cc:2238] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.620210 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]) successfully deleted
I20250115 10:11:52.620347 3909 raft_consensus.cc:2267] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.620658 3909 ts_tablet_manager.cc:1905] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.621004 3910 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.621212 3907 ts_tablet_manager.cc:1918] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.621277 3907 log.cc:1198] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/9af13c18749940828dbe55ef2cdbf31c
I20250115 10:11:52.621460 3910 tablet_bootstrap.cc:654] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.621493 3907 ts_tablet_manager.cc:1939] T 9af13c18749940828dbe55ef2cdbf31c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.621724 3907 tablet_replica.cc:331] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.621783 3907 raft_consensus.cc:2238] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.621795 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:52.621827 3907 raft_consensus.cc:2267] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.622047 3914 ts_tablet_manager.cc:1905] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.622130 3915 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.622212 3915 ts_tablet_manager.cc:1397] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:11:52.622233 3907 ts_tablet_manager.cc:1905] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.622385 3915 raft_consensus.cc:357] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.622445 3915 raft_consensus.cc:383] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.622464 3915 raft_consensus.cc:738] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.622504 3915 consensus_queue.cc:260] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.622596 3915 ts_tablet_manager.cc:1428] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.622646 3915 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.623138 3915 tablet_bootstrap.cc:654] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.623522 3907 ts_tablet_manager.cc:1918] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.623574 3907 log.cc:1198] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/bac5460ff8d848369760e64efeb62dfc
I20250115 10:11:52.623816 3907 ts_tablet_manager.cc:1939] T bac5460ff8d848369760e64efeb62dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.624184 3907 tablet_replica.cc:331] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.624258 3907 raft_consensus.cc:2238] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.624297 3907 raft_consensus.cc:2267] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:11:52.624279 3086 catalog_manager.cc:4945] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): alter failed for tablet 856454f4db4d471d81af2ea784215030 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]),no further retry: Not found: Tablet not found: 856454f4db4d471d81af2ea784215030
I20250115 10:11:52.624364 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:52.624399 3908 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.624436 3908 ts_tablet_manager.cc:1397] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:11:52.624594 3908 raft_consensus.cc:357] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.624672 3908 raft_consensus.cc:383] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.624701 3908 raft_consensus.cc:738] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.624751 3908 consensus_queue.cc:260] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.624783 3909 ts_tablet_manager.cc:1918] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250115 10:11:52.624835 3909 log.cc:1198] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/db1eb078c2d74b0c8ebff56863717195
I20250115 10:11:52.624869 3908 ts_tablet_manager.cc:1428] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.624936 3908 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.625097 3909 ts_tablet_manager.cc:1939] T db1eb078c2d74b0c8ebff56863717195 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.625267 3914 ts_tablet_manager.cc:1918] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.625314 3914 log.cc:1198] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/670935dae51e4585920666a958c556ec
I20250115 10:11:52.625344 3908 tablet_bootstrap.cc:654] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.625365 3909 tablet_replica.cc:331] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.625418 3909 raft_consensus.cc:2238] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.625440 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:52.625492 3909 raft_consensus.cc:2267] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.625619 3914 ts_tablet_manager.cc:1939] T 670935dae51e4585920666a958c556ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.625803 3909 ts_tablet_manager.cc:1905] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.625839 3907 ts_tablet_manager.cc:1905] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.625891 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 670935dae51e4585920666a958c556ec (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:52.625965 3914 tablet_replica.cc:331] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.626009 3914 raft_consensus.cc:2238] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.626039 3914 raft_consensus.cc:2267] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.626183 3914 ts_tablet_manager.cc:1905] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.626996 3909 ts_tablet_manager.cc:1918] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.627003 3907 ts_tablet_manager.cc:1918] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250115 10:11:52.627059 3907 log.cc:1198] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/db1eb078c2d74b0c8ebff56863717195
I20250115 10:11:52.627061 3909 log.cc:1198] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/bac5460ff8d848369760e64efeb62dfc
I20250115 10:11:52.627269 3907 ts_tablet_manager.cc:1939] T db1eb078c2d74b0c8ebff56863717195 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.627324 3909 ts_tablet_manager.cc:1939] T bac5460ff8d848369760e64efeb62dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.627540 3907 tablet_replica.cc:331] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.627599 3907 raft_consensus.cc:2238] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.627652 3907 raft_consensus.cc:2267] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.627843 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet db1eb078c2d74b0c8ebff56863717195 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:52.627871 3914 ts_tablet_manager.cc:1918] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.627929 3914 log.cc:1198] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/856454f4db4d471d81af2ea784215030
I20250115 10:11:52.628000 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
W20250115 10:11:52.628077 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 86d086cd94664d40a653d64d06438bda consensus state has no leader
I20250115 10:11:52.628121 3914 ts_tablet_manager.cc:1939] T 856454f4db4d471d81af2ea784215030 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.628371 3907 ts_tablet_manager.cc:1905] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.628465 3915 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.628504 3908 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.628482 3914 tablet_replica.cc:331] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.628543 3908 ts_tablet_manager.cc:1397] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:52.628569 3914 raft_consensus.cc:2238] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.628628 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 856454f4db4d471d81af2ea784215030 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:52.628628 3914 raft_consensus.cc:2267] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.628710 3908 raft_consensus.cc:357] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.628777 3908 raft_consensus.cc:383] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.628506 3915 ts_tablet_manager.cc:1397] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:52.628803 3908 raft_consensus.cc:738] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.628858 3908 consensus_queue.cc:260] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.628924 3915 raft_consensus.cc:357] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.628985 3908 ts_tablet_manager.cc:1428] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.628962 3914 ts_tablet_manager.cc:1905] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.628999 3915 raft_consensus.cc:383] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.629025 3915 raft_consensus.cc:738] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.629060 3908 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.629065 3915 consensus_queue.cc:260] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.629168 3915 ts_tablet_manager.cc:1428] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.629235 3915 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.629458 3908 tablet_bootstrap.cc:654] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.629608 3907 ts_tablet_manager.cc:1918] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.629642 3915 tablet_bootstrap.cc:654] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.629655 3907 log.cc:1198] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/95a236fda8124147a057be51ecfff945
I20250115 10:11:52.629856 3907 ts_tablet_manager.cc:1939] T 95a236fda8124147a057be51ecfff945 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.630081 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
W20250115 10:11:52.630152 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8cbfcedc2f5447a1acb095066d131d52 consensus state has no leader
I20250115 10:11:52.630146 3907 tablet_replica.cc:331] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.630275 3907 raft_consensus.cc:2238] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.630318 3907 raft_consensus.cc:2267] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.630543 3907 ts_tablet_manager.cc:1905] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.630734 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]) successfully deleted
I20250115 10:11:52.630890 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
I20250115 10:11:52.631392 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
I20250115 10:11:52.631665 3915 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.631719 3915 ts_tablet_manager.cc:1397] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.631940 3915 raft_consensus.cc:357] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.631994 3915 raft_consensus.cc:383] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.632014 3915 raft_consensus.cc:738] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.632030 3907 ts_tablet_manager.cc:1918] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.632046 3915 consensus_queue.cc:260] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.632088 3907 log.cc:1198] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f9c3726d8be14adeacea32fb82bf5913
I20250115 10:11:52.632134 3915 ts_tablet_manager.cc:1428] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.632210 3915 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.632431 3907 ts_tablet_manager.cc:1939] T f9c3726d8be14adeacea32fb82bf5913 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.632498 3914 ts_tablet_manager.cc:1918] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.632588 3915 tablet_bootstrap.cc:654] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.632565 3914 log.cc:1198] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/9af13c18749940828dbe55ef2cdbf31c
I20250115 10:11:52.632701 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f9c3726d8be14adeacea32fb82bf5913 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]) successfully deleted
I20250115 10:11:52.632958 3914 ts_tablet_manager.cc:1939] T 9af13c18749940828dbe55ef2cdbf31c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.633116 3909 tablet_replica.cc:331] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.633183 3909 raft_consensus.cc:2238] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.633237 3909 raft_consensus.cc:2267] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.633262 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:52.633263 3914 tablet_replica.cc:331] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.633328 3914 raft_consensus.cc:2238] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.633391 3914 raft_consensus.cc:2267] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.633442 3909 ts_tablet_manager.cc:1905] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.633457 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.633941 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:52.634310 3914 ts_tablet_manager.cc:1905] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.634653 3909 ts_tablet_manager.cc:1918] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.634720 3909 log.cc:1198] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/9af13c18749940828dbe55ef2cdbf31c
I20250115 10:11:52.634950 3909 ts_tablet_manager.cc:1939] T 9af13c18749940828dbe55ef2cdbf31c P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.635205 3909 tablet_replica.cc:331] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.635265 3909 raft_consensus.cc:2238] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.635316 3909 raft_consensus.cc:2267] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.635303 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 9af13c18749940828dbe55ef2cdbf31c (table default.Table_aad777aa179d4b2ba8bab5f224853a4c [id=7a251be119d54dd296cfc25f94278dd9]) successfully deleted
I20250115 10:11:52.635426 3909 ts_tablet_manager.cc:1905] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.635519 3914 ts_tablet_manager.cc:1918] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.635566 3914 log.cc:1198] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/bac5460ff8d848369760e64efeb62dfc
I20250115 10:11:52.635782 3914 ts_tablet_manager.cc:1939] T bac5460ff8d848369760e64efeb62dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.636029 3915 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.636072 3915 ts_tablet_manager.cc:1397] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:11:52.636073 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet bac5460ff8d848369760e64efeb62dfc (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82]) successfully deleted
I20250115 10:11:52.636199 3915 raft_consensus.cc:357] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.636279 3915 raft_consensus.cc:383] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.636307 3915 raft_consensus.cc:738] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.636343 3915 consensus_queue.cc:260] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.636446 3915 ts_tablet_manager.cc:1428] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.636523 3915 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.636622 3909 ts_tablet_manager.cc:1918] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.636684 3909 log.cc:1198] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6c311eccc93b4388b7ea59531803a244
I20250115 10:11:52.636853 3909 ts_tablet_manager.cc:1939] T 6c311eccc93b4388b7ea59531803a244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.636898 3915 tablet_bootstrap.cc:654] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.637236 3910 tablet_bootstrap.cc:492] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.637290 3910 ts_tablet_manager.cc:1397] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250115 10:11:52.637396 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6c311eccc93b4388b7ea59531803a244 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:52.636200 3914 tablet_replica.cc:331] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.637447 3910 raft_consensus.cc:357] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.637547 3910 raft_consensus.cc:383] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.637591 3910 raft_consensus.cc:738] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.637717 3910 consensus_queue.cc:260] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.637969 3909 tablet_replica.cc:331] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.638028 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
W20250115 10:11:52.638101 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet fd018dc2d7f644339b5feba799d3bdd7 consensus state has no leader
I20250115 10:11:52.638208 3909 raft_consensus.cc:2238] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.638342 3909 raft_consensus.cc:2267] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.638588 3914 raft_consensus.cc:2238] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.638741 3914 raft_consensus.cc:2267] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.638836 3909 ts_tablet_manager.cc:1905] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.638971 3910 ts_tablet_manager.cc:1428] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.639143 3914 ts_tablet_manager.cc:1905] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.639209 3908 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.639267 3908 ts_tablet_manager.cc:1397] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:11:52.639420 3908 raft_consensus.cc:357] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.639487 3908 raft_consensus.cc:383] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.639511 3908 raft_consensus.cc:738] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.639557 3908 consensus_queue.cc:260] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.639637 3908 ts_tablet_manager.cc:1428] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.639636 3910 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.640010 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.640138 3909 ts_tablet_manager.cc:1918] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.640182 3909 log.cc:1198] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/670935dae51e4585920666a958c556ec
I20250115 10:11:52.640342 3914 ts_tablet_manager.cc:1918] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.640375 3909 ts_tablet_manager.cc:1939] T 670935dae51e4585920666a958c556ec P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.640393 3914 log.cc:1198] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/95a236fda8124147a057be51ecfff945
I20250115 10:11:52.640635 3914 ts_tablet_manager.cc:1939] T 95a236fda8124147a057be51ecfff945 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.639703 3908 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.640892 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 670935dae51e4585920666a958c556ec (table default.Table_297e114594f943baa50770c53a3887c8 [id=d3c5c1e97a3a494685db9f4761be9018]) successfully deleted
I20250115 10:11:52.640937 3914 tablet_replica.cc:331] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.640976 3909 tablet_replica.cc:331] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.640988 3914 raft_consensus.cc:2238] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.641024 3909 raft_consensus.cc:2238] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.641028 3914 raft_consensus.cc:2267] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.641041 3910 tablet_bootstrap.cc:654] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.641060 3909 raft_consensus.cc:2267] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.641232 3908 tablet_bootstrap.cc:654] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.641260 3914 ts_tablet_manager.cc:1905] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.641600 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 95a236fda8124147a057be51ecfff945 (table default.Table_b32dafab78104aeeb20db4f39dd3a820 [id=9834d1159d3b4d08a8823fefe3b92479]) successfully deleted
I20250115 10:11:52.641664 3910 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.641716 3910 ts_tablet_manager.cc:1397] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.641881 3910 raft_consensus.cc:357] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.641924 3909 ts_tablet_manager.cc:1905] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.642068 3671 consensus_queue.cc:1035] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.642108 3915 tablet_bootstrap.cc:492] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.642149 3915 ts_tablet_manager.cc:1397] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:11:52.642302 3908 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.642303 3915 raft_consensus.cc:357] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.642340 3908 ts_tablet_manager.cc:1397] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:52.642364 3915 raft_consensus.cc:383] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.642386 3915 raft_consensus.cc:738] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.642432 3915 consensus_queue.cc:260] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.642527 3915 ts_tablet_manager.cc:1428] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.642611 3908 raft_consensus.cc:357] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.642673 3908 raft_consensus.cc:383] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.642697 3908 raft_consensus.cc:738] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.642757 3908 consensus_queue.cc:260] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.642868 3908 ts_tablet_manager.cc:1428] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.642940 3908 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.643262 3909 ts_tablet_manager.cc:1918] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.643262 3914 ts_tablet_manager.cc:1918] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.643316 3914 log.cc:1198] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f9c3726d8be14adeacea32fb82bf5913
I20250115 10:11:52.643316 3909 log.cc:1198] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/7860f89c26334571a26351e2fd20c042
I20250115 10:11:52.643363 3908 tablet_bootstrap.cc:654] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.643535 3914 ts_tablet_manager.cc:1939] T f9c3726d8be14adeacea32fb82bf5913 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.643535 3909 ts_tablet_manager.cc:1939] T 7860f89c26334571a26351e2fd20c042 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.643611 3915 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.644120 3915 tablet_bootstrap.cc:654] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.644336 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.644659 3909 tablet_replica.cc:331] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.644712 3909 raft_consensus.cc:2238] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.644745 3909 raft_consensus.cc:2267] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.644840 3909 ts_tablet_manager.cc:1905] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.644871 3915 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.644912 3915 ts_tablet_manager.cc:1397] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.645124 3915 raft_consensus.cc:357] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.645186 3915 raft_consensus.cc:383] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.645177 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 7860f89c26334571a26351e2fd20c042 (table default.Table_38f2486d33724fdfbbb0636e959c98cf [id=a3f102293d964aafad48498f12c9bb15]) successfully deleted
I20250115 10:11:52.645207 3915 raft_consensus.cc:738] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.645382 3915 consensus_queue.cc:260] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.645666 3915 ts_tablet_manager.cc:1428] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.645923 3915 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.645920 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
W20250115 10:11:52.645988 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2ba4b779b29841f69fe72527763ab7a1 consensus state has no leader
I20250115 10:11:52.645998 3909 ts_tablet_manager.cc:1918] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.646047 3909 log.cc:1198] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/856454f4db4d471d81af2ea784215030
I20250115 10:11:52.646225 3909 ts_tablet_manager.cc:1939] T 856454f4db4d471d81af2ea784215030 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.646481 3910 raft_consensus.cc:383] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.646562 3910 raft_consensus.cc:738] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.646667 3910 consensus_queue.cc:260] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.646689 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 856454f4db4d471d81af2ea784215030 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:52.646831 3915 tablet_bootstrap.cc:654] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.646976 3666 raft_consensus.cc:491] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.647022 3666 raft_consensus.cc:513] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.647054 3910 ts_tablet_manager.cc:1428] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:11:52.647140 3910 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.647159 3666 leader_election.cc:290] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.647651 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:11:52.647887 3350 leader_election.cc:343] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:11:52.647900 3910 tablet_bootstrap.cc:654] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.648698 3910 tablet_bootstrap.cc:492] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.648744 3910 ts_tablet_manager.cc:1397] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.648766 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.648900 3910 raft_consensus.cc:357] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.648958 3910 raft_consensus.cc:383] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.648989 3910 raft_consensus.cc:738] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.648986 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f9c3726d8be14adeacea32fb82bf5913 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]) successfully deleted
W20250115 10:11:52.649058 3087 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 6c311eccc93b4388b7ea59531803a244 because the tablet was not found. No further retry: Not found: Tablet not found: 6c311eccc93b4388b7ea59531803a244
I20250115 10:11:52.649044 3910 consensus_queue.cc:260] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:11:52.649107 3087 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 7860f89c26334571a26351e2fd20c042 because the tablet was not found. No further retry: Not found: Tablet not found: 7860f89c26334571a26351e2fd20c042
I20250115 10:11:52.649124 3910 ts_tablet_manager.cc:1428] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.649178 3910 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.649528 3910 tablet_bootstrap.cc:654] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:52.649822 3350 leader_election.cc:343] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:11:52.649868 3350 leader_election.cc:304] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:52.650045 3666 raft_consensus.cc:2743] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:52.650548 3910 tablet_bootstrap.cc:492] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.650609 3910 ts_tablet_manager.cc:1397] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.650748 3910 raft_consensus.cc:357] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.650801 3910 raft_consensus.cc:383] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.650831 3910 raft_consensus.cc:738] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.650868 3910 consensus_queue.cc:260] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.650988 3910 ts_tablet_manager.cc:1428] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.651046 3910 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.651398 3908 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.651438 3908 ts_tablet_manager.cc:1397] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:11:52.651436 3910 tablet_bootstrap.cc:654] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.651575 3908 raft_consensus.cc:357] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.651618 3908 raft_consensus.cc:383] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.651634 3908 raft_consensus.cc:738] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.651667 3908 consensus_queue.cc:260] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.651938 3908 ts_tablet_manager.cc:1428] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.652285 3908 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.652544 3414 raft_consensus.cc:1270] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.652729 3908 tablet_bootstrap.cc:654] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.653337 3908 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.653385 3908 ts_tablet_manager.cc:1397] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.653527 3908 raft_consensus.cc:357] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.653575 3908 raft_consensus.cc:383] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.653594 3908 raft_consensus.cc:738] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.653636 3908 consensus_queue.cc:260] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.653739 3908 ts_tablet_manager.cc:1428] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.653793 3908 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.654239 3908 tablet_bootstrap.cc:654] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.654496 3770 consensus_queue.cc:1035] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.655956 3100 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.656168 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.657543 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.657749 3919 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.659394 3917 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.660213 3665 raft_consensus.cc:491] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.660279 3665 raft_consensus.cc:513] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.660404 3665 leader_election.cc:290] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.660586 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777cc4bb380a4b53942b2c978325146e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.660650 3415 raft_consensus.cc:2463] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.660614 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777cc4bb380a4b53942b2c978325146e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.660688 3280 raft_consensus.cc:2463] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.660831 3485 leader_election.cc:304] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.660918 3665 raft_consensus.cc:2798] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.660943 3665 raft_consensus.cc:491] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.660961 3665 raft_consensus.cc:3054] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.661624 3665 raft_consensus.cc:513] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.661720 3922 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.661751 3665 leader_election.cc:290] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.662006 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777cc4bb380a4b53942b2c978325146e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.662075 3280 raft_consensus.cc:3054] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.662186 3100 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447]). Expected version 1 got 0
I20250115 10:11:52.662250 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_d5311d6b627d473a9b80c77f756569f1 [id=284816018979468d99f5a23274d90447] alter complete (version 1)
I20250115 10:11:52.662801 3280 raft_consensus.cc:2463] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.662987 3485 leader_election.cc:304] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.662979 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "777cc4bb380a4b53942b2c978325146e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.663048 3414 raft_consensus.cc:3054] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.663147 3665 raft_consensus.cc:2798] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.663203 3665 raft_consensus.cc:695] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.663250 3665 consensus_queue.cc:237] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.663837 3414 raft_consensus.cc:2463] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.664157 3100 catalog_manager.cc:5526] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.667404 3915 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.667460 3915 ts_tablet_manager.cc:1397] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20250115 10:11:52.667675 3910 tablet_bootstrap.cc:492] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.667651 3915 raft_consensus.cc:357] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.667739 3915 raft_consensus.cc:383] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.667740 3910 ts_tablet_manager.cc:1397] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250115 10:11:52.667768 3915 raft_consensus.cc:738] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.667814 3915 consensus_queue.cc:260] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.667886 3910 raft_consensus.cc:357] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.667949 3910 raft_consensus.cc:383] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.667944 3915 ts_tablet_manager.cc:1428] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.667969 3910 raft_consensus.cc:738] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.668008 3910 consensus_queue.cc:260] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.668030 3915 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.668100 3910 ts_tablet_manager.cc:1428] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.668169 3910 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.668536 3915 tablet_bootstrap.cc:654] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.668579 3910 tablet_bootstrap.cc:654] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.669381 3915 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.669435 3915 ts_tablet_manager.cc:1397] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.669574 3915 raft_consensus.cc:357] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.669634 3915 raft_consensus.cc:383] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.669652 3915 raft_consensus.cc:738] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.669694 3915 consensus_queue.cc:260] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.669777 3915 ts_tablet_manager.cc:1428] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.669831 3915 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.670186 3097 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.670552 3915 tablet_bootstrap.cc:654] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.671025 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.671157 3910 tablet_bootstrap.cc:492] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.671196 3910 ts_tablet_manager.cc:1397] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:52.671335 3910 raft_consensus.cc:357] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.671401 3910 raft_consensus.cc:383] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.671423 3910 raft_consensus.cc:738] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.671461 3910 consensus_queue.cc:260] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.671530 3910 ts_tablet_manager.cc:1428] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.671574 3910 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.671937 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
I20250115 10:11:52.672217 3910 tablet_bootstrap.cc:654] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.672820 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
I20250115 10:11:52.672919 3915 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.672968 3915 ts_tablet_manager.cc:1397] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:52.673187 3915 raft_consensus.cc:357] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.673243 3915 raft_consensus.cc:383] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.673266 3915 raft_consensus.cc:738] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.673313 3910 tablet_bootstrap.cc:492] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.673305 3915 consensus_queue.cc:260] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.673354 3910 ts_tablet_manager.cc:1397] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.673389 3915 ts_tablet_manager.cc:1428] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.673457 3915 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.673487 3910 raft_consensus.cc:357] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.673538 3910 raft_consensus.cc:383] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.673559 3910 raft_consensus.cc:738] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.673583 3908 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.673605 3910 consensus_queue.cc:260] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.673629 3908 ts_tablet_manager.cc:1397] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20250115 10:11:52.673695 3910 ts_tablet_manager.cc:1428] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.673753 3910 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.673784 3908 raft_consensus.cc:357] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.673846 3908 raft_consensus.cc:383] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.673869 3915 tablet_bootstrap.cc:654] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.673877 3908 raft_consensus.cc:738] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.673918 3908 consensus_queue.cc:260] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.674017 3908 ts_tablet_manager.cc:1428] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:52.674088 3908 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.674311 3910 tablet_bootstrap.cc:654] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.674543 3908 tablet_bootstrap.cc:654] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.674960 3671 raft_consensus.cc:491] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.674978 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.675009 3671 raft_consensus.cc:513] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.675135 3671 leader_election.cc:290] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.675565 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d086cd94664d40a653d64d06438bda" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.675627 3550 raft_consensus.cc:2463] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.675675 3100 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.675957 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d086cd94664d40a653d64d06438bda" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.676028 3414 raft_consensus.cc:2463] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.676373 3215 leader_election.cc:304] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.676710 3671 raft_consensus.cc:2798] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.676759 3671 raft_consensus.cc:491] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.676781 3671 raft_consensus.cc:3054] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.677485 3671 raft_consensus.cc:513] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.677595 3671 leader_election.cc:290] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.677815 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d086cd94664d40a653d64d06438bda" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.677906 3550 raft_consensus.cc:3054] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.678248 3908 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.678297 3908 ts_tablet_manager.cc:1397] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:11:52.678460 3908 raft_consensus.cc:357] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.678531 3908 raft_consensus.cc:383] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.678555 3908 raft_consensus.cc:738] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.678611 3550 raft_consensus.cc:2463] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.678606 3908 consensus_queue.cc:260] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.678702 3908 ts_tablet_manager.cc:1428] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.678849 3215 leader_election.cc:304] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.678951 3952 raft_consensus.cc:2798] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.678984 3952 raft_consensus.cc:695] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.679044 3952 consensus_queue.cc:237] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.679133 3915 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.679172 3915 ts_tablet_manager.cc:1397] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:11:52.679301 3915 raft_consensus.cc:357] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.679359 3915 raft_consensus.cc:383] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.679378 3915 raft_consensus.cc:738] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.679419 3915 consensus_queue.cc:260] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.679507 3915 ts_tablet_manager.cc:1428] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.679832 3100 catalog_manager.cc:5526] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.679951 3100 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.680094 3915 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.680536 3915 tablet_bootstrap.cc:654] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.681299 3908 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.681439 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86d086cd94664d40a653d64d06438bda" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.681504 3414 raft_consensus.cc:3054] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.681725 3908 tablet_bootstrap.cc:654] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.682191 3414 raft_consensus.cc:2463] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.682842 3908 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.682894 3908 ts_tablet_manager.cc:1397] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.682982 3666 raft_consensus.cc:491] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.683032 3666 raft_consensus.cc:513] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.683043 3908 raft_consensus.cc:357] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.683117 3908 raft_consensus.cc:383] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.683153 3908 raft_consensus.cc:738] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.683188 3908 consensus_queue.cc:260] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.683122 3666 leader_election.cc:290] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.683290 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c0f8da38d84482b284a628714e67d0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.683352 3280 raft_consensus.cc:2463] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.683420 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c0f8da38d84482b284a628714e67d0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.683548 3910 tablet_bootstrap.cc:492] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.683548 3908 ts_tablet_manager.cc:1428] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.683605 3910 ts_tablet_manager.cc:1397] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:11:52.683633 3908 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.683560 3350 leader_election.cc:304] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.683861 3663 raft_consensus.cc:2798] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250115 10:11:52.683910 3350 leader_election.cc:343] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:11:52.683919 3663 raft_consensus.cc:491] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.683995 3663 raft_consensus.cc:3054] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.684276 3908 tablet_bootstrap.cc:654] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.684818 3663 raft_consensus.cc:513] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.684971 3663 leader_election.cc:290] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.685139 3910 raft_consensus.cc:357] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.685173 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c0f8da38d84482b284a628714e67d0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.685153 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97c0f8da38d84482b284a628714e67d0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.685227 3910 raft_consensus.cc:383] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.685237 3280 raft_consensus.cc:3054] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.685254 3910 raft_consensus.cc:738] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.685297 3910 consensus_queue.cc:260] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.685364 3550 raft_consensus.cc:3054] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.685420 3910 ts_tablet_manager.cc:1428] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.685509 3910 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.685791 3915 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.685837 3915 ts_tablet_manager.cc:1397] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:11:52.685916 3280 raft_consensus.cc:2463] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.685925 3910 tablet_bootstrap.cc:654] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.686008 3915 raft_consensus.cc:357] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.686064 3915 raft_consensus.cc:383] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.686081 3915 raft_consensus.cc:738] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.686120 3915 consensus_queue.cc:260] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.686112 3550 raft_consensus.cc:2463] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.686195 3915 ts_tablet_manager.cc:1428] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.686246 3915 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.686336 3350 leader_election.cc:304] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.686540 3663 raft_consensus.cc:2798] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.686609 3663 raft_consensus.cc:695] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:52.686681 3915 tablet_bootstrap.cc:654] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.686653 3663 consensus_queue.cc:237] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.687263 3910 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.687376 3910 ts_tablet_manager.cc:1397] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.687538 3100 catalog_manager.cc:5526] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.687769 3910 raft_consensus.cc:357] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.687860 3910 raft_consensus.cc:383] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.687911 3910 raft_consensus.cc:738] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.688021 3910 consensus_queue.cc:260] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.689383 3908 tablet_bootstrap.cc:492] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.689424 3908 ts_tablet_manager.cc:1397] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:11:52.689576 3908 raft_consensus.cc:357] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.689642 3908 raft_consensus.cc:383] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.689661 3908 raft_consensus.cc:738] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.689697 3908 consensus_queue.cc:260] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.689783 3908 ts_tablet_manager.cc:1428] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.689783 3910 ts_tablet_manager.cc:1428] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.689915 3910 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.691195 3915 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.691243 3915 ts_tablet_manager.cc:1397] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:11:52.691407 3915 raft_consensus.cc:357] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.691458 3915 raft_consensus.cc:383] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.691452 3910 tablet_bootstrap.cc:654] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.691481 3915 raft_consensus.cc:738] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.691576 3915 consensus_queue.cc:260] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.692118 3915 ts_tablet_manager.cc:1428] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.693081 3910 tablet_bootstrap.cc:492] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.693130 3910 ts_tablet_manager.cc:1397] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:52.693421 3910 raft_consensus.cc:357] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.693486 3910 raft_consensus.cc:383] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.693511 3910 raft_consensus.cc:738] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.693580 3910 consensus_queue.cc:260] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.693676 3910 ts_tablet_manager.cc:1428] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.693939 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.694494 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.694675 3910 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.695127 3910 tablet_bootstrap.cc:654] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.695760 3910 tablet_bootstrap.cc:492] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.695816 3910 ts_tablet_manager.cc:1397] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.695973 3910 raft_consensus.cc:357] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.696033 3910 raft_consensus.cc:383] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.696053 3910 raft_consensus.cc:738] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.696126 3910 consensus_queue.cc:260] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.696887 3910 ts_tablet_manager.cc:1428] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.697403 3910 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.697983 3910 tablet_bootstrap.cc:654] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.698597 3910 tablet_bootstrap.cc:492] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.698652 3910 ts_tablet_manager.cc:1397] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.698797 3910 raft_consensus.cc:357] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.698869 3910 raft_consensus.cc:383] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.698889 3910 raft_consensus.cc:738] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.698954 3910 consensus_queue.cc:260] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.699774 3910 ts_tablet_manager.cc:1428] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.700052 3910 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.700330 3913 raft_consensus.cc:491] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.700445 3913 raft_consensus.cc:513] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.700553 3913 leader_election.cc:290] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.700711 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a789dbdecae4df287752bc6bac1f84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.700768 3280 raft_consensus.cc:2463] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.700798 3910 tablet_bootstrap.cc:654] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.700838 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a789dbdecae4df287752bc6bac1f84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.700902 3485 leader_election.cc:304] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.700912 3414 raft_consensus.cc:2463] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.701068 3913 raft_consensus.cc:2798] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.701121 3913 raft_consensus.cc:491] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.701149 3913 raft_consensus.cc:3054] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.701447 3910 tablet_bootstrap.cc:492] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.701494 3910 ts_tablet_manager.cc:1397] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.701629 3910 raft_consensus.cc:357] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.701678 3910 raft_consensus.cc:383] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.701696 3910 raft_consensus.cc:738] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.701736 3910 consensus_queue.cc:260] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.701829 3910 ts_tablet_manager.cc:1428] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.701848 3913 raft_consensus.cc:513] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.701977 3913 leader_election.cc:290] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.701895 3910 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.702194 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a789dbdecae4df287752bc6bac1f84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.702273 3280 raft_consensus.cc:3054] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.702574 3910 tablet_bootstrap.cc:654] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.702951 3280 raft_consensus.cc:2463] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.703101 3485 leader_election.cc:304] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.703199 3913 raft_consensus.cc:2798] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.703243 3913 raft_consensus.cc:695] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.703265 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5a789dbdecae4df287752bc6bac1f84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.703285 3913 consensus_queue.cc:237] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.703310 3910 tablet_bootstrap.cc:492] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.703326 3414 raft_consensus.cc:3054] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.703352 3910 ts_tablet_manager.cc:1397] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.703493 3913 raft_consensus.cc:491] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.703528 3913 raft_consensus.cc:513] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.703609 3913 leader_election.cc:290] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.703536 3910 raft_consensus.cc:357] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.703722 3910 raft_consensus.cc:383] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.703778 3910 raft_consensus.cc:738] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.703809 3910 consensus_queue.cc:260] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.703847 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f6f7a7dde84fe2917afb423d0306e5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.703917 3910 ts_tablet_manager.cc:1428] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.703929 3415 raft_consensus.cc:2463] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.704087 3484 leader_election.cc:304] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.704118 3414 raft_consensus.cc:2463] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.704159 3912 raft_consensus.cc:2798] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.704187 3912 raft_consensus.cc:491] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.704208 3912 raft_consensus.cc:3054] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.705087 3912 raft_consensus.cc:513] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.705220 3912 leader_election.cc:290] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.705204 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f6f7a7dde84fe2917afb423d0306e5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.705276 3280 raft_consensus.cc:2463] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.705348 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f6f7a7dde84fe2917afb423d0306e5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.705404 3280 raft_consensus.cc:3054] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.706035 3280 raft_consensus.cc:2463] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.706267 3097 catalog_manager.cc:5526] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.706635 3485 leader_election.cc:304] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.706748 3912 raft_consensus.cc:2798] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.706808 3912 raft_consensus.cc:695] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.706845 3912 consensus_queue.cc:237] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.708178 3097 catalog_manager.cc:5526] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.708861 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62f6f7a7dde84fe2917afb423d0306e5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.708927 3414 raft_consensus.cc:3054] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.709491 3414 raft_consensus.cc:2463] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.723021 3414 raft_consensus.cc:1270] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.723064 3550 raft_consensus.cc:1270] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.723291 3952 consensus_queue.cc:1035] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.723390 3671 consensus_queue.cc:1035] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.724690 3100 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.724783 3919 tablet.cc:1721] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.725270 3097 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.726404 3922 tablet.cc:1721] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.726662 3097 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:52.726814 3917 tablet.cc:1721] T 86d086cd94664d40a653d64d06438bda P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.729004 3097 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538] alter complete (version 3)
I20250115 10:11:52.739815 3913 raft_consensus.cc:491] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.739879 3913 raft_consensus.cc:513] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.740008 3913 leader_election.cc:290] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.740139 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd018dc2d7f644339b5feba799d3bdd7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.740154 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd018dc2d7f644339b5feba799d3bdd7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.740226 3280 raft_consensus.cc:2463] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.740226 3414 raft_consensus.cc:2463] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.740350 3485 leader_election.cc:304] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.740439 3913 raft_consensus.cc:2798] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.740481 3913 raft_consensus.cc:491] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.740506 3913 raft_consensus.cc:3054] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.740991 3913 raft_consensus.cc:513] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.741096 3913 leader_election.cc:290] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.741237 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd018dc2d7f644339b5feba799d3bdd7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.741256 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd018dc2d7f644339b5feba799d3bdd7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.741317 3414 raft_consensus.cc:3054] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.741312 3280 raft_consensus.cc:3054] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.741809 3280 raft_consensus.cc:2463] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.741890 3414 raft_consensus.cc:2463] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.741981 3485 leader_election.cc:304] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.742050 3912 raft_consensus.cc:491] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.742066 3913 raft_consensus.cc:491] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.742102 3912 raft_consensus.cc:513] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.742115 3913 raft_consensus.cc:513] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.742216 3913 leader_election.cc:290] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.742228 3912 leader_election.cc:290] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.742388 3912 raft_consensus.cc:2798] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.742383 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbfcedc2f5447a1acb095066d131d52" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.742434 3912 raft_consensus.cc:695] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.742439 3414 raft_consensus.cc:2463] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.742442 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.742503 3415 raft_consensus.cc:2463] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.742476 3912 consensus_queue.cc:237] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.742468 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.742532 3278 raft_consensus.cc:2463] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.742656 3484 leader_election.cc:304] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.742653 3485 leader_election.cc:304] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.742801 3912 raft_consensus.cc:2798] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.742805 3702 raft_consensus.cc:2798] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.742875 3912 raft_consensus.cc:491] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.742889 3702 raft_consensus.cc:491] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.742906 3912 raft_consensus.cc:3054] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.743525 3912 raft_consensus.cc:513] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.743628 3912 leader_election.cc:290] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.742910 3702 raft_consensus.cc:3054] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.743774 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbfcedc2f5447a1acb095066d131d52" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.743845 3415 raft_consensus.cc:3054] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.743871 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbfcedc2f5447a1acb095066d131d52" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.743935 3278 raft_consensus.cc:3054] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.744339 3415 raft_consensus.cc:2463] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.744444 3702 raft_consensus.cc:513] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.744498 3484 leader_election.cc:304] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.744557 3702 leader_election.cc:290] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.744578 3912 raft_consensus.cc:2798] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.744627 3912 raft_consensus.cc:695] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.744671 3912 consensus_queue.cc:237] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.744681 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.744727 3415 raft_consensus.cc:3054] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.744791 3278 raft_consensus.cc:2463] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.745059 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cbfcedc2f5447a1acb095066d131d52" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.745162 3280 raft_consensus.cc:2371] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1. Re-sending same reply.
I20250115 10:11:52.745340 3415 raft_consensus.cc:2463] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.745291 3098 catalog_manager.cc:5526] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.745419 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.745499 3484 leader_election.cc:304] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.745585 3913 raft_consensus.cc:2798] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.745618 3913 raft_consensus.cc:695] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.745607 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ba4b779b29841f69fe72527763ab7a1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.745652 3280 raft_consensus.cc:3054] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.745651 3913 consensus_queue.cc:237] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.746271 3280 raft_consensus.cc:2463] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.747211 3098 catalog_manager.cc:5526] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.747315 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.747349 3098 catalog_manager.cc:5526] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.747396 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_9634080873be4b1298b25849dbebdbee [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 1 got 0
I20250115 10:11:52.750187 3415 raft_consensus.cc:1270] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.750247 3280 raft_consensus.cc:1270] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.750355 3913 consensus_queue.cc:1035] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.750435 3702 consensus_queue.cc:1035] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.751119 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.751518 3917 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.751583 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.751832 3922 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.753829 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763] alter complete (version 1)
I20250115 10:11:52.753988 3097 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.754274 3702 raft_consensus.cc:491] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.754329 3702 raft_consensus.cc:513] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.754417 3702 leader_election.cc:290] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.754581 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f559e7cafb04ae39af12e7681bbaf24" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.754649 3415 raft_consensus.cc:2463] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.754788 3484 leader_election.cc:304] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.754871 3702 raft_consensus.cc:2798] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.754900 3702 raft_consensus.cc:491] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.754918 3702 raft_consensus.cc:3054] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.755036 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f559e7cafb04ae39af12e7681bbaf24" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.755120 3278 raft_consensus.cc:2463] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.755491 3702 raft_consensus.cc:513] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.755590 3702 leader_election.cc:290] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.755760 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f559e7cafb04ae39af12e7681bbaf24" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.755779 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f559e7cafb04ae39af12e7681bbaf24" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.755829 3415 raft_consensus.cc:3054] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.755856 3278 raft_consensus.cc:3054] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.756486 3278 raft_consensus.cc:2463] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.756486 3415 raft_consensus.cc:2463] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.756593 3919 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.756731 3485 leader_election.cc:304] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.756923 3913 raft_consensus.cc:2798] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.756973 3913 raft_consensus.cc:695] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.757026 3100 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_48062bcffb944b3195686962decc74eb [id=86dc03ca83b14d698f499bb19dd94763]). Expected version 1 got 0
I20250115 10:11:52.757012 3913 consensus_queue.cc:237] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.757918 3100 catalog_manager.cc:5526] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.760464 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8a6410a08dfc4b01afd49088e7e05fea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:52.760499 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a4d16a50840d4ae08a0942fbfa5d5644"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:52.760464 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5f7d3b5c4c684b15bb751f26f4489a43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.760630 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4d16a50840d4ae08a0942fbfa5d5644 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:52.760618 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a6410a08dfc4b01afd49088e7e05fea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:52.760623 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f7d3b5c4c684b15bb751f26f4489a43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.761483 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6e70c4510d8944dd9c1de2d561c2e4ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.761596 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e70c4510d8944dd9c1de2d561c2e4ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.763228 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.763262 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.763319 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.763370 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33da9827f4a5477aa977dbb8e982f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.763373 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33da9827f4a5477aa977dbb8e982f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.763430 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33da9827f4a5477aa977dbb8e982f5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.764226 3915 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.764588 3915 tablet_bootstrap.cc:654] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.764605 3910 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.765041 3910 tablet_bootstrap.cc:654] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.765384 3915 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.765425 3915 ts_tablet_manager.cc:1397] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.765532 3908 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.765589 3915 raft_consensus.cc:357] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.765640 3915 raft_consensus.cc:383] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.765662 3915 raft_consensus.cc:738] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.765705 3915 consensus_queue.cc:260] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.765815 3915 ts_tablet_manager.cc:1428] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.765942 3908 tablet_bootstrap.cc:654] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.766155 3248 tablet_service.cc:1467] Processing CreateTablet for tablet ec9406dc72bb4e489d76011a69ee2838 (DEFAULT_TABLE table=default.Table_5f7d3b5c4c684b15bb751f26f4489a43 [id=30103cae3a884979923c62212950f5e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.766227 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4dc0c74f2e43db8b87446a236771f2 (DEFAULT_TABLE table=default.Table_8a6410a08dfc4b01afd49088e7e05fea [id=d7471d4f9dcb43c4ac4b1e8a9088a7f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.766250 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9406dc72bb4e489d76011a69ee2838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.766295 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4dc0c74f2e43db8b87446a236771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.766398 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4dc0c74f2e43db8b87446a236771f2 (DEFAULT_TABLE table=default.Table_8a6410a08dfc4b01afd49088e7e05fea [id=d7471d4f9dcb43c4ac4b1e8a9088a7f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.766500 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4dc0c74f2e43db8b87446a236771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.767392 3915 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.767439 3528 tablet_service.cc:1467] Processing CreateTablet for tablet d83cd673a6ae402e9d2139946c066c5b (DEFAULT_TABLE table=default.Table_6e70c4510d8944dd9c1de2d561c2e4ba [id=3ba55c9ddac44ad98637fa9429ab1e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.767534 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd673a6ae402e9d2139946c066c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.767889 3915 tablet_bootstrap.cc:654] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.767953 3908 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.767997 3908 ts_tablet_manager.cc:1397] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.768148 3908 raft_consensus.cc:357] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.768221 3908 raft_consensus.cc:383] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.768245 3908 raft_consensus.cc:738] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.768292 3908 consensus_queue.cc:260] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.768407 3908 ts_tablet_manager.cc:1428] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.768445 3915 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.768484 3915 ts_tablet_manager.cc:1397] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.768599 3915 raft_consensus.cc:357] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.768647 3915 raft_consensus.cc:383] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.768663 3915 raft_consensus.cc:738] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.768693 3915 consensus_queue.cc:260] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.768787 3915 ts_tablet_manager.cc:1428] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.767390 3256 tablet_service.cc:1467] Processing CreateTablet for tablet d83cd673a6ae402e9d2139946c066c5b (DEFAULT_TABLE table=default.Table_6e70c4510d8944dd9c1de2d561c2e4ba [id=3ba55c9ddac44ad98637fa9429ab1e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.768920 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd673a6ae402e9d2139946c066c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.770294 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aa9bdbddbbff43aca427359974809b8c" } modify_external_catalogs: true
I20250115 10:11:52.770390 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aa9bdbddbbff43aca427359974809b8c" } modify_external_catalogs: true
I20250115 10:11:52.770426 3101 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6e70c4510d8944dd9c1de2d561c2e4ba" } new_table_name: "default.Table_62778323bccc4e0dadeb79d6ee19d090" modify_external_catalogs: true
I20250115 10:11:52.770469 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d5311d6b627d473a9b80c77f756569f1" } new_table_name: "default.Table_bd1eae72a80c4c70bcd2320317acaaf3" modify_external_catalogs: true
I20250115 10:11:52.770359 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9634080873be4b1298b25849dbebdbee" } new_table_name: "default.Table_23e69e38d12043a7aa2f13b9b52848a2" modify_external_catalogs: true
I20250115 10:11:52.770396 3097 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df4a7240aebb4948b8f1f69966f5bd87" } new_table_name: "default.Table_ae7149f318244b6d8a530cc1324d4c57" modify_external_catalogs: true
I20250115 10:11:52.770445 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_48062bcffb944b3195686962decc74eb" } new_table_name: "default.Table_2694e169c69e4e56b48763624e4a5e04" modify_external_catalogs: true
I20250115 10:11:52.770954 3388 tablet_service.cc:1467] Processing CreateTablet for tablet d83cd673a6ae402e9d2139946c066c5b (DEFAULT_TABLE table=default.Table_6e70c4510d8944dd9c1de2d561c2e4ba [id=3ba55c9ddac44ad98637fa9429ab1e81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.771093 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd673a6ae402e9d2139946c066c5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.771590 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a6dc1067d51493e8d19f1a5ac37abfb" } modify_external_catalogs: true
I20250115 10:11:52.771661 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a6dc1067d51493e8d19f1a5ac37abfb" } modify_external_catalogs: true
I20250115 10:11:52.771924 3391 tablet_service.cc:1467] Processing CreateTablet for tablet ec9406dc72bb4e489d76011a69ee2838 (DEFAULT_TABLE table=default.Table_5f7d3b5c4c684b15bb751f26f4489a43 [id=30103cae3a884979923c62212950f5e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.772017 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9406dc72bb4e489d76011a69ee2838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.770983 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 0f4dc0c74f2e43db8b87446a236771f2 (DEFAULT_TABLE table=default.Table_8a6410a08dfc4b01afd49088e7e05fea [id=d7471d4f9dcb43c4ac4b1e8a9088a7f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.772249 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f4dc0c74f2e43db8b87446a236771f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.772994 3908 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.773409 3908 tablet_bootstrap.cc:654] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.774112 3908 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.774163 3908 ts_tablet_manager.cc:1397] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.774370 3908 raft_consensus.cc:357] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.774435 3908 raft_consensus.cc:383] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.774458 3908 raft_consensus.cc:738] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.774493 3908 consensus_queue.cc:260] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.774619 3908 ts_tablet_manager.cc:1428] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.775110 3908 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.775497 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aebe1f2ba47642788e4a8e71dca5acad" } modify_external_catalogs: true
I20250115 10:11:52.775534 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0ef656e644104941a603aa26c89f1772" } modify_external_catalogs: true
I20250115 10:11:52.775568 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_aebe1f2ba47642788e4a8e71dca5acad" } modify_external_catalogs: true
I20250115 10:11:52.775568 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0ef656e644104941a603aa26c89f1772" } modify_external_catalogs: true
I20250115 10:11:52.775779 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55e9d5ef334a4d61a7708bd492211b40" } modify_external_catalogs: true
I20250115 10:11:52.775827 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55e9d5ef334a4d61a7708bd492211b40" } modify_external_catalogs: true
I20250115 10:11:52.776026 3908 tablet_bootstrap.cc:654] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.776835 3908 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.776890 3908 ts_tablet_manager.cc:1397] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.777140 3908 raft_consensus.cc:357] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.777200 3908 raft_consensus.cc:383] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.777201 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 62f6f7a7dde84fe2917afb423d0306e5
I20250115 10:11:52.777220 3908 raft_consensus.cc:738] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:11:52.777237 3101 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d83cd673a6ae402e9d2139946c066c5b consensus state has no leader
I20250115 10:11:52.777259 3908 consensus_queue.cc:260] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.777288 3101 master_service.cc:946] ReplaceTablet: received request to replace tablet 97c0f8da38d84482b284a628714e67d0 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:52.777320 3097 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 863d2fe8ea6648beb42458fc501cccb3 consensus state has no leader
I20250115 10:11:52.777282 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 62f6f7a7dde84fe2917afb423d0306e5 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.777357 3097 master_service.cc:946] ReplaceTablet: received request to replace tablet 777cc4bb380a4b53942b2c978325146e from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.777333 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet 33da9827f4a5477aa977dbb8e982f5ff from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.777281 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 863d2fe8ea6648beb42458fc501cccb3 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.777460 3908 ts_tablet_manager.cc:1428] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.777516 3908 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.777611 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 66cf94364ef34cfab28e355f42229305
I20250115 10:11:52.777789 3100 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 97c0f8da38d84482b284a628714e67d0
I20250115 10:11:52.778000 3908 tablet_bootstrap.cc:654] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.768833 3915 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.778466 3525 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.778569 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cf94364ef34cfab28e355f42229305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.778594 3254 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c0f8da38d84482b284a628714e67d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.778620 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c0f8da38d84482b284a628714e67d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.778738 3915 tablet_bootstrap.cc:654] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.778856 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cf94364ef34cfab28e355f42229305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.778867 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 777cc4bb380a4b53942b2c978325146e
I20250115 10:11:52.778927 3914 tablet_replica.cc:331] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.778963 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f0e12580d44644ed9cfb5a9c9f6f0ae6
I20250115 10:11:52.778987 3914 raft_consensus.cc:2238] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.779026 3914 raft_consensus.cc:2267] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.779059 3909 tablet_replica.cc:331] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.779130 3909 raft_consensus.cc:2238] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.779181 3909 pending_rounds.cc:62] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:11:52.779234 3909 pending_rounds.cc:69] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489498446913536 op_type: NO_OP noop_request { }
I20250115 10:11:52.779284 3909 raft_consensus.cc:2883] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.779311 3909 raft_consensus.cc:2267] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.779348 3914 ts_tablet_manager.cc:1905] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.779527 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet 777cc4bb380a4b53942b2c978325146e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.779589 3253 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.779832 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 777cc4bb380a4b53942b2c978325146e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.779840 3909 ts_tablet_manager.cc:1905] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.779944 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.780222 3919 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.780350 3917 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.780614 3770 raft_consensus.cc:491] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.780663 3770 raft_consensus.cc:513] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.780820 3770 leader_election.cc:290] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.781020 3914 ts_tablet_manager.cc:1918] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.781064 3914 log.cc:1198] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/97c0f8da38d84482b284a628714e67d0
I20250115 10:11:52.781239 3914 ts_tablet_manager.cc:1939] T 97c0f8da38d84482b284a628714e67d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.781394 3909 ts_tablet_manager.cc:1918] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.781437 3909 log.cc:1198] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/62f6f7a7dde84fe2917afb423d0306e5
I20250115 10:11:52.781461 3914 tablet_replica.cc:331] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.781509 3914 raft_consensus.cc:2238] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.781544 3914 raft_consensus.cc:2267] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.781659 3909 ts_tablet_manager.cc:1939] T 62f6f7a7dde84fe2917afb423d0306e5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.781742 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cf94364ef34cfab28e355f42229305" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.781781 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 97c0f8da38d84482b284a628714e67d0 (table default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]) successfully deleted
I20250115 10:11:52.781808 3550 raft_consensus.cc:2463] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.781996 3914 ts_tablet_manager.cc:1905] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.782002 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66cf94364ef34cfab28e355f42229305" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.782076 3413 raft_consensus.cc:2463] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.782359 3215 leader_election.cc:304] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:11:52.782419 3215 raft_consensus.cc:2681] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20250115 10:11:52.782651 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.782658 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 777cc4bb380a4b53942b2c978325146e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.782801 3907 tablet_replica.cc:331] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.782913 3907 raft_consensus.cc:2238] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.782946 3907 raft_consensus.cc:2267] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.782984 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet 66cf94364ef34cfab28e355f42229305 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.783090 3907 ts_tablet_manager.cc:1905] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.783296 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 97c0f8da38d84482b284a628714e67d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.783320 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.783543 3415 raft_consensus.cc:1270] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.783619 3914 ts_tablet_manager.cc:1918] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.783670 3914 log.cc:1198] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/66cf94364ef34cfab28e355f42229305
I20250115 10:11:52.783747 3913 consensus_queue.cc:1035] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.783809 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 62f6f7a7dde84fe2917afb423d0306e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.783905 3914 ts_tablet_manager.cc:1939] T 66cf94364ef34cfab28e355f42229305 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.783974 3522 tablet_service.cc:1467] Processing CreateTablet for tablet ec9406dc72bb4e489d76011a69ee2838 (DEFAULT_TABLE table=default.Table_5f7d3b5c4c684b15bb751f26f4489a43 [id=30103cae3a884979923c62212950f5e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.784060 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9406dc72bb4e489d76011a69ee2838. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.784106 3914 tablet_replica.cc:331] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.784150 3914 raft_consensus.cc:2238] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.784216 3914 raft_consensus.cc:2267] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.784513 3907 ts_tablet_manager.cc:1918] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.784569 3907 log.cc:1198] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f0e12580d44644ed9cfb5a9c9f6f0ae6
I20250115 10:11:52.784758 3907 ts_tablet_manager.cc:1939] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.784874 3922 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.785054 3914 ts_tablet_manager.cc:1905] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.785184 3917 tablet.cc:1721] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.785786 3922 tablet.cc:1721] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.786052 3280 raft_consensus.cc:1270] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.786309 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 66cf94364ef34cfab28e355f42229305 (table default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]) successfully deleted
I20250115 10:11:52.786578 3907 tablet_replica.cc:331] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.786638 3907 raft_consensus.cc:2238] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.786677 3907 raft_consensus.cc:2267] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.786896 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (table default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]) successfully deleted
I20250115 10:11:52.786937 3907 ts_tablet_manager.cc:1905] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.787081 3912 consensus_queue.cc:1035] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.787119 3914 ts_tablet_manager.cc:1918] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.787169 3914 log.cc:1198] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/777cc4bb380a4b53942b2c978325146e
I20250115 10:11:52.787202 3097 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_bd1eae72a80c4c70bcd2320317acaaf3 [id=284816018979468d99f5a23274d90447] alter complete (version 2)
I20250115 10:11:52.787341 3914 ts_tablet_manager.cc:1939] T 777cc4bb380a4b53942b2c978325146e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.787341 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 863d2fe8ea6648beb42458fc501cccb3
I20250115 10:11:52.787398 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 863d2fe8ea6648beb42458fc501cccb3 deleted and replaced by tablet 5187f117222048bc8b775bd98f632aea
I20250115 10:11:52.787552 3914 tablet_replica.cc:331] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.787606 3914 raft_consensus.cc:2238] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.787643 3914 raft_consensus.cc:2267] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.787838 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5187f117222048bc8b775bd98f632aea) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.788117 3914 ts_tablet_manager.cc:1905] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.788363 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_11479444269a4117945edd0028634c29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.788476 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11479444269a4117945edd0028634c29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.788601 3907 ts_tablet_manager.cc:1918] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.788646 3907 log.cc:1198] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/777cc4bb380a4b53942b2c978325146e
I20250115 10:11:52.788622 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2c41014de7a04fffb7bcba7f119579f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.788702 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c41014de7a04fffb7bcba7f119579f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.788798 3907 ts_tablet_manager.cc:1939] T 777cc4bb380a4b53942b2c978325146e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.789095 3907 tablet_replica.cc:331] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.789187 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 777cc4bb380a4b53942b2c978325146e (table default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]) successfully deleted
I20250115 10:11:52.789218 3907 raft_consensus.cc:2238] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.789274 3907 raft_consensus.cc:2267] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.789459 3914 ts_tablet_manager.cc:1918] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.789480 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 777cc4bb380a4b53942b2c978325146e (table default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]) successfully deleted
I20250115 10:11:52.789508 3914 log.cc:1198] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f0e12580d44644ed9cfb5a9c9f6f0ae6
I20250115 10:11:52.789507 3907 ts_tablet_manager.cc:1905] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.789690 3914 ts_tablet_manager.cc:1939] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.789868 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5187f117222048bc8b775bd98f632aea) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.790088 3914 tablet_replica.cc:331] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.790169 3914 raft_consensus.cc:2238] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.790222 3914 raft_consensus.cc:2267] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.790436 3914 ts_tablet_manager.cc:1905] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.790454 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (table default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]) successfully deleted
I20250115 10:11:52.790715 3907 ts_tablet_manager.cc:1918] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.790832 3101 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_04b37cf1d3954dc0be648463a865bb83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.790925 3101 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04b37cf1d3954dc0be648463a865bb83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.790880 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ad50056dab124052a1c2db8288f01386"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.790990 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad50056dab124052a1c2db8288f01386 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.791077 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_eb212e1f015b43c3a7023e57a09fbfd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.791162 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb212e1f015b43c3a7023e57a09fbfd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.791275 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f7d3a239a65543aebe02588904f8323b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.791345 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7d3a239a65543aebe02588904f8323b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.791425 3907 log.cc:1198] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/66cf94364ef34cfab28e355f42229305
I20250115 10:11:52.791600 3907 ts_tablet_manager.cc:1939] T 66cf94364ef34cfab28e355f42229305 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.791599 3914 ts_tablet_manager.cc:1918] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.791656 3914 log.cc:1198] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/62f6f7a7dde84fe2917afb423d0306e5
I20250115 10:11:52.791831 3910 tablet_bootstrap.cc:492] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.791878 3910 ts_tablet_manager.cc:1397] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20250115 10:11:52.791879 3914 ts_tablet_manager.cc:1939] T 62f6f7a7dde84fe2917afb423d0306e5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.792032 3910 raft_consensus.cc:357] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.792086 3910 raft_consensus.cc:383] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.792084 3914 tablet_replica.cc:331] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.792110 3910 raft_consensus.cc:738] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.792145 3910 consensus_queue.cc:260] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.792222 3910 ts_tablet_manager.cc:1428] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.792280 3910 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.792361 3914 raft_consensus.cc:2238] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.792405 3914 raft_consensus.cc:2267] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.792428 3917 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.792690 3910 tablet_bootstrap.cc:654] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.793099 3919 tablet.cc:1721] T 8cbfcedc2f5447a1acb095066d131d52 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.793340 3914 ts_tablet_manager.cc:1905] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.793440 3910 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.793485 3910 ts_tablet_manager.cc:1397] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.793617 3910 raft_consensus.cc:357] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.793668 3910 raft_consensus.cc:383] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.793689 3910 raft_consensus.cc:738] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.793731 3910 consensus_queue.cc:260] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.793820 3910 ts_tablet_manager.cc:1428] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.793875 3910 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.794251 3910 tablet_bootstrap.cc:654] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.794461 3914 ts_tablet_manager.cc:1918] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.794514 3914 log.cc:1198] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/863d2fe8ea6648beb42458fc501cccb3
I20250115 10:11:52.794687 3914 ts_tablet_manager.cc:1939] T 863d2fe8ea6648beb42458fc501cccb3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.794909 3907 tablet_replica.cc:331] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.794963 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 62f6f7a7dde84fe2917afb423d0306e5 (table default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]) successfully deleted
I20250115 10:11:52.794987 3907 raft_consensus.cc:2238] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.795110 3092 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 2 got 0
I20250115 10:11:52.795114 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 66cf94364ef34cfab28e355f42229305 (table default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]) successfully deleted
I20250115 10:11:52.795451 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb] alter complete (version 2)
I20250115 10:11:52.795154 3907 pending_rounds.cc:62] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:11:52.795867 3907 pending_rounds.cc:69] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489498364944384 op_type: NO_OP noop_request { }
I20250115 10:11:52.795915 3910 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.795931 3907 raft_consensus.cc:2883] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.795955 3910 ts_tablet_manager.cc:1397] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.795984 3907 raft_consensus.cc:2267] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.796103 3910 raft_consensus.cc:357] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.796164 3910 raft_consensus.cc:383] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.796202 3910 raft_consensus.cc:738] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.796206 3907 ts_tablet_manager.cc:1905] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.796249 3910 consensus_queue.cc:260] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.796337 3910 ts_tablet_manager.cc:1428] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.796430 3910 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.797339 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 5187f117222048bc8b775bd98f632aea (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.797500 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5187f117222048bc8b775bd98f632aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.797554 3925 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.797892 3915 tablet_bootstrap.cc:492] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.797950 3915 ts_tablet_manager.cc:1397] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250115 10:11:52.797977 3910 tablet_bootstrap.cc:654] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.798126 3915 raft_consensus.cc:357] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.798194 3915 raft_consensus.cc:383] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.798216 3915 raft_consensus.cc:738] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.798267 3915 consensus_queue.cc:260] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.798367 3915 ts_tablet_manager.cc:1428] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:52.798903 3910 tablet_bootstrap.cc:492] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.798949 3910 ts_tablet_manager.cc:1397] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20250115 10:11:52.798997 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 5187f117222048bc8b775bd98f632aea (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.799063 3910 raft_consensus.cc:357] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.799117 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5187f117222048bc8b775bd98f632aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.799396 3915 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.799789 3907 ts_tablet_manager.cc:1918] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.799839 3907 log.cc:1198] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/97c0f8da38d84482b284a628714e67d0
I20250115 10:11:52.799993 3915 tablet_bootstrap.cc:654] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.800042 3907 ts_tablet_manager.cc:1939] T 97c0f8da38d84482b284a628714e67d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.800263 3907 tablet_replica.cc:331] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.800338 3907 raft_consensus.cc:2238] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.800382 3907 raft_consensus.cc:2267] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.800545 3907 ts_tablet_manager.cc:1905] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.799117 3910 raft_consensus.cc:383] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.800622 3910 raft_consensus.cc:738] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.800642 3915 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.800694 3910 consensus_queue.cc:260] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.800745 3915 ts_tablet_manager.cc:1397] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.800803 3910 ts_tablet_manager.cc:1428] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.800904 3910 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.800899 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 97c0f8da38d84482b284a628714e67d0 (table default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]) successfully deleted
I20250115 10:11:52.801134 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 5187f117222048bc8b775bd98f632aea (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.800980 3915 raft_consensus.cc:357] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.801219 3915 raft_consensus.cc:383] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.801333 3910 tablet_bootstrap.cc:654] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.801285 3915 raft_consensus.cc:738] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.801239 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5187f117222048bc8b775bd98f632aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.801630 3915 consensus_queue.cc:260] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.802412 3907 ts_tablet_manager.cc:1918] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.802431 3915 ts_tablet_manager.cc:1428] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.802467 3907 log.cc:1198] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/62f6f7a7dde84fe2917afb423d0306e5
I20250115 10:11:52.802666 3907 ts_tablet_manager.cc:1939] T 62f6f7a7dde84fe2917afb423d0306e5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.803089 3915 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.803193 3909 tablet_replica.cc:331] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.803251 3909 raft_consensus.cc:2238] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.803285 3909 raft_consensus.cc:2267] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.803287 3910 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.803426 3910 ts_tablet_manager.cc:1397] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:52.803512 3909 ts_tablet_manager.cc:1905] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.803583 3910 raft_consensus.cc:357] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.803647 3910 raft_consensus.cc:383] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.803670 3910 raft_consensus.cc:738] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.803679 3915 tablet_bootstrap.cc:654] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.803731 3910 consensus_queue.cc:260] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.803834 3910 ts_tablet_manager.cc:1428] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.803844 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 62f6f7a7dde84fe2917afb423d0306e5 (table default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]) successfully deleted
I20250115 10:11:52.804149 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 863d2fe8ea6648beb42458fc501cccb3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5187f117222048bc8b775bd98f632aea) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.804653 3915 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.804699 3915 ts_tablet_manager.cc:1397] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.804785 3907 tablet_replica.cc:331] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.804848 3909 ts_tablet_manager.cc:1918] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.804859 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 62f6f7a7dde84fe2917afb423d0306e5 (table default.Table_3a6dc1067d51493e8d19f1a5ac37abfb [id=024de0404e4d4ab8aa1f0c618f6d8d70]) successfully deleted
I20250115 10:11:52.804869 3915 raft_consensus.cc:357] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.804925 3915 raft_consensus.cc:383] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.804948 3915 raft_consensus.cc:738] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.804946 3907 raft_consensus.cc:2238] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.804988 3907 raft_consensus.cc:2267] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.805012 3915 consensus_queue.cc:260] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.805647 3915 ts_tablet_manager.cc:1428] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.805701 3907 ts_tablet_manager.cc:1905] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.806061 3909 log.cc:1198] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/66cf94364ef34cfab28e355f42229305
I20250115 10:11:52.806275 3909 ts_tablet_manager.cc:1939] T 66cf94364ef34cfab28e355f42229305 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.806391 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 33da9827f4a5477aa977dbb8e982f5ff
I20250115 10:11:52.806452 3094 catalog_manager.cc:6596] ReplaceTablet: tablet 33da9827f4a5477aa977dbb8e982f5ff deleted and replaced by tablet 5779ec7816cd499ebe46962e29092a70
I20250115 10:11:52.806540 3909 tablet_replica.cc:331] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.806584 3909 raft_consensus.cc:2238] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.806612 3909 raft_consensus.cc:2267] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.806816 3909 ts_tablet_manager.cc:1905] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.807229 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 66cf94364ef34cfab28e355f42229305 (table default.Table_0ef656e644104941a603aa26c89f1772 [id=81fff9659dbd44a9b402e5293cf0c25c]) successfully deleted
I20250115 10:11:52.808100 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5779ec7816cd499ebe46962e29092a70) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.808477 3909 ts_tablet_manager.cc:1918] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.808588 3521 tablet_service.cc:1467] Processing CreateTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 (DEFAULT_TABLE table=default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.808701 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2b3ba3d834a55aacac680c4c2a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.808694 3256 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (DEFAULT_TABLE table=default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.808782 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.808805 3528 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (DEFAULT_TABLE table=default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.808878 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.809481 3915 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.809885 3910 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.809913 3253 tablet_service.cc:1467] Processing CreateTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 (DEFAULT_TABLE table=default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.809971 3915 tablet_bootstrap.cc:654] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.810007 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2b3ba3d834a55aacac680c4c2a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.810266 3910 tablet_bootstrap.cc:654] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.810987 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 5779ec7816cd499ebe46962e29092a70 (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.811074 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5779ec7816cd499ebe46962e29092a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.811103 3529 tablet_service.cc:1467] Processing CreateTablet for tablet d667834206fe4410a22b4944b3494462 (DEFAULT_TABLE table=default.Table_04b37cf1d3954dc0be648463a865bb83 [id=ab569ac74bbb44f1913506709002a4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.811195 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d667834206fe4410a22b4944b3494462. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.811170 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 01a8681daa9b459ba85dea9410d83256 (DEFAULT_TABLE table=default.Table_ad50056dab124052a1c2db8288f01386 [id=9b3ecdf3104a477199cf73b7b0d78155]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.811322 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8681daa9b459ba85dea9410d83256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.811614 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5779ec7816cd499ebe46962e29092a70) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.806643 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet 33da9827f4a5477aa977dbb8e982f5ff with delete_type TABLET_DATA_DELETED (replaced by tablet 5779ec7816cd499ebe46962e29092a70) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.812278 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 01a8681daa9b459ba85dea9410d83256 (DEFAULT_TABLE table=default.Table_ad50056dab124052a1c2db8288f01386 [id=9b3ecdf3104a477199cf73b7b0d78155]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.812353 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8681daa9b459ba85dea9410d83256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.812618 3248 tablet_service.cc:1467] Processing CreateTablet for tablet f509f1b315544adca69617d12c71d277 (DEFAULT_TABLE table=default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.811079 3526 tablet_service.cc:1467] Processing CreateTablet for tablet f509f1b315544adca69617d12c71d277 (DEFAULT_TABLE table=default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.812707 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f509f1b315544adca69617d12c71d277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.812764 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f509f1b315544adca69617d12c71d277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.813411 3258 tablet_service.cc:1467] Processing CreateTablet for tablet d667834206fe4410a22b4944b3494462 (DEFAULT_TABLE table=default.Table_04b37cf1d3954dc0be648463a865bb83 [id=ab569ac74bbb44f1913506709002a4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.813479 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d667834206fe4410a22b4944b3494462. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.813525 3907 ts_tablet_manager.cc:1918] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.813571 3907 log.cc:1198] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/863d2fe8ea6648beb42458fc501cccb3
I20250115 10:11:52.813750 3907 ts_tablet_manager.cc:1939] T 863d2fe8ea6648beb42458fc501cccb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.808137 3391 tablet_service.cc:1467] Processing CreateTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (DEFAULT_TABLE table=default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.813922 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.813952 3910 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.813987 3910 ts_tablet_manager.cc:1397] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:11:52.814111 3910 raft_consensus.cc:357] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.814164 3910 raft_consensus.cc:383] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.814203 3910 raft_consensus.cc:738] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.814213 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 863d2fe8ea6648beb42458fc501cccb3 (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:52.814250 3910 consensus_queue.cc:260] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.814332 3907 tablet_replica.cc:331] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.814363 3910 ts_tablet_manager.cc:1428] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.814389 3907 raft_consensus.cc:2238] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.814427 3910 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.814428 3907 raft_consensus.cc:2267] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.814786 3907 ts_tablet_manager.cc:1905] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.814821 3910 tablet_bootstrap.cc:654] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.815868 3256 tablet_service.cc:1467] Processing CreateTablet for tablet d92890d082e242ccae8ad4e40d056c74 (DEFAULT_TABLE table=default.Table_eb212e1f015b43c3a7023e57a09fbfd2 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.816058 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92890d082e242ccae8ad4e40d056c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.816617 3095 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_2694e169c69e4e56b48763624e4a5e04 [id=86dc03ca83b14d698f499bb19dd94763] alter complete (version 2)
I20250115 10:11:52.816694 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 5779ec7816cd499ebe46962e29092a70 (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.816790 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5779ec7816cd499ebe46962e29092a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.817363 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]). Expected version 1 got 0
I20250115 10:11:52.817423 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
W20250115 10:11:52.817488 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5187f117222048bc8b775bd98f632aea consensus state has no leader
I20250115 10:11:52.817798 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:52.817850 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]). Expected version 1 got 0
I20250115 10:11:52.808137 3392 tablet_service.cc:1467] Processing CreateTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 (DEFAULT_TABLE table=default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.818037 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dde2b3ba3d834a55aacac680c4c2a3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.818482 3914 tablet_replica.cc:331] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
W20250115 10:11:52.818522 2944 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01285bc3401243e9bcbba5062c80dbfa consensus state has no leader
I20250115 10:11:52.818619 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 863d2fe8ea6648beb42458fc501cccb3 (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:52.818706 3907 ts_tablet_manager.cc:1918] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.818765 3907 log.cc:1198] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/33da9827f4a5477aa977dbb8e982f5ff
I20250115 10:11:52.818930 3907 ts_tablet_manager.cc:1939] T 33da9827f4a5477aa977dbb8e982f5ff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.818960 3914 raft_consensus.cc:2238] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.819089 3914 raft_consensus.cc:2267] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.810796 3383 tablet_service.cc:1467] Processing CreateTablet for tablet d92890d082e242ccae8ad4e40d056c74 (DEFAULT_TABLE table=default.Table_eb212e1f015b43c3a7023e57a09fbfd2 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.819231 3922 tablet.cc:1721] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.819267 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92890d082e242ccae8ad4e40d056c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.819306 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 33da9827f4a5477aa977dbb8e982f5ff (table default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]) successfully deleted
I20250115 10:11:52.819566 3914 ts_tablet_manager.cc:1905] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.810905 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 01a8681daa9b459ba85dea9410d83256 (DEFAULT_TABLE table=default.Table_ad50056dab124052a1c2db8288f01386 [id=9b3ecdf3104a477199cf73b7b0d78155]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.819933 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a8681daa9b459ba85dea9410d83256. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.810920 3389 tablet_service.cc:1467] Processing CreateTablet for tablet f509f1b315544adca69617d12c71d277 (DEFAULT_TABLE table=default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.821233 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f509f1b315544adca69617d12c71d277. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.821624 3914 ts_tablet_manager.cc:1918] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.821684 3914 log.cc:1198] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/33da9827f4a5477aa977dbb8e982f5ff
I20250115 10:11:52.821861 3914 ts_tablet_manager.cc:1939] T 33da9827f4a5477aa977dbb8e982f5ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.822257 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 33da9827f4a5477aa977dbb8e982f5ff (table default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]) successfully deleted
I20250115 10:11:52.810961 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 5779ec7816cd499ebe46962e29092a70 (DEFAULT_TABLE table=default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.822624 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5779ec7816cd499ebe46962e29092a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.823557 3908 tablet_bootstrap.cc:492] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.823613 3908 ts_tablet_manager.cc:1397] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.000s
I20250115 10:11:52.823645 3915 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.823693 3915 ts_tablet_manager.cc:1397] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:11:52.823794 3908 raft_consensus.cc:357] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.811025 3386 tablet_service.cc:1467] Processing CreateTablet for tablet d667834206fe4410a22b4944b3494462 (DEFAULT_TABLE table=default.Table_04b37cf1d3954dc0be648463a865bb83 [id=ab569ac74bbb44f1913506709002a4c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.823890 3908 raft_consensus.cc:383] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.823916 3908 raft_consensus.cc:738] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.823874 3915 raft_consensus.cc:357] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.823945 3915 raft_consensus.cc:383] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.823980 3915 raft_consensus.cc:738] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.823952 3908 consensus_queue.cc:260] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.823954 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d667834206fe4410a22b4944b3494462. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.824028 3915 consensus_queue.cc:260] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.824060 3908 ts_tablet_manager.cc:1428] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.824124 3908 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.824128 3915 ts_tablet_manager.cc:1428] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.824185 3915 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.824492 3908 tablet_bootstrap.cc:654] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.824661 3915 tablet_bootstrap.cc:654] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.825340 3908 tablet_bootstrap.cc:492] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.825382 3908 ts_tablet_manager.cc:1397] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.825414 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]). Expected version 1 got 0
I20250115 10:11:52.825508 3908 raft_consensus.cc:357] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.825580 3908 raft_consensus.cc:383] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.825601 3908 raft_consensus.cc:738] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.825639 3908 consensus_queue.cc:260] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.825753 3908 ts_tablet_manager.cc:1428] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.825798 3908 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.826095 3908 tablet_bootstrap.cc:654] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.826225 3521 tablet_service.cc:1467] Processing CreateTablet for tablet d92890d082e242ccae8ad4e40d056c74 (DEFAULT_TABLE table=default.Table_eb212e1f015b43c3a7023e57a09fbfd2 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.826318 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92890d082e242ccae8ad4e40d056c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.826581 3908 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.826617 3908 ts_tablet_manager.cc:1397] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.826933 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:52.826803 3908 raft_consensus.cc:357] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.827085 3908 raft_consensus.cc:383] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.827116 3908 raft_consensus.cc:738] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.827172 3908 consensus_queue.cc:260] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.827287 3414 raft_consensus.cc:1270] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.827397 3908 ts_tablet_manager.cc:1428] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.827457 3908 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.827461 3665 consensus_queue.cc:1035] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.808591 3909 log.cc:1198] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/97c0f8da38d84482b284a628714e67d0
I20250115 10:11:52.828272 3278 raft_consensus.cc:1270] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.828306 3909 ts_tablet_manager.cc:1939] T 97c0f8da38d84482b284a628714e67d0 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.828426 3665 consensus_queue.cc:1035] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.828545 3908 tablet_bootstrap.cc:654] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.828743 3909 tablet_replica.cc:331] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.828745 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 97c0f8da38d84482b284a628714e67d0 (table default.Table_aa9bdbddbbff43aca427359974809b8c [id=360e78d3007b415099818a7c048215ee]) successfully deleted
I20250115 10:11:52.828807 3909 raft_consensus.cc:2238] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.828869 3909 pending_rounds.cc:62] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:11:52.828889 3909 pending_rounds.cc:69] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489498268983296 op_type: NO_OP noop_request { }
I20250115 10:11:52.828924 3909 raft_consensus.cc:2883] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.828943 3909 raft_consensus.cc:2267] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.829303 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:52.829319 3908 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.829345 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.829360 3908 ts_tablet_manager.cc:1397] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:52.829398 3095 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.829489 3909 ts_tablet_manager.cc:1905] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.829488 3908 raft_consensus.cc:357] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.829540 3908 raft_consensus.cc:383] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.829563 3908 raft_consensus.cc:738] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.829627 3908 consensus_queue.cc:260] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.829720 3908 ts_tablet_manager.cc:1428] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.829787 3908 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.830169 3908 tablet_bootstrap.cc:654] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.830436 3095 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.830618 3919 tablet.cc:1721] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.830773 3917 tablet.cc:1721] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.831395 3909 ts_tablet_manager.cc:1918] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.831449 3910 tablet_bootstrap.cc:492] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.831507 3910 ts_tablet_manager.cc:1397] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250115 10:11:52.831684 3910 raft_consensus.cc:357] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.831796 3910 raft_consensus.cc:383] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.831820 3910 raft_consensus.cc:738] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.831888 3910 consensus_queue.cc:260] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.831992 3910 ts_tablet_manager.cc:1428] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.832044 3910 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.832458 3910 tablet_bootstrap.cc:654] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.831444 3909 log.cc:1198] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/777cc4bb380a4b53942b2c978325146e
I20250115 10:11:52.832967 3909 ts_tablet_manager.cc:1939] T 777cc4bb380a4b53942b2c978325146e P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.833245 3095 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874] alter complete (version 2)
I20250115 10:11:52.833320 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 777cc4bb380a4b53942b2c978325146e (table default.Table_aebe1f2ba47642788e4a8e71dca5acad [id=9dca1b776b074b8c85d1df0198890ca8]) successfully deleted
I20250115 10:11:52.833561 3909 tablet_replica.cc:331] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.833633 3915 tablet_bootstrap.cc:492] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.833675 3915 ts_tablet_manager.cc:1397] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:11:52.833698 3909 raft_consensus.cc:2238] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.833740 3909 raft_consensus.cc:2267] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.833853 3915 raft_consensus.cc:357] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.833920 3915 raft_consensus.cc:383] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.833942 3915 raft_consensus.cc:738] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.833952 3909 ts_tablet_manager.cc:1905] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.833989 3915 consensus_queue.cc:260] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.834098 3915 ts_tablet_manager.cc:1428] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.834159 3915 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.834666 3915 tablet_bootstrap.cc:654] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.835552 3915 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.835601 3915 ts_tablet_manager.cc:1397] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.835698 3909 ts_tablet_manager.cc:1918] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.835762 3909 log.cc:1198] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f0e12580d44644ed9cfb5a9c9f6f0ae6
I20250115 10:11:52.835765 3915 raft_consensus.cc:357] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.835844 3915 raft_consensus.cc:383] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.835867 3915 raft_consensus.cc:738] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.835907 3915 consensus_queue.cc:260] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.835992 3915 ts_tablet_manager.cc:1428] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.836050 3915 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.836146 3909 ts_tablet_manager.cc:1939] T f0e12580d44644ed9cfb5a9c9f6f0ae6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.836439 3915 tablet_bootstrap.cc:654] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.836499 3909 tablet_replica.cc:331] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.836496 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f0e12580d44644ed9cfb5a9c9f6f0ae6 (table default.Table_55e9d5ef334a4d61a7708bd492211b40 [id=2c7174aaa29d43abb07a7bf682f1b54b]) successfully deleted
I20250115 10:11:52.836571 3909 raft_consensus.cc:2238] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.836606 3909 raft_consensus.cc:2267] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.837332 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:52.837515 3922 tablet.cc:1721] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:52.838773 3909 ts_tablet_manager.cc:1905] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.840062 3909 ts_tablet_manager.cc:1918] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.840126 3909 log.cc:1198] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/863d2fe8ea6648beb42458fc501cccb3
I20250115 10:11:52.840286 3909 ts_tablet_manager.cc:1939] T 863d2fe8ea6648beb42458fc501cccb3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.840577 3908 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.840580 3909 tablet_replica.cc:331] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.840637 3909 raft_consensus.cc:2238] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.840636 3908 ts_tablet_manager.cc:1397] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:11:52.840663 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 863d2fe8ea6648beb42458fc501cccb3 (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:52.840669 3910 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.840715 3910 ts_tablet_manager.cc:1397] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:11:52.840837 3910 raft_consensus.cc:357] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.840883 3910 raft_consensus.cc:383] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.840842 3908 raft_consensus.cc:357] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.840899 3910 raft_consensus.cc:738] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.840909 3908 raft_consensus.cc:383] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.840930 3908 raft_consensus.cc:738] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.840926 3915 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.840938 3910 consensus_queue.cc:260] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.840962 3915 ts_tablet_manager.cc:1397] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:11:52.840977 3908 consensus_queue.cc:260] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.841015 3910 ts_tablet_manager.cc:1428] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.841076 3910 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.841073 3908 ts_tablet_manager.cc:1428] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.841107 3915 raft_consensus.cc:357] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.841145 3908 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.841166 3915 raft_consensus.cc:383] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.841184 3915 raft_consensus.cc:738] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.841223 3915 consensus_queue.cc:260] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.841320 3915 ts_tablet_manager.cc:1428] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.841408 3915 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.841557 3908 tablet_bootstrap.cc:654] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.841567 3910 tablet_bootstrap.cc:654] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.841807 3915 tablet_bootstrap.cc:654] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.840668 3909 raft_consensus.cc:2267] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.842137 3909 ts_tablet_manager.cc:1905] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.842659 3913 raft_consensus.cc:491] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.842729 3913 raft_consensus.cc:513] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.842875 3913 leader_election.cc:290] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.843252 3915 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.843297 3915 ts_tablet_manager.cc:1397] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.843492 3915 raft_consensus.cc:357] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.843556 3915 raft_consensus.cc:383] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.843582 3915 raft_consensus.cc:738] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.843633 3915 consensus_queue.cc:260] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.843930 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efdfc58cbb4c4d85880fe8d1ddd4a53b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.844024 3414 raft_consensus.cc:2463] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.843304 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efdfc58cbb4c4d85880fe8d1ddd4a53b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.844306 3278 raft_consensus.cc:2463] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.844429 3915 ts_tablet_manager.cc:1428] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.844432 3485 leader_election.cc:304] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.844491 3915 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.844512 3913 raft_consensus.cc:2798] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.844553 3913 raft_consensus.cc:491] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.844573 3913 raft_consensus.cc:3054] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.844906 3915 tablet_bootstrap.cc:654] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.845081 3910 tablet_bootstrap.cc:492] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.845125 3910 ts_tablet_manager.cc:1397] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:11:52.845245 3913 raft_consensus.cc:513] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.845275 3910 raft_consensus.cc:357] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.845319 3910 raft_consensus.cc:383] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.845336 3910 raft_consensus.cc:738] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.845376 3910 consensus_queue.cc:260] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.845413 3909 ts_tablet_manager.cc:1918] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.845477 3909 log.cc:1198] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/33da9827f4a5477aa977dbb8e982f5ff
I20250115 10:11:52.845641 3909 ts_tablet_manager.cc:1939] T 33da9827f4a5477aa977dbb8e982f5ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.845767 3915 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.845809 3915 ts_tablet_manager.cc:1397] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.845956 3915 raft_consensus.cc:357] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.846024 3915 raft_consensus.cc:383] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.846048 3915 raft_consensus.cc:738] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.846096 3915 consensus_queue.cc:260] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.846118 3908 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.846159 3908 ts_tablet_manager.cc:1397] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:11:52.846125 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efdfc58cbb4c4d85880fe8d1ddd4a53b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.846190 3278 raft_consensus.cc:3054] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.846241 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 33da9827f4a5477aa977dbb8e982f5ff (table default.Table_a4d16a50840d4ae08a0942fbfa5d5644 [id=1d766421e2be4d92b84d436c65506229]) successfully deleted
I20250115 10:11:52.846314 3908 raft_consensus.cc:357] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.846385 3908 raft_consensus.cc:383] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.846406 3908 raft_consensus.cc:738] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.846449 3908 consensus_queue.cc:260] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.846534 3908 ts_tablet_manager.cc:1428] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.846599 3908 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.846949 3278 raft_consensus.cc:2463] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.847064 3908 tablet_bootstrap.cc:654] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.847438 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efdfc58cbb4c4d85880fe8d1ddd4a53b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.847508 3414 raft_consensus.cc:3054] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.847504 3485 leader_election.cc:304] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.845374 3913 leader_election.cc:290] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.847613 3913 raft_consensus.cc:2798] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.847653 3913 raft_consensus.cc:695] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.847692 3913 consensus_queue.cc:237] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.846195 3915 ts_tablet_manager.cc:1428] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.847786 3915 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.848198 3915 tablet_bootstrap.cc:654] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.848299 3414 raft_consensus.cc:2463] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.848299 3098 catalog_manager.cc:5526] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.849202 3908 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.849246 3908 ts_tablet_manager.cc:1397] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:52.849375 3908 raft_consensus.cc:357] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.849443 3908 raft_consensus.cc:383] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.849493 3908 raft_consensus.cc:738] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.849535 3908 consensus_queue.cc:260] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.849643 3908 ts_tablet_manager.cc:1428] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.849700 3908 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.850101 3908 tablet_bootstrap.cc:654] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.845479 3910 ts_tablet_manager.cc:1428] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.850718 3910 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.851136 3910 tablet_bootstrap.cc:654] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.851652 3910 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.851747 3910 ts_tablet_manager.cc:1397] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.851938 3910 raft_consensus.cc:357] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.852010 3910 raft_consensus.cc:383] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.852032 3910 raft_consensus.cc:738] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.852102 3910 consensus_queue.cc:260] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.852217 3910 ts_tablet_manager.cc:1428] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.852293 3910 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.852702 3910 tablet_bootstrap.cc:654] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.853331 3910 tablet_bootstrap.cc:492] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.853379 3910 ts_tablet_manager.cc:1397] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.853547 3910 raft_consensus.cc:357] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.853590 3910 raft_consensus.cc:383] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.853603 3910 raft_consensus.cc:738] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.853639 3910 consensus_queue.cc:260] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.853849 3910 ts_tablet_manager.cc:1428] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.853948 3910 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.854708 3910 tablet_bootstrap.cc:654] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.855270 3910 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.855314 3910 ts_tablet_manager.cc:1397] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:52.855438 3910 raft_consensus.cc:357] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.855481 3910 raft_consensus.cc:383] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.855504 3910 raft_consensus.cc:738] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.855564 3910 consensus_queue.cc:260] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.855654 3910 ts_tablet_manager.cc:1428] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.856329 3912 raft_consensus.cc:491] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.856384 3912 raft_consensus.cc:513] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.856482 3912 leader_election.cc:290] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.856608 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde2b3ba3d834a55aacac680c4c2a3a8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.856693 3414 raft_consensus.cc:2463] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.856665 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde2b3ba3d834a55aacac680c4c2a3a8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.856753 3278 raft_consensus.cc:2463] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.856873 3484 leader_election.cc:304] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.856972 3912 raft_consensus.cc:2798] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.857005 3912 raft_consensus.cc:491] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.857023 3912 raft_consensus.cc:3054] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.857645 3912 raft_consensus.cc:513] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.857764 3912 leader_election.cc:290] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.857884 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde2b3ba3d834a55aacac680c4c2a3a8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.857950 3278 raft_consensus.cc:3054] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.858000 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dde2b3ba3d834a55aacac680c4c2a3a8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.858084 3414 raft_consensus.cc:3054] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.862576 3952 raft_consensus.cc:491] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.862632 3952 raft_consensus.cc:513] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.862800 3952 leader_election.cc:290] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.862926 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a8681daa9b459ba85dea9410d83256" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.862941 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a8681daa9b459ba85dea9410d83256" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.863000 3415 raft_consensus.cc:2463] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.863004 3550 raft_consensus.cc:2463] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.863165 3214 leader_election.cc:304] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.863286 3952 raft_consensus.cc:2798] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.863327 3952 raft_consensus.cc:491] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.863353 3952 raft_consensus.cc:3054] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.871918 3915 tablet_bootstrap.cc:492] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.871933 3908 tablet_bootstrap.cc:492] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.871985 3915 ts_tablet_manager.cc:1397] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.001s
I20250115 10:11:52.871985 3908 ts_tablet_manager.cc:1397] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.000s
I20250115 10:11:52.872146 3908 raft_consensus.cc:357] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.872148 3915 raft_consensus.cc:357] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.872197 3908 raft_consensus.cc:383] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.872201 3915 raft_consensus.cc:383] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.872215 3908 raft_consensus.cc:738] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.872221 3915 raft_consensus.cc:738] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.872259 3908 consensus_queue.cc:260] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.872264 3915 consensus_queue.cc:260] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.872361 3908 ts_tablet_manager.cc:1428] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.872375 3915 ts_tablet_manager.cc:1428] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.872452 3908 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.872534 3414 raft_consensus.cc:2463] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.872537 3952 raft_consensus.cc:513] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.872642 3952 leader_election.cc:290] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.872841 3484 leader_election.cc:304] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.872907 3908 tablet_bootstrap.cc:654] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.873062 3912 raft_consensus.cc:2798] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.873129 3912 raft_consensus.cc:695] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.873196 3912 consensus_queue.cc:237] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.873288 3278 raft_consensus.cc:2463] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.873520 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a8681daa9b459ba85dea9410d83256" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.873580 3414 raft_consensus.cc:3054] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.874253 3414 raft_consensus.cc:2463] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.874563 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01a8681daa9b459ba85dea9410d83256" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.874631 3550 raft_consensus.cc:3054] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.874828 3214 leader_election.cc:304] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.874910 3770 raft_consensus.cc:2798] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.874944 3770 raft_consensus.cc:695] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.874981 3770 consensus_queue.cc:237] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.874917 3092 catalog_manager.cc:5526] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.875171 3908 tablet_bootstrap.cc:492] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.875211 3908 ts_tablet_manager.cc:1397] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:52.875347 3908 raft_consensus.cc:357] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.875411 3908 raft_consensus.cc:383] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.875433 3908 raft_consensus.cc:738] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.875438 3550 raft_consensus.cc:2463] T 01a8681daa9b459ba85dea9410d83256 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.875474 3908 consensus_queue.cc:260] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.875581 3908 ts_tablet_manager.cc:1428] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.876703 3098 catalog_manager.cc:5526] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.889029 3663 raft_consensus.cc:491] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.889110 3663 raft_consensus.cc:513] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.889242 3663 leader_election.cc:290] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.889428 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.889442 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.889509 3278 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.889536 3550 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.889679 3350 leader_election.cc:304] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.889787 3663 raft_consensus.cc:2798] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.889832 3663 raft_consensus.cc:491] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.889853 3663 raft_consensus.cc:3054] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.890378 3663 raft_consensus.cc:513] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.890486 3663 leader_election.cc:290] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.890650 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.890641 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.890712 3550 raft_consensus.cc:3054] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.890710 3278 raft_consensus.cc:3054] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.891227 3550 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.891369 3278 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.891382 3350 leader_election.cc:304] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.891517 3663 raft_consensus.cc:2798] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.891562 3663 raft_consensus.cc:695] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:52.891613 3663 consensus_queue.cc:237] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.892285 3098 catalog_manager.cc:5526] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.900363 3952 raft_consensus.cc:491] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.900440 3952 raft_consensus.cc:513] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.900544 3952 leader_election.cc:290] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.900671 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4dc0c74f2e43db8b87446a236771f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.900672 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4dc0c74f2e43db8b87446a236771f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.900724 3550 raft_consensus.cc:2463] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.900733 3414 raft_consensus.cc:2463] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.900831 3215 leader_election.cc:304] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.900964 3952 raft_consensus.cc:2798] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.901003 3952 raft_consensus.cc:491] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.901024 3952 raft_consensus.cc:3054] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.901579 3952 raft_consensus.cc:513] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.901697 3952 leader_election.cc:290] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.901880 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4dc0c74f2e43db8b87446a236771f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.901890 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f4dc0c74f2e43db8b87446a236771f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.901934 3414 raft_consensus.cc:3054] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.901947 3550 raft_consensus.cc:3054] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.902477 3414 raft_consensus.cc:2463] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.902518 3550 raft_consensus.cc:2463] T 0f4dc0c74f2e43db8b87446a236771f2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.902637 3214 leader_election.cc:304] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.902751 3952 raft_consensus.cc:2798] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.902813 3952 raft_consensus.cc:695] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.902877 3952 consensus_queue.cc:237] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.903578 3098 catalog_manager.cc:5526] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.924345 3663 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.924433 3663 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.924578 3663 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.924791 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.924798 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.924875 3550 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.924883 3278 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.925043 3350 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.925194 3663 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.925240 3663 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.925261 3663 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.925830 3663 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.925949 3663 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.926096 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.926118 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.926182 3550 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.926182 3278 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.926836 3278 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.926836 3550 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.927004 3350 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.927073 3663 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.927136 3663 raft_consensus.cc:695] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:52.927186 3663 consensus_queue.cc:237] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.928364 3098 catalog_manager.cc:5526] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.939520 3663 raft_consensus.cc:491] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.939584 3663 raft_consensus.cc:513] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.939744 3663 leader_election.cc:290] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.939908 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.939904 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.939975 3278 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.939978 3550 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:52.940085 3350 leader_election.cc:304] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.940172 3663 raft_consensus.cc:2798] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.940219 3663 raft_consensus.cc:491] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.940236 3663 raft_consensus.cc:3054] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.940732 3663 raft_consensus.cc:513] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.940831 3663 leader_election.cc:290] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:52.941071 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.941062 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.941135 3278 raft_consensus.cc:3054] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.941135 3550 raft_consensus.cc:3054] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.941799 3550 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.941799 3278 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:52.941979 3350 leader_election.cc:304] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.942059 3663 raft_consensus.cc:2798] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.942107 3663 raft_consensus.cc:695] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:52.942155 3663 consensus_queue.cc:237] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:52.942924 3098 catalog_manager.cc:5526] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.962116 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c2066f707d4641f6bba1f894369fc58d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.962280 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2066f707d4641f6bba1f894369fc58d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.962786 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4daaab8a6db143a6a3c6e591553bdddc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:52.962881 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_59c103a185524c3f9aaab71834303868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.962996 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59c103a185524c3f9aaab71834303868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:52.962893 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4daaab8a6db143a6a3c6e591553bdddc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.963495 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bad0fd4bb1804efa99363b6fb5b93491"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.963587 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bad0fd4bb1804efa99363b6fb5b93491 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.965687 3521 tablet_service.cc:1467] Processing CreateTablet for tablet c3f88d5d54b74f63a94bf88d3a33cfae (DEFAULT_TABLE table=default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.965842 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f88d5d54b74f63a94bf88d3a33cfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.965813 3383 tablet_service.cc:1467] Processing CreateTablet for tablet c3f88d5d54b74f63a94bf88d3a33cfae (DEFAULT_TABLE table=default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.965922 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f88d5d54b74f63a94bf88d3a33cfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.966825 3952 raft_consensus.cc:491] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.966883 3952 raft_consensus.cc:513] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.967054 3910 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.967115 3253 tablet_service.cc:1467] Processing CreateTablet for tablet c3f88d5d54b74f63a94bf88d3a33cfae (DEFAULT_TABLE table=default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.967228 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f88d5d54b74f63a94bf88d3a33cfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.967489 3910 tablet_bootstrap.cc:654] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.967818 3952 leader_election.cc:290] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.968070 3910 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.968115 3910 ts_tablet_manager.cc:1397] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.968199 3915 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.968207 3908 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.968291 3910 raft_consensus.cc:357] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.968348 3910 raft_consensus.cc:383] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.968364 3910 raft_consensus.cc:738] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.968405 3910 consensus_queue.cc:260] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.968487 3910 ts_tablet_manager.cc:1428] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.968605 3908 tablet_bootstrap.cc:654] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.968750 3915 tablet_bootstrap.cc:654] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.969295 3908 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.969343 3908 ts_tablet_manager.cc:1397] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.969496 3908 raft_consensus.cc:357] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.969552 3908 raft_consensus.cc:383] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.969569 3908 raft_consensus.cc:738] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.969600 3908 consensus_queue.cc:260] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.969673 3908 ts_tablet_manager.cc:1428] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.969933 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (DEFAULT_TABLE table=default.Table_c2066f707d4641f6bba1f894369fc58d [id=336af606a29d472799f85c1a69021bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.969969 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 4db40559d7894bb8b80cf27b546c8f56 (DEFAULT_TABLE table=default.Table_bad0fd4bb1804efa99363b6fb5b93491 [id=db9639c2422847d29930bd7ce722f244]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970028 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab77abe34374a6ba6f30bf3a2bd67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.970042 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d83cd673a6ae402e9d2139946c066c5b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.970098 3414 raft_consensus.cc:2463] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.970131 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (DEFAULT_TABLE table=default.Table_c2066f707d4641f6bba1f894369fc58d [id=336af606a29d472799f85c1a69021bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970161 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 4db40559d7894bb8b80cf27b546c8f56 (DEFAULT_TABLE table=default.Table_bad0fd4bb1804efa99363b6fb5b93491 [id=db9639c2422847d29930bd7ce722f244]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970206 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab77abe34374a6ba6f30bf3a2bd67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.970417 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (DEFAULT_TABLE table=default.Table_c2066f707d4641f6bba1f894369fc58d [id=336af606a29d472799f85c1a69021bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970484 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 4db40559d7894bb8b80cf27b546c8f56 (DEFAULT_TABLE table=default.Table_bad0fd4bb1804efa99363b6fb5b93491 [id=db9639c2422847d29930bd7ce722f244]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970553 3258 tablet_service.cc:1467] Processing CreateTablet for tablet f792ae7d54184207825a92d72bc5a323 (DEFAULT_TABLE table=default.Table_59c103a185524c3f9aaab71834303868 [id=3b158ca8be84467289e8efbfdd4e20f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.970505 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab77abe34374a6ba6f30bf3a2bd67de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.970602 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db40559d7894bb8b80cf27b546c8f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.971343 3385 tablet_service.cc:1467] Processing CreateTablet for tablet f792ae7d54184207825a92d72bc5a323 (DEFAULT_TABLE table=default.Table_59c103a185524c3f9aaab71834303868 [id=3b158ca8be84467289e8efbfdd4e20f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.971416 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792ae7d54184207825a92d72bc5a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.971500 3910 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.971760 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db40559d7894bb8b80cf27b546c8f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.971817 3524 tablet_service.cc:1467] Processing CreateTablet for tablet f792ae7d54184207825a92d72bc5a323 (DEFAULT_TABLE table=default.Table_59c103a185524c3f9aaab71834303868 [id=3b158ca8be84467289e8efbfdd4e20f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:52.971869 3702 raft_consensus.cc:491] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:52.971926 3702 raft_consensus.cc:513] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.972041 3702 leader_election.cc:290] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.972046 3214 leader_election.cc:304] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.972023 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d83cd673a6ae402e9d2139946c066c5b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:52.972162 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792ae7d54184207825a92d72bc5a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.972189 3550 raft_consensus.cc:2463] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:52.972335 3952 raft_consensus.cc:2798] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.972365 3952 raft_consensus.cc:491] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.972381 3952 raft_consensus.cc:3054] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.972793 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3f88d5d54b74f63a94bf88d3a33cfae" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:52.972864 3414 raft_consensus.cc:2463] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:52.972975 3908 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.972949 3952 raft_consensus.cc:513] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.973048 3952 leader_election.cc:290] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:52.971891 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f792ae7d54184207825a92d72bc5a323. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.973286 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3f88d5d54b74f63a94bf88d3a33cfae" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:52.973335 3908 tablet_bootstrap.cc:654] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:52.973484 3485 leader_election.cc:343] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:11:52.973747 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db40559d7894bb8b80cf27b546c8f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:52.973791 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d83cd673a6ae402e9d2139946c066c5b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.973856 3414 raft_consensus.cc:3054] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.974411 3414 raft_consensus.cc:2463] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.974473 3484 leader_election.cc:304] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:11:52.974603 3702 raft_consensus.cc:2798] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:52.974637 3702 raft_consensus.cc:491] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:52.974668 3702 raft_consensus.cc:3054] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.974938 3214 leader_election.cc:304] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:52.975026 3952 raft_consensus.cc:2798] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.975065 3952 raft_consensus.cc:695] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:52.975101 3952 consensus_queue.cc:237] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.975261 3702 raft_consensus.cc:513] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.975373 3702 leader_election.cc:290] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:52.975476 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d83cd673a6ae402e9d2139946c066c5b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:52.975517 3550 raft_consensus.cc:3054] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.976011 3100 catalog_manager.cc:5526] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:52.976125 3100 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]). Expected version 1 got 0
I20250115 10:11:52.976131 3550 raft_consensus.cc:2463] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:52.976145 3915 tablet_bootstrap.cc:492] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.976187 3915 ts_tablet_manager.cc:1397] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:11:52.976354 3915 raft_consensus.cc:357] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.976397 3915 raft_consensus.cc:383] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.976409 3915 raft_consensus.cc:738] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.976444 3915 consensus_queue.cc:260] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.976540 3915 ts_tablet_manager.cc:1428] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.976600 3915 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.971930 3910 tablet_bootstrap.cc:654] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.976939 3915 tablet_bootstrap.cc:654] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.977341 3910 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.977383 3910 ts_tablet_manager.cc:1397] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:11:52.977422 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3f88d5d54b74f63a94bf88d3a33cfae" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:52.977475 3414 raft_consensus.cc:3054] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.977581 3910 raft_consensus.cc:357] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.977641 3910 raft_consensus.cc:383] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.977661 3910 raft_consensus.cc:738] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.977696 3910 consensus_queue.cc:260] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.977823 3910 ts_tablet_manager.cc:1428] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:52.977880 3414 raft_consensus.cc:2463] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.977898 3910 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.978235 3915 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.978269 3915 ts_tablet_manager.cc:1397] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:52.978401 3915 raft_consensus.cc:357] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.978447 3915 raft_consensus.cc:383] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.978475 3915 raft_consensus.cc:738] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.978286 3910 tablet_bootstrap.cc:654] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.978510 3915 consensus_queue.cc:260] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.978590 3915 ts_tablet_manager.cc:1428] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.978628 3915 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.978482 3484 leader_election.cc:304] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:52.978852 3702 raft_consensus.cc:2798] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:52.978888 3702 raft_consensus.cc:695] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:52.978922 3702 consensus_queue.cc:237] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.978965 3915 tablet_bootstrap.cc:654] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.979569 3910 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.979610 3910 ts_tablet_manager.cc:1397] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:52.979743 3915 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.979777 3915 ts_tablet_manager.cc:1397] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:52.979759 3910 raft_consensus.cc:357] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.979815 3910 raft_consensus.cc:383] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.979830 3910 raft_consensus.cc:738] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.979861 3910 consensus_queue.cc:260] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.979907 3915 raft_consensus.cc:357] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.979951 3915 raft_consensus.cc:383] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.979969 3915 raft_consensus.cc:738] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.979981 3910 ts_tablet_manager.cc:1428] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.980005 3915 consensus_queue.cc:260] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.980027 3910 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:52.980075 3915 ts_tablet_manager.cc:1428] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.980114 3915 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:52.980396 3910 tablet_bootstrap.cc:654] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.980952 3908 tablet_bootstrap.cc:492] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.980989 3908 ts_tablet_manager.cc:1397] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:11:52.981088 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_11479444269a4117945edd0028634c29" } modify_external_catalogs: true
I20250115 10:11:52.981125 3908 raft_consensus.cc:357] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.981181 3908 raft_consensus.cc:383] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.981204 3908 raft_consensus.cc:738] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.981185 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_11479444269a4117945edd0028634c29" } modify_external_catalogs: true
I20250115 10:11:52.981213 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b5eda0ed1b124fdabbb33656f6b3eece" } new_table_name: "default.Table_8188fd66d87540ba91dfa4cae707dc68" modify_external_catalogs: true
I20250115 10:11:52.981242 3908 consensus_queue.cc:260] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.981326 3908 ts_tablet_manager.cc:1428] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.981375 3908 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.981402 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c2066f707d4641f6bba1f894369fc58d" } new_table_name: "default.Table_4adcd3081b6b4e4d9c26572586305fe5" modify_external_catalogs: true
I20250115 10:11:52.981184 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2c41014de7a04fffb7bcba7f119579f3" } modify_external_catalogs: true
I20250115 10:11:52.981719 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2c41014de7a04fffb7bcba7f119579f3" } modify_external_catalogs: true
I20250115 10:11:52.981776 3908 tablet_bootstrap.cc:654] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.982070 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd1eae72a80c4c70bcd2320317acaaf3" } new_table_name: "default.Table_df0e2c0ea73e40f480f5bcad442866b9" modify_external_catalogs: true
I20250115 10:11:52.982250 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_43716352b9c4495ba22250ef039e268d" } modify_external_catalogs: true
I20250115 10:11:52.982296 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_43716352b9c4495ba22250ef039e268d" } modify_external_catalogs: true
I20250115 10:11:52.982470 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bad0fd4bb1804efa99363b6fb5b93491" } new_table_name: "default.Table_9bef498958184c8595bc50e15f924293" modify_external_catalogs: true
I20250115 10:11:52.982640 3101 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a4d16a50840d4ae08a0942fbfa5d5644" } new_table_name: "default.Table_74dbe28e3a4f4af69edff5bbb4beae07" modify_external_catalogs: true
I20250115 10:11:52.982746 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7d3a239a65543aebe02588904f8323b" } modify_external_catalogs: true
I20250115 10:11:52.983017 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7d3a239a65543aebe02588904f8323b" } modify_external_catalogs: true
I20250115 10:11:52.983114 3100 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet dde2b3ba3d834a55aacac680c4c2a3a8
I20250115 10:11:52.983182 3100 master_service.cc:946] ReplaceTablet: received request to replace tablet fd018dc2d7f644339b5feba799d3bdd7 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.983425 3915 tablet_bootstrap.cc:654] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.983592 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.983675 3914 tablet_replica.cc:331] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.983745 3914 raft_consensus.cc:2238] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.983783 3914 raft_consensus.cc:2267] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.983775 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.983798 3280 raft_consensus.cc:1270] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.983907 3909 tablet_replica.cc:331] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.983971 3909 raft_consensus.cc:2238] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.983970 3914 ts_tablet_manager.cc:1905] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.984014 3909 pending_rounds.cc:62] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:11:52.984031 3909 pending_rounds.cc:69] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489499128471552 op_type: NO_OP noop_request { }
I20250115 10:11:52.984061 3909 raft_consensus.cc:2883] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.984079 3909 raft_consensus.cc:2267] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.984143 3912 consensus_queue.cc:1035] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.984213 3414 raft_consensus.cc:1270] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:52.984278 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet dde2b3ba3d834a55aacac680c4c2a3a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.984513 3912 consensus_queue.cc:1035] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:52.984730 3908 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.984743 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet 5a789dbdecae4df287752bc6bac1f84e from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.984778 3908 ts_tablet_manager.cc:1397] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:52.984912 3908 raft_consensus.cc:357] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:11:52.984948 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3ab77abe34374a6ba6f30bf3a2bd67de consensus state has no leader
I20250115 10:11:52.984962 3908 raft_consensus.cc:383] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.984984 3908 raft_consensus.cc:738] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.985029 3908 consensus_queue.cc:260] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.985071 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f5ff35b2ad144eccb4ae8f6d91a1e17b
I20250115 10:11:52.985112 3908 ts_tablet_manager.cc:1428] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.985162 3908 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:52.985313 3909 ts_tablet_manager.cc:1905] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.985414 3914 ts_tablet_manager.cc:1918] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.985452 3914 log.cc:1198] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/dde2b3ba3d834a55aacac680c4c2a3a8
I20250115 10:11:52.985474 3095 catalog_manager.cc:5526] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:52.985563 3908 tablet_bootstrap.cc:654] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:52.985605 3914 ts_tablet_manager.cc:1939] T dde2b3ba3d834a55aacac680c4c2a3a8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.985746 3907 tablet_replica.cc:331] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.985796 3907 raft_consensus.cc:2238] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.985823 3907 raft_consensus.cc:2267] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.985998 3907 ts_tablet_manager.cc:1905] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.986521 3915 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:52.986588 3915 ts_tablet_manager.cc:1397] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:11:52.986701 3915 raft_consensus.cc:357] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.986734 3915 raft_consensus.cc:383] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.986745 3915 raft_consensus.cc:738] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.986797 3915 consensus_queue.cc:260] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.986903 3915 ts_tablet_manager.cc:1428] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.986958 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet dde2b3ba3d834a55aacac680c4c2a3a8 (table default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]) successfully deleted
I20250115 10:11:52.987082 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.987272 3253 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.987344 3914 tablet_replica.cc:331] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.987350 3907 ts_tablet_manager.cc:1918] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.987396 3914 raft_consensus.cc:2238] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.987383 3911 mvcc.cc:204] Tried to move back new op lower bound from 7114489499579101184 to 7114489498652319744. Current Snapshot: MvccSnapshot[applied={T|T < 7114489499579101184}]
I20250115 10:11:52.987399 3907 log.cc:1198] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/dde2b3ba3d834a55aacac680c4c2a3a8
I20250115 10:11:52.987426 3914 raft_consensus.cc:2267] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.987442 3917 tablet.cc:1721] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.987562 3907 ts_tablet_manager.cc:1939] T dde2b3ba3d834a55aacac680c4c2a3a8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:52.987911 3914 ts_tablet_manager.cc:1905] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.988384 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62778323bccc4e0dadeb79d6ee19d090" } modify_external_catalogs: true
I20250115 10:11:52.988392 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ff35b2ad144eccb4ae8f6d91a1e17b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.988442 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62778323bccc4e0dadeb79d6ee19d090" } modify_external_catalogs: true
I20250115 10:11:52.989104 3922 tablet.cc:1721] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.989336 3914 ts_tablet_manager.cc:1918] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.989401 3914 log.cc:1198] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f5ff35b2ad144eccb4ae8f6d91a1e17b
I20250115 10:11:52.989560 3914 ts_tablet_manager.cc:1939] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.989619 3919 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.989944 3908 tablet_bootstrap.cc:492] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:52.989979 3908 ts_tablet_manager.cc:1397] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:11:52.990098 3908 raft_consensus.cc:357] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.990161 3908 raft_consensus.cc:383] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.990180 3908 raft_consensus.cc:738] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.990202 3907 tablet_replica.cc:331] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.990274 3907 raft_consensus.cc:2238] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.990306 3907 raft_consensus.cc:2267] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.990204 3908 consensus_queue.cc:260] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.990537 3908 ts_tablet_manager.cc:1428] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:52.990653 3923 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.990814 3907 ts_tablet_manager.cc:1905] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.991036 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (table default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]) successfully deleted
I20250115 10:11:52.991259 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet dde2b3ba3d834a55aacac680c4c2a3a8 (table default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]) successfully deleted
I20250115 10:11:52.991766 3921 tablet.cc:1721] T 4839f8e0539d468ea11077d48f8f8266 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:11:52.992173 3907 ts_tablet_manager.cc:1918] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.992230 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet efdfc58cbb4c4d85880fe8d1ddd4a53b
I20250115 10:11:52.992259 3907 log.cc:1198] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f5ff35b2ad144eccb4ae8f6d91a1e17b
I20250115 10:11:52.992341 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet 5187f117222048bc8b775bd98f632aea from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:52.992467 3907 ts_tablet_manager.cc:1939] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
W20250115 10:11:52.992568 3101 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5779ec7816cd499ebe46962e29092a70 consensus state has no leader
I20250115 10:11:52.992633 3101 master_service.cc:946] ReplaceTablet: received request to replace tablet efdfc58cbb4c4d85880fe8d1ddd4a53b from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:52.992689 3096 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4db40559d7894bb8b80cf27b546c8f56 consensus state has no leader
I20250115 10:11:52.993002 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.993078 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.993151 3914 tablet_replica.cc:331] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.993188 3914 raft_consensus.cc:2238] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.993206 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (table default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]) successfully deleted
I20250115 10:11:52.993228 3914 raft_consensus.cc:2267] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.993280 3100 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet fd018dc2d7f644339b5feba799d3bdd7
I20250115 10:11:52.993346 3100 catalog_manager.cc:6596] ReplaceTablet: tablet fd018dc2d7f644339b5feba799d3bdd7 deleted and replaced by tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:52.993374 3914 ts_tablet_manager.cc:1905] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.993659 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 3096adefffe04e008f58ecba3c3dd633) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.993780 3907 tablet_replica.cc:331] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:52.993860 3907 raft_consensus.cc:2238] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.994040 3909 ts_tablet_manager.cc:1918] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:52.994086 3909 log.cc:1198] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/dde2b3ba3d834a55aacac680c4c2a3a8
I20250115 10:11:52.994287 3909 ts_tablet_manager.cc:1939] T dde2b3ba3d834a55aacac680c4c2a3a8 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.994516 3909 tablet_replica.cc:331] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.994536 3914 ts_tablet_manager.cc:1918] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.994575 3914 log.cc:1198] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/efdfc58cbb4c4d85880fe8d1ddd4a53b
I20250115 10:11:52.994580 3909 raft_consensus.cc:2238] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.994616 3909 raft_consensus.cc:2267] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.994612 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet dde2b3ba3d834a55aacac680c4c2a3a8 (table default.Table_11479444269a4117945edd0028634c29 [id=7baad2684f434940aff80f75fa6933b6]) successfully deleted
I20250115 10:11:52.994685 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3f88d5d54b74f63a94bf88d3a33cfae" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:52.994738 3914 ts_tablet_manager.cc:1939] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.994762 3907 raft_consensus.cc:2267] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.995182 3909 ts_tablet_manager.cc:1905] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.995313 3907 ts_tablet_manager.cc:1905] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.995524 3097 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f509f1b315544adca69617d12c71d277
I20250115 10:11:52.995801 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet efdfc58cbb4c4d85880fe8d1ddd4a53b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.995900 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 5a789dbdecae4df287752bc6bac1f84e
I20250115 10:11:52.995967 3094 catalog_manager.cc:6596] ReplaceTablet: tablet 5a789dbdecae4df287752bc6bac1f84e deleted and replaced by tablet f889cc1201404c8691bf01256750e244
I20250115 10:11:52.995980 3910 tablet_bootstrap.cc:492] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:52.996018 3910 ts_tablet_manager.cc:1397] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250115 10:11:52.996100 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 5187f117222048bc8b775bd98f632aea
I20250115 10:11:52.996148 3093 catalog_manager.cc:6596] ReplaceTablet: tablet 5187f117222048bc8b775bd98f632aea deleted and replaced by tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:52.996161 3910 raft_consensus.cc:357] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.996217 3910 raft_consensus.cc:383] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:52.996232 3910 raft_consensus.cc:738] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:52.996266 3910 consensus_queue.cc:260] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:52.996340 3910 ts_tablet_manager.cc:1428] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:52.996405 3909 ts_tablet_manager.cc:1918] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:52.996452 3909 log.cc:1198] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f5ff35b2ad144eccb4ae8f6d91a1e17b
I20250115 10:11:52.996615 3909 ts_tablet_manager.cc:1939] T f5ff35b2ad144eccb4ae8f6d91a1e17b P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:52.996723 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 3096adefffe04e008f58ecba3c3dd633) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.996817 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet fd018dc2d7f644339b5feba799d3bdd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 3096adefffe04e008f58ecba3c3dd633) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.996991 3914 tablet_replica.cc:331] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:52.997045 3914 raft_consensus.cc:2238] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:52.997080 3914 raft_consensus.cc:2267] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.994746 3278 raft_consensus.cc:3054] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:52.997356 3914 ts_tablet_manager.cc:1905] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.997437 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_71fadfa7b3fc4592bf0079c6081de706"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.997538 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71fadfa7b3fc4592bf0079c6081de706 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.997781 3278 raft_consensus.cc:2463] T c3f88d5d54b74f63a94bf88d3a33cfae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:52.997752 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_24943961f2504c878a6fc91847c54607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:52.997864 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24943961f2504c878a6fc91847c54607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:52.997946 3909 tablet_replica.cc:331] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:52.997994 3909 raft_consensus.cc:2238] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:52.998042 3909 pending_rounds.cc:62] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:11:52.998062 3909 pending_rounds.cc:69] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489499023892480 op_type: NO_OP noop_request { }
I20250115 10:11:52.998114 3909 raft_consensus.cc:2883] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:52.998143 3909 raft_consensus.cc:2267] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:52.998196 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 5187f117222048bc8b775bd98f632aea with delete_type TABLET_DATA_DELETED (replaced by tablet 2377c27855a64ac7bec95a6d6c5289af) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.998215 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d83cd673a6ae402e9d2139946c066c5b
I20250115 10:11:52.998301 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a789dbdecae4df287752bc6bac1f84e with delete_type TABLET_DATA_DELETED (replaced by tablet f889cc1201404c8691bf01256750e244) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.998355 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet f509f1b315544adca69617d12c71d277 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.998507 3914 ts_tablet_manager.cc:1918] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:52.998558 3914 log.cc:1198] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/fd018dc2d7f644339b5feba799d3bdd7
I20250115 10:11:52.998646 3385 tablet_service.cc:1514] Processing DeleteTablet for tablet d83cd673a6ae402e9d2139946c066c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:52.998750 3914 ts_tablet_manager.cc:1939] T fd018dc2d7f644339b5feba799d3bdd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:52.999075 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (table default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]) successfully deleted
I20250115 10:11:52.999133 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f5ff35b2ad144eccb4ae8f6d91a1e17b (table default.Table_2c41014de7a04fffb7bcba7f119579f3 [id=65ebb27dfc5d4f3c8145ef5f0c7749b0]) successfully deleted
I20250115 10:11:52.999119 3919 tablet.cc:1721] T 4f559e7cafb04ae39af12e7681bbaf24 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:52.999181 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet f509f1b315544adca69617d12c71d277 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.999209 3524 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a789dbdecae4df287752bc6bac1f84e with delete_type TABLET_DATA_DELETED (replaced by tablet f889cc1201404c8691bf01256750e244) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.999274 3529 tablet_service.cc:1514] Processing DeleteTablet for tablet d83cd673a6ae402e9d2139946c066c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.999445 3909 ts_tablet_manager.cc:1905] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:52.999464 3256 tablet_service.cc:1514] Processing DeleteTablet for tablet 5187f117222048bc8b775bd98f632aea with delete_type TABLET_DATA_DELETED (replaced by tablet 2377c27855a64ac7bec95a6d6c5289af) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.999519 3248 tablet_service.cc:1514] Processing DeleteTablet for tablet d83cd673a6ae402e9d2139946c066c5b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.999770 3253 tablet_service.cc:1514] Processing DeleteTablet for tablet 5a789dbdecae4df287752bc6bac1f84e with delete_type TABLET_DATA_DELETED (replaced by tablet f889cc1201404c8691bf01256750e244) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:52.999788 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 5187f117222048bc8b775bd98f632aea with delete_type TABLET_DATA_DELETED (replaced by tablet 2377c27855a64ac7bec95a6d6c5289af) from {username='slave'} at 127.0.0.1:40142
I20250115 10:11:52.999828 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet f509f1b315544adca69617d12c71d277 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:52 UTC) from {username='slave'} at 127.0.0.1:50454
I20250115 10:11:53.000550 3914 tablet_replica.cc:331] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:53.000584 3909 ts_tablet_manager.cc:1918] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.000612 3914 raft_consensus.cc:2238] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.000628 3909 log.cc:1198] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/efdfc58cbb4c4d85880fe8d1ddd4a53b
I20250115 10:11:53.000615 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:53.000638 3914 raft_consensus.cc:2267] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.000814 3909 ts_tablet_manager.cc:1939] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.000857 3914 ts_tablet_manager.cc:1905] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.001183 3909 tablet_replica.cc:331] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:53.001241 3909 raft_consensus.cc:2238] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:53.001232 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (table default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]) successfully deleted
I20250115 10:11:53.001292 3909 raft_consensus.cc:2267] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.001736 3909 ts_tablet_manager.cc:1905] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.002455 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:53.002550 3099 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (table default.Table_4adcd3081b6b4e4d9c26572586305fe5 [id=336af606a29d472799f85c1a69021bc6]). Expected version 1 got 0
I20250115 10:11:53.002591 3099 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:53.002925 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 3096adefffe04e008f58ecba3c3dd633 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.002949 3529 tablet_service.cc:1467] Processing CreateTablet for tablet f889cc1201404c8691bf01256750e244 (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.003026 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3096adefffe04e008f58ecba3c3dd633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.003054 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f889cc1201404c8691bf01256750e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.003381 3909 ts_tablet_manager.cc:1918] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.003422 3909 log.cc:1198] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/fd018dc2d7f644339b5feba799d3bdd7
I20250115 10:11:53.003628 3383 tablet_service.cc:1467] Processing CreateTablet for tablet f889cc1201404c8691bf01256750e244 (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.003866 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f889cc1201404c8691bf01256750e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.003979 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_358b4ece271b412c8380fe9634da76af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.004065 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_358b4ece271b412c8380fe9634da76af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.004246 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 2377c27855a64ac7bec95a6d6c5289af (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.002949 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 2377c27855a64ac7bec95a6d6c5289af (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.004344 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2377c27855a64ac7bec95a6d6c5289af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.004367 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2377c27855a64ac7bec95a6d6c5289af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.004755 3914 ts_tablet_manager.cc:1918] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.004797 3914 log.cc:1198] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/5187f117222048bc8b775bd98f632aea
I20250115 10:11:53.004981 3908 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.004999 3915 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.005415 3909 ts_tablet_manager.cc:1939] T fd018dc2d7f644339b5feba799d3bdd7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.005491 3253 tablet_service.cc:1467] Processing CreateTablet for tablet f889cc1201404c8691bf01256750e244 (DEFAULT_TABLE table=default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.005519 3908 tablet_bootstrap.cc:654] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.005578 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f889cc1201404c8691bf01256750e244. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.005653 3909 tablet_replica.cc:331] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:53.005666 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 3096adefffe04e008f58ecba3c3dd633 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.005693 3909 raft_consensus.cc:2238] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.005718 3909 raft_consensus.cc:2267] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.005750 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3096adefffe04e008f58ecba3c3dd633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.004271 3910 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.005936 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 2377c27855a64ac7bec95a6d6c5289af (DEFAULT_TABLE table=default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.006012 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2377c27855a64ac7bec95a6d6c5289af. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.006319 3910 tablet_bootstrap.cc:654] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.006687 3915 tablet_bootstrap.cc:654] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.006780 3910 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.006816 3910 ts_tablet_manager.cc:1397] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:11:53.007045 3910 raft_consensus.cc:357] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.007122 3910 raft_consensus.cc:383] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.007143 3910 raft_consensus.cc:738] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.007133 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 3096adefffe04e008f58ecba3c3dd633 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.007172 3910 consensus_queue.cc:260] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.007211 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3096adefffe04e008f58ecba3c3dd633. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.007275 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_24a1adaaced643af9cea60e94f10b20d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.007378 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24a1adaaced643af9cea60e94f10b20d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.007441 3910 ts_tablet_manager.cc:1428] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.007519 3910 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.007587 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fb1ee264d56d49c3b5ec53a80ac2b790"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.007687 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb1ee264d56d49c3b5ec53a80ac2b790 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.007756 3915 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.007789 3915 ts_tablet_manager.cc:1397] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:53.007944 3915 raft_consensus.cc:357] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.008011 3915 raft_consensus.cc:383] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.008033 3915 raft_consensus.cc:738] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.008033 3910 tablet_bootstrap.cc:654] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.008071 3915 consensus_queue.cc:260] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.008172 3914 ts_tablet_manager.cc:1939] T 5187f117222048bc8b775bd98f632aea P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:53.008193 3915 ts_tablet_manager.cc:1428] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.008253 3915 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.008564 3910 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.008602 3910 ts_tablet_manager.cc:1397] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.008695 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2ed244badf544b6e82fa85ddb3a99f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.008718 3910 raft_consensus.cc:357] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.008761 3910 raft_consensus.cc:383] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.008776 3910 raft_consensus.cc:738] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:11:53.008772 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ed244badf544b6e82fa85ddb3a99f78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.008809 3910 consensus_queue.cc:260] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.008870 3910 ts_tablet_manager.cc:1428] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.008910 3910 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.008399 3914 tablet_replica.cc:331] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:53.009027 3914 raft_consensus.cc:2238] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:53.009171 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:53.009078 3914 pending_rounds.cc:62] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:11:53.009263 3914 pending_rounds.cc:69] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489499546386432 op_type: NO_OP noop_request { }
I20250115 10:11:53.009297 3910 tablet_bootstrap.cc:654] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.009302 3914 raft_consensus.cc:2883] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:53.009326 3914 raft_consensus.cc:2267] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.009500 3909 ts_tablet_manager.cc:1905] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.009716 3907 ts_tablet_manager.cc:1918] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.009758 3907 log.cc:1198] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/fd018dc2d7f644339b5feba799d3bdd7
I20250115 10:11:53.009928 3097 master_service.cc:946] ReplaceTablet: received request to replace tablet efdfc58cbb4c4d85880fe8d1ddd4a53b from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.009960 3907 ts_tablet_manager.cc:1939] T fd018dc2d7f644339b5feba799d3bdd7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.010190 3907 tablet_replica.cc:331] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.008649 3915 tablet_bootstrap.cc:654] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.010263 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet fd018dc2d7f644339b5feba799d3bdd7 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:53.010305 3907 raft_consensus.cc:2238] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.010344 3907 raft_consensus.cc:2267] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.010924 3915 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.010972 3915 ts_tablet_manager.cc:1397] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:53.011194 3914 ts_tablet_manager.cc:1905] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.011286 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7] alter complete (version 1)
I20250115 10:11:53.011811 3909 ts_tablet_manager.cc:1918] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.011881 3909 log.cc:1198] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f509f1b315544adca69617d12c71d277
I20250115 10:11:53.012063 3909 ts_tablet_manager.cc:1939] T f509f1b315544adca69617d12c71d277 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.012373 3915 raft_consensus.cc:357] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.012460 3915 raft_consensus.cc:383] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.012486 3915 raft_consensus.cc:738] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.012535 3915 consensus_queue.cc:260] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.012629 3909 tablet_replica.cc:331] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:53.012637 3915 ts_tablet_manager.cc:1428] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.012687 3909 raft_consensus.cc:2238] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:53.012698 3915 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.012735 3909 pending_rounds.cc:62] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:11:53.012758 3909 pending_rounds.cc:69] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489498432335872 op_type: NO_OP noop_request { }
I20250115 10:11:53.012797 3909 raft_consensus.cc:2883] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:53.012823 3909 raft_consensus.cc:2267] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.013067 3914 ts_tablet_manager.cc:1918] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.010485 3907 ts_tablet_manager.cc:1905] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.013193 3908 tablet_bootstrap.cc:492] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.013243 3908 ts_tablet_manager.cc:1397] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:11:53.012352 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 6034c750d47744ff8eb4d62c7c135ed7 (DEFAULT_TABLE table=default.Table_71fadfa7b3fc4592bf0079c6081de706 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.013366 3908 raft_consensus.cc:357] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.013432 3908 raft_consensus.cc:383] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.013460 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6034c750d47744ff8eb4d62c7c135ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.013460 3908 raft_consensus.cc:738] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.013698 3908 consensus_queue.cc:260] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.013805 3908 ts_tablet_manager.cc:1428] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.013919 3909 ts_tablet_manager.cc:1905] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.014478 3907 ts_tablet_manager.cc:1918] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.013091 3915 tablet_bootstrap.cc:654] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.015084 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f509f1b315544adca69617d12c71d277 (table default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]) successfully deleted
I20250115 10:11:53.015189 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:53.015362 3952 raft_consensus.cc:491] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.015386 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 6034c750d47744ff8eb4d62c7c135ed7 (DEFAULT_TABLE table=default.Table_71fadfa7b3fc4592bf0079c6081de706 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.015404 3909 ts_tablet_manager.cc:1918] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.015410 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 6034c750d47744ff8eb4d62c7c135ed7 (DEFAULT_TABLE table=default.Table_71fadfa7b3fc4592bf0079c6081de706 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.015451 3909 log.cc:1198] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/5a789dbdecae4df287752bc6bac1f84e
I20250115 10:11:53.015475 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6034c750d47744ff8eb4d62c7c135ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.015424 3952 raft_consensus.cc:513] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.015516 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6034c750d47744ff8eb4d62c7c135ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.015595 3952 leader_election.cc:290] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.015659 3909 ts_tablet_manager.cc:1939] T 5a789dbdecae4df287752bc6bac1f84e P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.015353 3914 log.cc:1198] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d83cd673a6ae402e9d2139946c066c5b
I20250115 10:11:53.015904 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d92890d082e242ccae8ad4e40d056c74" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.015964 3550 raft_consensus.cc:2463] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.015970 3914 ts_tablet_manager.cc:1939] T d83cd673a6ae402e9d2139946c066c5b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:53.016012 3909 tablet_replica.cc:331] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:53.016062 3909 raft_consensus.cc:2238] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.016072 3215 leader_election.cc:304] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.016124 3909 raft_consensus.cc:2267] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.016149 3952 raft_consensus.cc:2798] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.016180 3952 raft_consensus.cc:491] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.016202 3952 raft_consensus.cc:3054] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.016783 3952 raft_consensus.cc:513] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.016897 3952 leader_election.cc:290] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.016918 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 5a789dbdecae4df287752bc6bac1f84e (table default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]) successfully deleted
I20250115 10:11:53.017089 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d92890d082e242ccae8ad4e40d056c74" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.017153 3550 raft_consensus.cc:3054] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.017282 3093 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.017343 3914 tablet_replica.cc:331] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:53.017390 3914 raft_consensus.cc:2238] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.017416 3914 raft_consensus.cc:2267] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.017416 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]) successfully deleted
I20250115 10:11:53.014910 3908 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.017758 3550 raft_consensus.cc:2463] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.017863 3908 tablet_bootstrap.cc:654] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.017967 3215 leader_election.cc:304] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.018034 3952 raft_consensus.cc:2798] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.018070 3952 raft_consensus.cc:695] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:53.018108 3910 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.017053 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d92890d082e242ccae8ad4e40d056c74" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.018118 3952 consensus_queue.cc:237] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.018155 3910 ts_tablet_manager.cc:1397] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:11:53.018182 3415 raft_consensus.cc:2463] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.017064 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d92890d082e242ccae8ad4e40d056c74" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.018241 3414 raft_consensus.cc:3054] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.018306 3910 raft_consensus.cc:357] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.018347 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_df0e2c0ea73e40f480f5bcad442866b9 [id=284816018979468d99f5a23274d90447] alter complete (version 3)
I20250115 10:11:53.018360 3910 raft_consensus.cc:383] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.018378 3910 raft_consensus.cc:738] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.018412 3910 consensus_queue.cc:260] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.018493 3910 ts_tablet_manager.cc:1428] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.018554 3910 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:11:53.018774 3093 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 3096adefffe04e008f58ecba3c3dd633 consensus state has no leader
I20250115 10:11:53.018867 3414 raft_consensus.cc:2463] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.018939 3910 tablet_bootstrap.cc:654] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.019588 3907 log.cc:1198] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/efdfc58cbb4c4d85880fe8d1ddd4a53b
I20250115 10:11:53.019914 3914 ts_tablet_manager.cc:1905] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.020067 3907 ts_tablet_manager.cc:1939] T efdfc58cbb4c4d85880fe8d1ddd4a53b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.020098 3910 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.020135 3910 ts_tablet_manager.cc:1397] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:53.020203 3099 catalog_manager.cc:5526] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:53.020388 3910 raft_consensus.cc:357] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.020443 3910 raft_consensus.cc:383] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.020459 3910 raft_consensus.cc:738] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.020490 3910 consensus_queue.cc:260] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.020560 3910 ts_tablet_manager.cc:1428] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.020644 3907 tablet_replica.cc:331] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.020709 3907 raft_consensus.cc:2238] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.020752 3907 raft_consensus.cc:2267] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.020941 3915 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.020987 3915 ts_tablet_manager.cc:1397] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:11:53.021023 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet efdfc58cbb4c4d85880fe8d1ddd4a53b (table default.Table_43716352b9c4495ba22250ef039e268d [id=e7281b104b34496d8b6e76d15ee3e260]) successfully deleted
I20250115 10:11:53.021178 3915 raft_consensus.cc:357] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.021226 3915 raft_consensus.cc:383] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.021247 3915 raft_consensus.cc:738] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.021376 3915 consensus_queue.cc:260] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.021718 3915 ts_tablet_manager.cc:1428] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.021781 3915 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.021865 3907 ts_tablet_manager.cc:1905] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.022457 3915 tablet_bootstrap.cc:654] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.022686 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
W20250115 10:11:53.022802 3098 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 2377c27855a64ac7bec95a6d6c5289af consensus state has no leader
I20250115 10:11:53.022838 3093 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.022898 3093 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:53.023833 3914 ts_tablet_manager.cc:1918] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.023913 3914 log.cc:1198] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/5a789dbdecae4df287752bc6bac1f84e
I20250115 10:11:53.024119 3914 ts_tablet_manager.cc:1939] T 5a789dbdecae4df287752bc6bac1f84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:53.024546 3914 tablet_replica.cc:331] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:11:53.024634 3914 raft_consensus.cc:2238] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.024623 3093 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.024696 3914 raft_consensus.cc:2267] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.024623 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 5a789dbdecae4df287752bc6bac1f84e (table default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]) successfully deleted
I20250115 10:11:53.023685 3907 ts_tablet_manager.cc:1918] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.024873 3914 ts_tablet_manager.cc:1905] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.024677 3909 ts_tablet_manager.cc:1905] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.025482 3907 log.cc:1198] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5187f117222048bc8b775bd98f632aea
I20250115 10:11:53.025810 3907 ts_tablet_manager.cc:1939] T 5187f117222048bc8b775bd98f632aea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.026283 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:53.026042 3907 tablet_replica.cc:331] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.026625 3907 raft_consensus.cc:2238] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.026693 3907 raft_consensus.cc:2267] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.027387 3907 ts_tablet_manager.cc:1905] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.028259 3914 ts_tablet_manager.cc:1918] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.028318 3914 log.cc:1198] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f509f1b315544adca69617d12c71d277
I20250115 10:11:53.028507 3914 ts_tablet_manager.cc:1939] T f509f1b315544adca69617d12c71d277 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:11:53.028697 3909 ts_tablet_manager.cc:1918] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.028753 3909 log.cc:1198] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d83cd673a6ae402e9d2139946c066c5b
I20250115 10:11:53.028918 3909 ts_tablet_manager.cc:1939] T d83cd673a6ae402e9d2139946c066c5b P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.029102 3087 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f509f1b315544adca69617d12c71d277 (table default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]) successfully deleted
I20250115 10:11:53.029199 3909 tablet_replica.cc:331] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:11:53.029247 3909 raft_consensus.cc:2238] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.029273 3909 raft_consensus.cc:2267] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.029304 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]) successfully deleted
I20250115 10:11:53.029493 3909 ts_tablet_manager.cc:1905] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.029500 3908 tablet_bootstrap.cc:492] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.029562 3908 ts_tablet_manager.cc:1397] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250115 10:11:53.029691 3908 raft_consensus.cc:357] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.029747 3908 raft_consensus.cc:383] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.029767 3908 raft_consensus.cc:738] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.029799 3908 consensus_queue.cc:260] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.029879 3908 ts_tablet_manager.cc:1428] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.029955 3908 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.030356 3908 tablet_bootstrap.cc:654] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.030731 3909 ts_tablet_manager.cc:1918] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.030773 3909 log.cc:1198] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/5187f117222048bc8b775bd98f632aea
I20250115 10:11:53.030917 3909 ts_tablet_manager.cc:1939] T 5187f117222048bc8b775bd98f632aea P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:11:53.031349 3908 tablet_bootstrap.cc:492] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.031394 3908 ts_tablet_manager.cc:1397] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.031415 3087 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 5187f117222048bc8b775bd98f632aea (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:53.031522 3908 raft_consensus.cc:357] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.031581 3908 raft_consensus.cc:383] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.031598 3908 raft_consensus.cc:738] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.031630 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:53.031641 3908 consensus_queue.cc:260] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.032044 3908 ts_tablet_manager.cc:1428] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.032116 3908 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.032471 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.032611 3908 tablet_bootstrap.cc:654] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.033025 3907 ts_tablet_manager.cc:1918] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.033077 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.033110 3907 log.cc:1198] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5a789dbdecae4df287752bc6bac1f84e
I20250115 10:11:53.033324 3908 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.033365 3908 ts_tablet_manager.cc:1397] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.033497 3908 raft_consensus.cc:357] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.033550 3908 raft_consensus.cc:383] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.033566 3908 raft_consensus.cc:738] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.033706 3908 consensus_queue.cc:260] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.033923 3908 ts_tablet_manager.cc:1428] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.034183 3907 ts_tablet_manager.cc:1939] T 5a789dbdecae4df287752bc6bac1f84e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.034469 3907 tablet_replica.cc:331] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.034531 3907 raft_consensus.cc:2238] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.034566 3907 raft_consensus.cc:2267] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.034673 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5a789dbdecae4df287752bc6bac1f84e (table default.Table_e5d23a5647e244c0b5dce7cb47f567da [id=1ac3f51295024b83b64f69df31a970d2]) successfully deleted
I20250115 10:11:53.034854 3907 ts_tablet_manager.cc:1905] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.034899 3915 tablet_bootstrap.cc:492] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.034945 3915 ts_tablet_manager.cc:1397] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:11:53.035123 3915 raft_consensus.cc:357] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.035187 3915 raft_consensus.cc:383] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.035209 3915 raft_consensus.cc:738] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.035254 3915 consensus_queue.cc:260] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.035337 3915 ts_tablet_manager.cc:1428] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.036339 3907 ts_tablet_manager.cc:1918] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.036406 3907 log.cc:1198] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f509f1b315544adca69617d12c71d277
I20250115 10:11:53.036569 3907 ts_tablet_manager.cc:1939] T f509f1b315544adca69617d12c71d277 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.036764 3907 tablet_replica.cc:331] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.036834 3907 raft_consensus.cc:2238] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.036830 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f509f1b315544adca69617d12c71d277 (table default.Table_f7d3a239a65543aebe02588904f8323b [id=75c510ea1ac04ba5a31f62bc15ee13a3]) successfully deleted
I20250115 10:11:53.036885 3907 raft_consensus.cc:2267] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.037021 3907 ts_tablet_manager.cc:1905] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.038125 3907 ts_tablet_manager.cc:1918] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.038194 3907 log.cc:1198] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d83cd673a6ae402e9d2139946c066c5b
I20250115 10:11:53.038347 3907 ts_tablet_manager.cc:1939] T d83cd673a6ae402e9d2139946c066c5b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.038619 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d83cd673a6ae402e9d2139946c066c5b (table default.Table_62778323bccc4e0dadeb79d6ee19d090 [id=3ba55c9ddac44ad98637fa9429ab1e81]) successfully deleted
I20250115 10:11:53.040609 3524 tablet_service.cc:1467] Processing CreateTablet for tablet f9825097e391481da01ad9111c836ec9 (DEFAULT_TABLE table=default.Table_2ed244badf544b6e82fa85ddb3a99f78 [id=de3371776cbd4e0ab430fb426790aa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.040628 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 6e56c83017b54e65a066e8e377293b13 (DEFAULT_TABLE table=default.Table_24a1adaaced643af9cea60e94f10b20d [id=97e1085cf3bc494c8a0a05662b4c2701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.040659 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 7352b551832b40039715e5bf18a31ffb (DEFAULT_TABLE table=default.Table_fb1ee264d56d49c3b5ec53a80ac2b790 [id=5c4fc6ff1dbf4efe9587de2a0c193745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.040678 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 6e56c83017b54e65a066e8e377293b13 (DEFAULT_TABLE table=default.Table_24a1adaaced643af9cea60e94f10b20d [id=97e1085cf3bc494c8a0a05662b4c2701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.040722 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9825097e391481da01ad9111c836ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.040721 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56c83017b54e65a066e8e377293b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.040823 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352b551832b40039715e5bf18a31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.040824 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56c83017b54e65a066e8e377293b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.041772 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 7352b551832b40039715e5bf18a31ffb (DEFAULT_TABLE table=default.Table_fb1ee264d56d49c3b5ec53a80ac2b790 [id=5c4fc6ff1dbf4efe9587de2a0c193745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.041772 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 4727b40e9db4460b826fcc1ca67c9c8f (DEFAULT_TABLE table=default.Table_24943961f2504c878a6fc91847c54607 [id=eefc1fd3a92140409e37f2225e9a4ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.041797 3910 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.041847 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4727b40e9db4460b826fcc1ca67c9c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.041847 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352b551832b40039715e5bf18a31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.042141 3910 tablet_bootstrap.cc:654] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.042690 3910 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.042742 3910 ts_tablet_manager.cc:1397] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.042865 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 4727b40e9db4460b826fcc1ca67c9c8f (DEFAULT_TABLE table=default.Table_24943961f2504c878a6fc91847c54607 [id=eefc1fd3a92140409e37f2225e9a4ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.042901 3910 raft_consensus.cc:357] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.042956 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4727b40e9db4460b826fcc1ca67c9c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.043066 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 13abbfea00154474b1082cf8ccd14899 (DEFAULT_TABLE table=default.Table_358b4ece271b412c8380fe9634da76af [id=2e7d46ae77eb4445ad58baf56cc55cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.042963 3910 raft_consensus.cc:383] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.043120 3910 raft_consensus.cc:738] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.043155 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13abbfea00154474b1082cf8ccd14899. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.043179 3910 consensus_queue.cc:260] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.043291 3910 ts_tablet_manager.cc:1428] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.043356 3910 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.043758 3910 tablet_bootstrap.cc:654] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.044049 3386 tablet_service.cc:1467] Processing CreateTablet for tablet f9825097e391481da01ad9111c836ec9 (DEFAULT_TABLE table=default.Table_2ed244badf544b6e82fa85ddb3a99f78 [id=de3371776cbd4e0ab430fb426790aa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.044117 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 7352b551832b40039715e5bf18a31ffb (DEFAULT_TABLE table=default.Table_fb1ee264d56d49c3b5ec53a80ac2b790 [id=5c4fc6ff1dbf4efe9587de2a0c193745]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.044155 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9825097e391481da01ad9111c836ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.044070 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 13abbfea00154474b1082cf8ccd14899 (DEFAULT_TABLE table=default.Table_358b4ece271b412c8380fe9634da76af [id=2e7d46ae77eb4445ad58baf56cc55cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.040637 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 13abbfea00154474b1082cf8ccd14899 (DEFAULT_TABLE table=default.Table_358b4ece271b412c8380fe9634da76af [id=2e7d46ae77eb4445ad58baf56cc55cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.044212 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13abbfea00154474b1082cf8ccd14899. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.044313 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13abbfea00154474b1082cf8ccd14899. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.044835 3910 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.044905 3910 ts_tablet_manager.cc:1397] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.045045 3910 raft_consensus.cc:357] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.045106 3910 raft_consensus.cc:383] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.045125 3910 raft_consensus.cc:738] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.045163 3910 consensus_queue.cc:260] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.045243 3910 ts_tablet_manager.cc:1428] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.045248 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7352b551832b40039715e5bf18a31ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.045287 3910 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.045302 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 4727b40e9db4460b826fcc1ca67c9c8f (DEFAULT_TABLE table=default.Table_24943961f2504c878a6fc91847c54607 [id=eefc1fd3a92140409e37f2225e9a4ef6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.045377 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4727b40e9db4460b826fcc1ca67c9c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.040639 3253 tablet_service.cc:1467] Processing CreateTablet for tablet f9825097e391481da01ad9111c836ec9 (DEFAULT_TABLE table=default.Table_2ed244badf544b6e82fa85ddb3a99f78 [id=de3371776cbd4e0ab430fb426790aa1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.045608 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9825097e391481da01ad9111c836ec9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.045672 3910 tablet_bootstrap.cc:654] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.046255 3913 raft_consensus.cc:491] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.045255 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 6e56c83017b54e65a066e8e377293b13 (DEFAULT_TABLE table=default.Table_24a1adaaced643af9cea60e94f10b20d [id=97e1085cf3bc494c8a0a05662b4c2701]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.046300 3913 raft_consensus.cc:513] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.046355 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56c83017b54e65a066e8e377293b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.046386 3913 leader_election.cc:290] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:53.046747 3908 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.046964 3910 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.047010 3910 ts_tablet_manager.cc:1397] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.047174 3908 tablet_bootstrap.cc:654] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.047135 3910 raft_consensus.cc:357] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.047199 3910 raft_consensus.cc:383] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.047219 3910 raft_consensus.cc:738] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.047269 3910 consensus_queue.cc:260] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.047361 3910 ts_tablet_manager.cc:1428] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.047412 3910 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.047484 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034c750d47744ff8eb4d62c7c135ed7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.047549 3414 raft_consensus.cc:2463] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.047686 3908 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.047775 3908 ts_tablet_manager.cc:1397] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.047776 3910 tablet_bootstrap.cc:654] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.047850 3915 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.047928 3908 raft_consensus.cc:357] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.047976 3908 raft_consensus.cc:383] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.047991 3908 raft_consensus.cc:738] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.048015 3908 consensus_queue.cc:260] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.048086 3908 ts_tablet_manager.cc:1428] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.048164 3908 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.048169 3484 leader_election.cc:304] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.048281 3915 tablet_bootstrap.cc:654] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.048488 3908 tablet_bootstrap.cc:654] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.048471 3912 raft_consensus.cc:2798] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.048524 3912 raft_consensus.cc:491] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.048548 3912 raft_consensus.cc:3054] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.049192 3912 raft_consensus.cc:513] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.049300 3912 leader_election.cc:290] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:53.049366 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034c750d47744ff8eb4d62c7c135ed7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.049428 3278 raft_consensus.cc:2463] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.049451 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034c750d47744ff8eb4d62c7c135ed7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.049508 3280 raft_consensus.cc:3054] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.049854 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6034c750d47744ff8eb4d62c7c135ed7" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.049929 3414 raft_consensus.cc:3054] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.050077 3280 raft_consensus.cc:2463] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.050252 3910 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.050287 3910 ts_tablet_manager.cc:1397] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:11:53.050416 3910 raft_consensus.cc:357] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.050480 3910 raft_consensus.cc:383] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.050503 3910 raft_consensus.cc:738] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.050521 3414 raft_consensus.cc:2463] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.050539 3910 consensus_queue.cc:260] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.050647 3484 leader_election.cc:304] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.050645 3910 ts_tablet_manager.cc:1428] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.050797 3913 raft_consensus.cc:2798] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.050822 3910 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:11:53.050838 3913 raft_consensus.cc:695] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.050961 3913 consensus_queue.cc:237] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:53.051146 3910 tablet_bootstrap.cc:654] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.051574 3910 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:11:53.051616 3910 ts_tablet_manager.cc:1397] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.051798 3910 raft_consensus.cc:357] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.051852 3910 raft_consensus.cc:383] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.051872 3910 raft_consensus.cc:738] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.051905 3910 consensus_queue.cc:260] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.051848 3098 catalog_manager.cc:5526] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:53.051978 3910 ts_tablet_manager.cc:1428] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.052656 3908 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.052702 3908 ts_tablet_manager.cc:1397] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:11:53.052937 3908 raft_consensus.cc:357] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.052994 3908 raft_consensus.cc:383] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.053011 3908 raft_consensus.cc:738] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.053049 3908 consensus_queue.cc:260] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.053157 3908 ts_tablet_manager.cc:1428] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.053498 3908 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.053903 3908 tablet_bootstrap.cc:654] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.054602 3915 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.054649 3915 ts_tablet_manager.cc:1397] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:11:53.054793 3915 raft_consensus.cc:357] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.054872 3915 raft_consensus.cc:383] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.054899 3915 raft_consensus.cc:738] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.054947 3915 consensus_queue.cc:260] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.055044 3915 ts_tablet_manager.cc:1428] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.055224 3908 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.055261 3908 ts_tablet_manager.cc:1397] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:11:53.055374 3908 raft_consensus.cc:357] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.055423 3908 raft_consensus.cc:383] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.055437 3908 raft_consensus.cc:738] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.055490 3908 consensus_queue.cc:260] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.055577 3908 ts_tablet_manager.cc:1428] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.055663 3915 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.056082 3915 tablet_bootstrap.cc:654] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.056505 3908 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.056870 3908 tablet_bootstrap.cc:654] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.057379 3915 tablet_bootstrap.cc:492] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.057394 3908 tablet_bootstrap.cc:492] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.057425 3915 ts_tablet_manager.cc:1397] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.057425 3908 ts_tablet_manager.cc:1397] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.057554 3915 raft_consensus.cc:357] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.057566 3908 raft_consensus.cc:357] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.057613 3915 raft_consensus.cc:383] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.057613 3908 raft_consensus.cc:383] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.057632 3908 raft_consensus.cc:738] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.057632 3915 raft_consensus.cc:738] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.057673 3908 consensus_queue.cc:260] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.057683 3915 consensus_queue.cc:260] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.057782 3915 ts_tablet_manager.cc:1428] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.057873 3915 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.058275 3915 tablet_bootstrap.cc:654] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.058462 3908 ts_tablet_manager.cc:1428] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.058519 3908 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.058912 3915 tablet_bootstrap.cc:492] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.058913 3912 raft_consensus.cc:491] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.058964 3915 ts_tablet_manager.cc:1397] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.058952 3912 raft_consensus.cc:513] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.059062 3912 leader_election.cc:290] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.059083 3915 raft_consensus.cc:357] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.059139 3915 raft_consensus.cc:383] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.059155 3915 raft_consensus.cc:738] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.059185 3915 consensus_queue.cc:260] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.059274 3915 ts_tablet_manager.cc:1428] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.059285 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5779ec7816cd499ebe46962e29092a70" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.059324 3915 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.059540 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5779ec7816cd499ebe46962e29092a70" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.059605 3414 raft_consensus.cc:2463] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.059795 3484 leader_election.cc:304] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.059859 3912 raft_consensus.cc:2798] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.059882 3912 raft_consensus.cc:491] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.059901 3912 raft_consensus.cc:3054] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.059330 3280 raft_consensus.cc:2463] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.060231 3915 tablet_bootstrap.cc:654] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.060534 3912 raft_consensus.cc:513] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.060639 3912 leader_election.cc:290] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.060761 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5779ec7816cd499ebe46962e29092a70" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.060817 3280 raft_consensus.cc:3054] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.060851 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5779ec7816cd499ebe46962e29092a70" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.060904 3414 raft_consensus.cc:3054] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.061015 3908 tablet_bootstrap.cc:654] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.061467 3414 raft_consensus.cc:2463] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.061487 3280 raft_consensus.cc:2463] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.060823 3915 tablet_bootstrap.cc:492] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.061646 3485 leader_election.cc:304] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.061700 3915 ts_tablet_manager.cc:1397] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.061728 3912 raft_consensus.cc:2798] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.061774 3912 raft_consensus.cc:695] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.061812 3912 consensus_queue.cc:237] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.061820 3915 raft_consensus.cc:357] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.061872 3915 raft_consensus.cc:383] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.061897 3915 raft_consensus.cc:738] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.061928 3915 consensus_queue.cc:260] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.062044 3915 ts_tablet_manager.cc:1428] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.062053 3908 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.062088 3908 ts_tablet_manager.cc:1397] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:11:53.062103 3915 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:11:53.062216 3908 raft_consensus.cc:357] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.062269 3908 raft_consensus.cc:383] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.062285 3908 raft_consensus.cc:738] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.062381 3908 consensus_queue.cc:260] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.062461 3915 tablet_bootstrap.cc:654] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.062772 3908 ts_tablet_manager.cc:1428] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.063297 3098 catalog_manager.cc:5526] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:53.063405 3098 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5779ec7816cd499ebe46962e29092a70 (table default.Table_74dbe28e3a4f4af69edff5bbb4beae07 [id=1d766421e2be4d92b84d436c65506229]). Expected version 1 got 0
I20250115 10:11:53.064610 3915 tablet_bootstrap.cc:492] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:11:53.064656 3915 ts_tablet_manager.cc:1397] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:11:53.064797 3915 raft_consensus.cc:357] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.064853 3915 raft_consensus.cc:383] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.064877 3915 raft_consensus.cc:738] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.064914 3915 consensus_queue.cc:260] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.064999 3915 ts_tablet_manager.cc:1428] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.083613 3414 raft_consensus.cc:1270] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.083622 3280 raft_consensus.cc:1270] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.083871 3912 consensus_queue.cc:1035] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.084080 3912 consensus_queue.cc:1035] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.084951 3921 tablet.cc:1721] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.085216 3098 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5779ec7816cd499ebe46962e29092a70 (table default.Table_74dbe28e3a4f4af69edff5bbb4beae07 [id=1d766421e2be4d92b84d436c65506229]). Expected version 1 got 0
I20250115 10:11:53.085515 3919 tablet.cc:1721] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.087497 3093 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_74dbe28e3a4f4af69edff5bbb4beae07 [id=1d766421e2be4d92b84d436c65506229] alter complete (version 1)
I20250115 10:11:53.088263 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5779ec7816cd499ebe46962e29092a70 (table default.Table_74dbe28e3a4f4af69edff5bbb4beae07 [id=1d766421e2be4d92b84d436c65506229]). Expected version 1 got 0
I20250115 10:11:53.089448 3923 tablet.cc:1721] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.102864 3913 raft_consensus.cc:491] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.102948 3913 raft_consensus.cc:513] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.103083 3913 leader_election.cc:290] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.103238 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7352b551832b40039715e5bf18a31ffb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.103250 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7352b551832b40039715e5bf18a31ffb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.103329 3414 raft_consensus.cc:2463] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.103329 3280 raft_consensus.cc:2463] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.103487 3485 leader_election.cc:304] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.103559 3913 raft_consensus.cc:2798] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.103596 3913 raft_consensus.cc:491] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.103621 3913 raft_consensus.cc:3054] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.104393 3913 raft_consensus.cc:513] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.104545 3913 leader_election.cc:290] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.104693 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7352b551832b40039715e5bf18a31ffb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.104693 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7352b551832b40039715e5bf18a31ffb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.104761 3414 raft_consensus.cc:3054] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.104761 3280 raft_consensus.cc:3054] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.105418 3280 raft_consensus.cc:2463] T 7352b551832b40039715e5bf18a31ffb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.105418 3414 raft_consensus.cc:2463] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.105608 3485 leader_election.cc:304] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.105700 3913 raft_consensus.cc:2798] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.105746 3913 raft_consensus.cc:695] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.105791 3913 consensus_queue.cc:237] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.106585 3093 catalog_manager.cc:5526] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:53.106678 3671 raft_consensus.cc:491] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.106738 3671 raft_consensus.cc:513] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.106864 3671 leader_election.cc:290] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.106993 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9825097e391481da01ad9111c836ec9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.107059 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9825097e391481da01ad9111c836ec9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.107093 3550 raft_consensus.cc:2463] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.107131 3414 raft_consensus.cc:2463] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.107288 3214 leader_election.cc:304] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.107370 3671 raft_consensus.cc:2798] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.107435 3671 raft_consensus.cc:491] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.107455 3671 raft_consensus.cc:3054] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.108175 3671 raft_consensus.cc:513] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.108310 3671 leader_election.cc:290] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.108500 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9825097e391481da01ad9111c836ec9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.108561 3414 raft_consensus.cc:3054] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.108747 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9825097e391481da01ad9111c836ec9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.108811 3550 raft_consensus.cc:3054] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.109025 3414 raft_consensus.cc:2463] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.109205 3214 leader_election.cc:304] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.109366 3550 raft_consensus.cc:2463] T f9825097e391481da01ad9111c836ec9 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.109447 3671 raft_consensus.cc:2798] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.109498 3671 raft_consensus.cc:695] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:53.109539 3671 consensus_queue.cc:237] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.113457 3671 raft_consensus.cc:491] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.113503 3671 raft_consensus.cc:513] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.113610 3671 leader_election.cc:290] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.113727 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4727b40e9db4460b826fcc1ca67c9c8f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.113766 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4727b40e9db4460b826fcc1ca67c9c8f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.113818 3550 raft_consensus.cc:2463] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.113830 3414 raft_consensus.cc:2463] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.113955 3215 leader_election.cc:304] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.114039 3671 raft_consensus.cc:2798] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.114076 3671 raft_consensus.cc:491] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.114102 3671 raft_consensus.cc:3054] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.114643 3671 raft_consensus.cc:513] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.114759 3671 leader_election.cc:290] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.114923 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4727b40e9db4460b826fcc1ca67c9c8f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.114950 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4727b40e9db4460b826fcc1ca67c9c8f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.115005 3550 raft_consensus.cc:3054] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.115005 3414 raft_consensus.cc:3054] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.115659 3414 raft_consensus.cc:2463] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.115701 3550 raft_consensus.cc:2463] T 4727b40e9db4460b826fcc1ca67c9c8f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.115837 3214 leader_election.cc:304] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.115943 3671 raft_consensus.cc:2798] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.116020 3671 raft_consensus.cc:695] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:53.116072 3671 consensus_queue.cc:237] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.127692 3913 raft_consensus.cc:491] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.127775 3913 raft_consensus.cc:513] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.127900 3913 leader_election.cc:290] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.128046 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ab77abe34374a6ba6f30bf3a2bd67de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.128115 3280 raft_consensus.cc:2463] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.128074 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ab77abe34374a6ba6f30bf3a2bd67de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.128155 3414 raft_consensus.cc:2463] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.128266 3485 leader_election.cc:304] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.128355 3913 raft_consensus.cc:2798] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.128386 3913 raft_consensus.cc:491] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.128404 3913 raft_consensus.cc:3054] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.129074 3913 raft_consensus.cc:513] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.129197 3913 leader_election.cc:290] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.129308 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ab77abe34374a6ba6f30bf3a2bd67de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.129359 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ab77abe34374a6ba6f30bf3a2bd67de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.129390 3414 raft_consensus.cc:3054] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.129410 3280 raft_consensus.cc:3054] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.129995 3280 raft_consensus.cc:2463] T 3ab77abe34374a6ba6f30bf3a2bd67de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.129995 3414 raft_consensus.cc:2463] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.130177 3485 leader_election.cc:304] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.130271 3913 raft_consensus.cc:2798] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.130352 3913 raft_consensus.cc:695] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.130400 3913 consensus_queue.cc:237] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.131124 3093 catalog_manager.cc:5526] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:53.131291 3093 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (table default.Table_4adcd3081b6b4e4d9c26572586305fe5 [id=336af606a29d472799f85c1a69021bc6]). Expected version 1 got 0
I20250115 10:11:53.131613 3666 raft_consensus.cc:491] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.131664 3666 raft_consensus.cc:513] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.131796 3666 leader_election.cc:290] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.131916 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.131991 3280 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:53.132076 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.132156 3550 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:53.132143 3350 leader_election.cc:304] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.132258 3666 raft_consensus.cc:2798] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.132285 3666 raft_consensus.cc:491] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.132304 3666 raft_consensus.cc:3054] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.132920 3666 raft_consensus.cc:513] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.133016 3666 leader_election.cc:290] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.133152 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.133167 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.133216 3550 raft_consensus.cc:3054] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.133216 3280 raft_consensus.cc:3054] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.133776 3280 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:53.133824 3550 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:53.133920 3350 leader_election.cc:304] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.133996 3666 raft_consensus.cc:2798] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.134038 3666 raft_consensus.cc:695] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:53.134069 3666 consensus_queue.cc:237] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.134708 3093 catalog_manager.cc:5526] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:53.143500 3671 raft_consensus.cc:491] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.143568 3671 raft_consensus.cc:513] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.143682 3671 leader_election.cc:290] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.143851 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e56c83017b54e65a066e8e377293b13" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.143934 3550 raft_consensus.cc:2463] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.143878 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e56c83017b54e65a066e8e377293b13" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.143972 3414 raft_consensus.cc:2463] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.144075 3215 leader_election.cc:304] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.144171 3671 raft_consensus.cc:2798] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.144210 3671 raft_consensus.cc:491] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.144235 3671 raft_consensus.cc:3054] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.144843 3671 raft_consensus.cc:513] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.144989 3671 leader_election.cc:290] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.145100 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e56c83017b54e65a066e8e377293b13" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.145124 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e56c83017b54e65a066e8e377293b13" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.145164 3550 raft_consensus.cc:3054] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.145185 3414 raft_consensus.cc:3054] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.145720 3414 raft_consensus.cc:2463] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.145804 3550 raft_consensus.cc:2463] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.145905 3214 leader_election.cc:304] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.146006 3671 raft_consensus.cc:2798] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.146039 3671 raft_consensus.cc:695] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:53.146093 3671 consensus_queue.cc:237] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.164785 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_58352e733c08438aa7c9e60115cd00d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.164820 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3a332652b77747769a1004512912ed09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.165012 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58352e733c08438aa7c9e60115cd00d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.164991 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_de4be19898364ed582dc0ad4962a4909"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.165032 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a332652b77747769a1004512912ed09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:53.165066 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de4be19898364ed582dc0ad4962a4909 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.165410 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_54fd3ba51b8d41d0ba009ef52c0d072a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.165506 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54fd3ba51b8d41d0ba009ef52c0d072a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.167955 3386 tablet_service.cc:1467] Processing CreateTablet for tablet bd1c5a31c2ef4d629e0439fbe79d06a4 (DEFAULT_TABLE table=default.Table_de4be19898364ed582dc0ad4962a4909 [id=b18be4868f6043868407914800d910a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.167965 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 95eeaefd108a4f468966db318e5fccd3 (DEFAULT_TABLE table=default.Table_3a332652b77747769a1004512912ed09 [id=8ea43dace1094342a334666aef5b00cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.168098 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1c5a31c2ef4d629e0439fbe79d06a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.168183 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95eeaefd108a4f468966db318e5fccd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.169217 3908 tablet_bootstrap.cc:492] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.169615 3908 tablet_bootstrap.cc:654] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.170019 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 373997090ec44e6e8632d42a6465067f (DEFAULT_TABLE table=default.Table_58352e733c08438aa7c9e60115cd00d9 [id=153421886fa64ff88c4c955b3563eb0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.170025 3389 tablet_service.cc:1467] Processing CreateTablet for tablet c679c7c71b3c4f03a0ab05a2dbedf053 (DEFAULT_TABLE table=default.Table_54fd3ba51b8d41d0ba009ef52c0d072a [id=34cb1b392a3a493e8c1cec9e4eb1427d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.170112 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373997090ec44e6e8632d42a6465067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.170148 3908 tablet_bootstrap.cc:492] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.170178 3908 ts_tablet_manager.cc:1397] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.170204 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c679c7c71b3c4f03a0ab05a2dbedf053. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.170322 3908 raft_consensus.cc:357] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.170387 3908 raft_consensus.cc:383] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.170403 3908 raft_consensus.cc:738] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.170449 3908 consensus_queue.cc:260] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.170542 3908 ts_tablet_manager.cc:1428] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.170614 3908 tablet_bootstrap.cc:492] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.170975 3908 tablet_bootstrap.cc:654] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.171613 3908 tablet_bootstrap.cc:492] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.171658 3908 ts_tablet_manager.cc:1397] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.171669 3671 raft_consensus.cc:491] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.171836 3908 raft_consensus.cc:357] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.171893 3908 raft_consensus.cc:383] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.171911 3908 raft_consensus.cc:738] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.171944 3908 consensus_queue.cc:260] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.172032 3908 ts_tablet_manager.cc:1428] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.172080 3908 tablet_bootstrap.cc:492] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.171761 3671 raft_consensus.cc:513] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.172415 3908 tablet_bootstrap.cc:654] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.172622 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f792ae7d54184207825a92d72bc5a323" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.172696 3414 raft_consensus.cc:2463] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.172894 3214 leader_election.cc:304] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.172983 3952 raft_consensus.cc:2798] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.173028 3952 raft_consensus.cc:491] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.173049 3952 raft_consensus.cc:3054] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.173111 3671 leader_election.cc:290] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.173091 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f792ae7d54184207825a92d72bc5a323" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.173166 3550 raft_consensus.cc:2463] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:11:53.173388 3908 tablet_bootstrap.cc:492] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.173414 3908 ts_tablet_manager.cc:1397] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.173503 3908 raft_consensus.cc:357] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.173534 3908 raft_consensus.cc:383] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.173545 3908 raft_consensus.cc:738] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.173574 3908 consensus_queue.cc:260] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.173648 3908 ts_tablet_manager.cc:1428] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.173710 3908 tablet_bootstrap.cc:492] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.173662 3952 raft_consensus.cc:513] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.173785 3952 leader_election.cc:290] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.174018 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f792ae7d54184207825a92d72bc5a323" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.174098 3550 raft_consensus.cc:3054] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.174348 3908 tablet_bootstrap.cc:654] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.174835 3908 tablet_bootstrap.cc:492] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.174888 3908 ts_tablet_manager.cc:1397] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.174922 3550 raft_consensus.cc:2463] T f792ae7d54184207825a92d72bc5a323 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.175027 3908 raft_consensus.cc:357] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.175092 3215 leader_election.cc:304] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.175168 3908 raft_consensus.cc:383] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.175168 3952 raft_consensus.cc:2798] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.175232 3952 raft_consensus.cc:695] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:53.175246 3908 raft_consensus.cc:738] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.175277 3952 consensus_queue.cc:237] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.175065 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f792ae7d54184207825a92d72bc5a323" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.175453 3414 raft_consensus.cc:3054] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.175303 3908 consensus_queue.cc:260] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.175568 3908 ts_tablet_manager.cc:1428] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.176326 3414 raft_consensus.cc:2463] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:53.184010 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_24a1adaaced643af9cea60e94f10b20d" } new_table_name: "default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a" modify_external_catalogs: true
W20250115 10:11:53.185207 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e56c83017b54e65a066e8e377293b13 consensus state has no leader
I20250115 10:11:53.185956 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df0e2c0ea73e40f480f5bcad442866b9" } modify_external_catalogs: true
I20250115 10:11:53.186014 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df0e2c0ea73e40f480f5bcad442866b9" } modify_external_catalogs: true
I20250115 10:11:53.186882 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4839f8e0539d468ea11077d48f8f8266
I20250115 10:11:53.187101 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 4839f8e0539d468ea11077d48f8f8266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.187211 3907 tablet_replica.cc:331] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.187289 3907 raft_consensus.cc:2238] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.187335 3907 raft_consensus.cc:2267] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.187521 3907 ts_tablet_manager.cc:1905] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.188522 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2694e169c69e4e56b48763624e4a5e04" } modify_external_catalogs: true
I20250115 10:11:53.188588 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2694e169c69e4e56b48763624e4a5e04" } modify_external_catalogs: true
I20250115 10:11:53.188644 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5d23a5647e244c0b5dce7cb47f567da" } new_table_name: "default.Table_e5550426b49241a48cac19af16d12519" modify_external_catalogs: true
I20250115 10:11:53.188863 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_04b37cf1d3954dc0be648463a865bb83" } new_table_name: "default.Table_0805564dd00b4390a58f127f7f1e316c" modify_external_catalogs: true
I20250115 10:11:53.188899 3907 ts_tablet_manager.cc:1918] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20250115 10:11:53.188944 3907 log.cc:1198] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4839f8e0539d468ea11077d48f8f8266
I20250115 10:11:53.189160 3907 ts_tablet_manager.cc:1939] T 4839f8e0539d468ea11077d48f8f8266 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.189731 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4839f8e0539d468ea11077d48f8f8266 (table default.Table_df0e2c0ea73e40f480f5bcad442866b9 [id=284816018979468d99f5a23274d90447]) successfully deleted
I20250115 10:11:53.189767 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:11:53.189747 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f889cc1201404c8691bf01256750e244 consensus state has no leader
I20250115 10:11:53.189992 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2ba4b779b29841f69fe72527763ab7a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.190084 3907 tablet_replica.cc:331] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.190146 3907 raft_consensus.cc:2238] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.190197 3907 raft_consensus.cc:2267] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.190399 3907 ts_tablet_manager.cc:1905] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.190905 3280 raft_consensus.cc:1270] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.190905 3550 raft_consensus.cc:1270] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.191067 3666 consensus_queue.cc:1035] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.191140 3663 consensus_queue.cc:1035] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.192014 3907 ts_tablet_manager.cc:1918] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:53.192076 3907 log.cc:1198] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:53.192392 3907 ts_tablet_manager.cc:1939] T 2ba4b779b29841f69fe72527763ab7a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.192440 3099 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d667834206fe4410a22b4944b3494462 (table default.Table_0805564dd00b4390a58f127f7f1e316c [id=ab569ac74bbb44f1913506709002a4c4]). Expected version 1 got 0
I20250115 10:11:53.192678 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2ba4b779b29841f69fe72527763ab7a1 (table default.Table_2694e169c69e4e56b48763624e4a5e04 [id=86dc03ca83b14d698f499bb19dd94763]) successfully deleted
I20250115 10:11:53.192768 3923 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.193049 3919 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.195113 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb1ee264d56d49c3b5ec53a80ac2b790" } modify_external_catalogs: true
I20250115 10:11:53.195188 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb1ee264d56d49c3b5ec53a80ac2b790" } modify_external_catalogs: true
I20250115 10:11:53.195094 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4adcd3081b6b4e4d9c26572586305fe5" } new_table_name: "default.Table_6780cb70cb8843a683c91aa3763f5739" modify_external_catalogs: true
I20250115 10:11:53.195533 3099 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_0805564dd00b4390a58f127f7f1e316c [id=ab569ac74bbb44f1913506709002a4c4] alter complete (version 1)
I20250115 10:11:53.195887 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_de4be19898364ed582dc0ad4962a4909" } new_table_name: "default.Table_312bea7f87e54c19b580055bf9a92136" modify_external_catalogs: true
I20250115 10:11:53.195924 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 8cbfcedc2f5447a1acb095066d131d52 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.196028 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet 3096adefffe04e008f58ecba3c3dd633 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.196345 3921 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.196818 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:53.196831 3092 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d667834206fe4410a22b4944b3494462 (table default.Table_0805564dd00b4390a58f127f7f1e316c [id=ab569ac74bbb44f1913506709002a4c4]). Expected version 1 got 0
I20250115 10:11:53.197181 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 7352b551832b40039715e5bf18a31ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.197250 3907 tablet_replica.cc:331] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.197295 3907 raft_consensus.cc:2238] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.197322 3907 raft_consensus.cc:2267] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.197495 3907 ts_tablet_manager.cc:1905] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.198401 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:53.198467 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 8cbfcedc2f5447a1acb095066d131d52 deleted and replaced by tablet ff31ad7e43e8447192503ed8c65ba512
W20250115 10:11:53.198499 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd1c5a31c2ef4d629e0439fbe79d06a4 consensus state has no leader
I20250115 10:11:53.198463 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:53.198558 3907 ts_tablet_manager.cc:1918] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.198596 3907 log.cc:1198] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/7352b551832b40039715e5bf18a31ffb
I20250115 10:11:53.198611 3094 catalog_manager.cc:6596] ReplaceTablet: tablet 3096adefffe04e008f58ecba3c3dd633 deleted and replaced by tablet d8f4977e6b174332ad6f5540c0211fd6
I20250115 10:11:53.198741 3907 ts_tablet_manager.cc:1939] T 7352b551832b40039715e5bf18a31ffb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.199401 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_24943961f2504c878a6fc91847c54607" } modify_external_catalogs: true
I20250115 10:11:53.199455 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_24943961f2504c878a6fc91847c54607" } modify_external_catalogs: true
I20250115 10:11:53.199740 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8a6410a08dfc4b01afd49088e7e05fea" } modify_external_catalogs: true
I20250115 10:11:53.199790 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8a6410a08dfc4b01afd49088e7e05fea" } modify_external_catalogs: true
I20250115 10:11:53.199887 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cbfcedc2f5447a1acb095066d131d52 with delete_type TABLET_DATA_DELETED (replaced by tablet ff31ad7e43e8447192503ed8c65ba512) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.199963 3383 tablet_service.cc:1467] Processing CreateTablet for tablet d8f4977e6b174332ad6f5540c0211fd6 (DEFAULT_TABLE table=default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.199963 3384 tablet_service.cc:1467] Processing CreateTablet for tablet ff31ad7e43e8447192503ed8c65ba512 (DEFAULT_TABLE table=default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.200048 3907 tablet_replica.cc:331] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.200134 3907 raft_consensus.cc:2238] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.200057 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f4977e6b174332ad6f5540c0211fd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.200186 3907 raft_consensus.cc:2267] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.200239 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 3096adefffe04e008f58ecba3c3dd633 with delete_type TABLET_DATA_DELETED (replaced by tablet d8f4977e6b174332ad6f5540c0211fd6) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.200314 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff31ad7e43e8447192503ed8c65ba512. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.200400 3907 ts_tablet_manager.cc:1905] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.201246 3907 ts_tablet_manager.cc:1918] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.201308 3907 log.cc:1198] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:53.201341 3908 tablet_bootstrap.cc:492] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.201506 3907 ts_tablet_manager.cc:1939] T 8cbfcedc2f5447a1acb095066d131d52 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.201645 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 7352b551832b40039715e5bf18a31ffb (table default.Table_fb1ee264d56d49c3b5ec53a80ac2b790 [id=5c4fc6ff1dbf4efe9587de2a0c193745]) successfully deleted
I20250115 10:11:53.201694 3907 tablet_replica.cc:331] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.201745 3907 raft_consensus.cc:2238] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.201797 3907 raft_consensus.cc:2267] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.201776 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:11:53.201779 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet c3f88d5d54b74f63a94bf88d3a33cfae from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.201746 3908 tablet_bootstrap.cc:654] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.202415 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 8cbfcedc2f5447a1acb095066d131d52 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:53.202538 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 0f4dc0c74f2e43db8b87446a236771f2
I20250115 10:11:53.202570 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 4727b40e9db4460b826fcc1ca67c9c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.202606 3908 tablet_bootstrap.cc:492] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.202630 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet 4727b40e9db4460b826fcc1ca67c9c8f from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.202642 3908 ts_tablet_manager.cc:1397] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.202780 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f4dc0c74f2e43db8b87446a236771f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.202905 3908 raft_consensus.cc:357] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.202971 3908 raft_consensus.cc:383] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.202991 3908 raft_consensus.cc:738] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.203037 3908 consensus_queue.cc:260] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.203167 3908 ts_tablet_manager.cc:1428] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.203384 3908 tablet_bootstrap.cc:492] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.203387 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:53.203459 3098 catalog_manager.cc:6596] ReplaceTablet: tablet c3f88d5d54b74f63a94bf88d3a33cfae deleted and replaced by tablet 2791e190212c4ceabd14f5cc9127f9a3
I20250115 10:11:53.203745 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet c3f88d5d54b74f63a94bf88d3a33cfae with delete_type TABLET_DATA_DELETED (replaced by tablet 2791e190212c4ceabd14f5cc9127f9a3) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.203882 3907 ts_tablet_manager.cc:1905] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.203938 3908 tablet_bootstrap.cc:654] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.203959 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_80e15e6a3c06452b82c2dee7d4960b17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.204068 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80e15e6a3c06452b82c2dee7d4960b17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.205052 3907 ts_tablet_manager.cc:1918] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.205102 3908 tablet_bootstrap.cc:492] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.205123 3907 log.cc:1198] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:53.205147 3908 ts_tablet_manager.cc:1397] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.205288 3907 ts_tablet_manager.cc:1939] T 3096adefffe04e008f58ecba3c3dd633 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.205480 3094 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d8f4977e6b174332ad6f5540c0211fd6 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
W20250115 10:11:53.205586 3094 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d8f4977e6b174332ad6f5540c0211fd6 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d8f4977e6b174332ad6f5540c0211fd6 consensus state has no leader
I20250115 10:11:53.205559 3908 raft_consensus.cc:357] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.205623 3908 raft_consensus.cc:383] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.205655 3908 raft_consensus.cc:738] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.205720 3908 consensus_queue.cc:260] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.205804 3908 ts_tablet_manager.cc:1428] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.206171 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 2791e190212c4ceabd14f5cc9127f9a3 (DEFAULT_TABLE table=default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.206197 3907 tablet_replica.cc:331] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.206244 3907 raft_consensus.cc:2238] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.206259 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2791e190212c4ceabd14f5cc9127f9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.206269 3907 raft_consensus.cc:2267] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.206394 3907 ts_tablet_manager.cc:1905] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.206998 3908 tablet_bootstrap.cc:492] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.207584 3908 tablet_bootstrap.cc:654] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.207602 3098 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d8f4977e6b174332ad6f5540c0211fd6 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]). Expected version 2 got 0
I20250115 10:11:53.207616 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3096adefffe04e008f58ecba3c3dd633 (table default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566 [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:53.207780 3907 ts_tablet_manager.cc:1918] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.207818 3907 log.cc:1198] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:11:53.207895 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_67925ff15a2f42ef822f05595f8587a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.207980 3907 ts_tablet_manager.cc:1939] T 4727b40e9db4460b826fcc1ca67c9c8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
W20250115 10:11:53.207985 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67925ff15a2f42ef822f05595f8587a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.208137 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 1bcb79ab62e84c308746055230e73517 (DEFAULT_TABLE table=default.Table_80e15e6a3c06452b82c2dee7d4960b17 [id=d4e6a722d6b74a16b8845fcef95660e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.208178 3094 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ff31ad7e43e8447192503ed8c65ba512 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 2 got 0
I20250115 10:11:53.208241 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcb79ab62e84c308746055230e73517. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:53.208254 3094 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet ff31ad7e43e8447192503ed8c65ba512 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet ff31ad7e43e8447192503ed8c65ba512 consensus state has no leader
I20250115 10:11:53.208370 3907 tablet_replica.cc:331] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.208437 3907 raft_consensus.cc:2238] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.208465 3907 raft_consensus.cc:2267] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.208532 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4727b40e9db4460b826fcc1ca67c9c8f (table default.Table_24943961f2504c878a6fc91847c54607 [id=eefc1fd3a92140409e37f2225e9a4ef6]) successfully deleted
I20250115 10:11:53.208622 3907 ts_tablet_manager.cc:1905] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.209679 3907 ts_tablet_manager.cc:1918] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.209728 3907 log.cc:1198] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/0f4dc0c74f2e43db8b87446a236771f2
I20250115 10:11:53.209880 3907 ts_tablet_manager.cc:1939] T 0f4dc0c74f2e43db8b87446a236771f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.210451 3908 tablet_bootstrap.cc:492] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.210453 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 0f4dc0c74f2e43db8b87446a236771f2 (table default.Table_8a6410a08dfc4b01afd49088e7e05fea [id=d7471d4f9dcb43c4ac4b1e8a9088a7f9]) successfully deleted
I20250115 10:11:53.210496 3908 ts_tablet_manager.cc:1397] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:53.210521 3907 tablet_replica.cc:331] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.210569 3907 raft_consensus.cc:2238] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.210695 3907 raft_consensus.cc:2267] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.210693 3908 raft_consensus.cc:357] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.210916 3907 ts_tablet_manager.cc:1905] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.211040 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 86d086cd94664d40a653d64d06438bda from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.210901 3908 raft_consensus.cc:383] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.211341 3908 raft_consensus.cc:738] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.211462 3908 consensus_queue.cc:260] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.211961 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6133daf4f4814267885dfdbc10a9d002"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.211998 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a071d084a3a040bfb3bc742b2d550241"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.212072 3384 tablet_service.cc:1467] Processing CreateTablet for tablet a65b655fb9a84e8d9214cb2b6872cceb (DEFAULT_TABLE table=default.Table_67925ff15a2f42ef822f05595f8587a9 [id=d296d7e3f74b475eaa30ec9ab411976e]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:11:53.212072 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6133daf4f4814267885dfdbc10a9d002 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.212147 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a65b655fb9a84e8d9214cb2b6872cceb. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:53.212086 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a071d084a3a040bfb3bc742b2d550241 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.212678 3908 ts_tablet_manager.cc:1428] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.212750 3907 ts_tablet_manager.cc:1918] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.212817 3907 log.cc:1198] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:53.213019 3907 ts_tablet_manager.cc:1939] T c3f88d5d54b74f63a94bf88d3a33cfae P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.213297 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet c3f88d5d54b74f63a94bf88d3a33cfae (table default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]) successfully deleted
I20250115 10:11:53.213490 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_886e69d3af1042e0aab10f38f17e742f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.213529 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_62d774f73d504686a1fa6c4a416fd557"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.213583 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_886e69d3af1042e0aab10f38f17e742f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:53.213613 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62d774f73d504686a1fa6c4a416fd557 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.213732 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:11:53.213802 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 86d086cd94664d40a653d64d06438bda deleted and replaced by tablet cf7cad91ebd247dc9b1ad9512dd8d347
I20250115 10:11:53.213960 3908 tablet_bootstrap.cc:492] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.214196 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 86d086cd94664d40a653d64d06438bda with delete_type TABLET_DATA_DELETED (replaced by tablet cf7cad91ebd247dc9b1ad9512dd8d347) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.214365 3908 tablet_bootstrap.cc:654] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.214471 3907 tablet_replica.cc:331] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.214562 3907 raft_consensus.cc:2238] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.214658 3907 raft_consensus.cc:2267] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.214921 3907 ts_tablet_manager.cc:1905] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.215250 3908 tablet_bootstrap.cc:492] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.215305 3908 ts_tablet_manager.cc:1397] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.215569 3908 raft_consensus.cc:357] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.215849 3384 tablet_service.cc:1467] Processing CreateTablet for tablet cf7cad91ebd247dc9b1ad9512dd8d347 (DEFAULT_TABLE table=default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.215857 3908 raft_consensus.cc:383] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.215950 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7cad91ebd247dc9b1ad9512dd8d347. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.215953 3908 raft_consensus.cc:738] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.216080 3908 consensus_queue.cc:260] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.216441 3907 ts_tablet_manager.cc:1918] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.216516 3907 log.cc:1198] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/86d086cd94664d40a653d64d06438bda
I20250115 10:11:53.216586 3908 ts_tablet_manager.cc:1428] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.216676 3908 tablet_bootstrap.cc:492] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.216712 3907 ts_tablet_manager.cc:1939] T 86d086cd94664d40a653d64d06438bda P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.217109 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 86d086cd94664d40a653d64d06438bda (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:53.217407 3908 tablet_bootstrap.cc:654] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.217880 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 1f243a63e99f482594780094f904f59f (DEFAULT_TABLE table=default.Table_62d774f73d504686a1fa6c4a416fd557 [id=b3b64b3890f24b7ca49641044b04b40b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.217943 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 08bc2865f5c34a05a7d02fbc2e8c0504 (DEFAULT_TABLE table=default.Table_a071d084a3a040bfb3bc742b2d550241 [id=176f8d4264144007a0d874e4d96e6612]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.217978 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f243a63e99f482594780094f904f59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.217990 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 55fe5ef291454df2a788197943225250 (DEFAULT_TABLE table=default.Table_6133daf4f4814267885dfdbc10a9d002 [id=1958431b6dfa48b8b911a6bb9aaf2c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.218066 3908 tablet_bootstrap.cc:492] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.218087 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55fe5ef291454df2a788197943225250. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.218099 3908 ts_tablet_manager.cc:1397] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.218194 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bc2865f5c34a05a7d02fbc2e8c0504. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.218263 3908 raft_consensus.cc:357] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.218310 3908 raft_consensus.cc:383] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.218340 3908 raft_consensus.cc:738] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.218376 3908 consensus_queue.cc:260] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.218442 3908 ts_tablet_manager.cc:1428] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.218495 3908 tablet_bootstrap.cc:492] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.218870 3908 tablet_bootstrap.cc:654] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.219144 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 6c7e5d185b9e43b5b2265cc88de97999 (DEFAULT_TABLE table=default.Table_886e69d3af1042e0aab10f38f17e742f [id=a69f65c9f9904a839351ae067c897251]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.219219 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c7e5d185b9e43b5b2265cc88de97999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.220600 3908 tablet_bootstrap.cc:492] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.220643 3908 ts_tablet_manager.cc:1397] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.220762 3908 raft_consensus.cc:357] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.220808 3908 raft_consensus.cc:383] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.220830 3908 raft_consensus.cc:738] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.220878 3908 consensus_queue.cc:260] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.220980 3908 ts_tablet_manager.cc:1428] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.221066 3908 tablet_bootstrap.cc:492] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.221325 3095 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cf7cad91ebd247dc9b1ad9512dd8d347 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
W20250115 10:11:53.221406 3095 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet cf7cad91ebd247dc9b1ad9512dd8d347 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet cf7cad91ebd247dc9b1ad9512dd8d347 consensus state has no leader
I20250115 10:11:53.221438 3908 tablet_bootstrap.cc:654] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.221896 3095 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cf7cad91ebd247dc9b1ad9512dd8d347 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
I20250115 10:11:53.222024 3908 tablet_bootstrap.cc:492] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.222072 3908 ts_tablet_manager.cc:1397] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.222204 3908 raft_consensus.cc:357] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.222283 3908 raft_consensus.cc:383] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.222306 3908 raft_consensus.cc:738] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.222358 3908 consensus_queue.cc:260] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.222501 3908 ts_tablet_manager.cc:1428] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:53.222564 3908 tablet_bootstrap.cc:492] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.222965 3908 tablet_bootstrap.cc:654] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.223541 3908 tablet_bootstrap.cc:492] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.223753 3908 ts_tablet_manager.cc:1397] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.223938 3908 raft_consensus.cc:357] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.224001 3908 raft_consensus.cc:383] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.224020 3908 raft_consensus.cc:738] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.224053 3908 consensus_queue.cc:260] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.224148 3908 ts_tablet_manager.cc:1428] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.224258 3908 tablet_bootstrap.cc:492] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.224263 3666 raft_consensus.cc:491] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.224364 3666 raft_consensus.cc:513] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.224468 3666 leader_election.cc:290] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.224715 3908 tablet_bootstrap.cc:654] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:53.224957 3350 leader_election.cc:343] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: c679c7c71b3c4f03a0ab05a2dbedf053
W20250115 10:11:53.225025 3350 leader_election.cc:343] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: c679c7c71b3c4f03a0ab05a2dbedf053
I20250115 10:11:53.225049 3350 leader_election.cc:304] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.225116 3666 raft_consensus.cc:2743] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.225632 3908 tablet_bootstrap.cc:492] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.225675 3908 ts_tablet_manager.cc:1397] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.225837 3908 raft_consensus.cc:357] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.225895 3908 raft_consensus.cc:383] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.225911 3908 raft_consensus.cc:738] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.225941 3908 consensus_queue.cc:260] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.226022 3908 ts_tablet_manager.cc:1428] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.226100 3908 tablet_bootstrap.cc:492] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.226680 3908 tablet_bootstrap.cc:654] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.227262 3908 tablet_bootstrap.cc:492] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.227324 3908 ts_tablet_manager.cc:1397] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.227428 3908 raft_consensus.cc:357] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.227473 3908 raft_consensus.cc:383] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.227486 3908 raft_consensus.cc:738] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.227520 3908 consensus_queue.cc:260] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.227614 3908 ts_tablet_manager.cc:1428] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.300750 3666 raft_consensus.cc:491] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.300837 3666 raft_consensus.cc:513] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.300981 3666 leader_election.cc:290] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.301337 3350 leader_election.cc:343] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 2791e190212c4ceabd14f5cc9127f9a3
W20250115 10:11:53.301419 3350 leader_election.cc:343] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 2791e190212c4ceabd14f5cc9127f9a3
I20250115 10:11:53.301440 3350 leader_election.cc:304] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.301502 3666 raft_consensus.cc:2743] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.312158 3912 raft_consensus.cc:491] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.312249 3912 raft_consensus.cc:513] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.312423 3912 leader_election.cc:290] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.312673 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db40559d7894bb8b80cf27b546c8f56" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.312788 3280 raft_consensus.cc:2463] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.312898 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db40559d7894bb8b80cf27b546c8f56" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.312986 3414 raft_consensus.cc:2463] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.313127 3484 leader_election.cc:304] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.313205 3912 raft_consensus.cc:2798] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.313256 3912 raft_consensus.cc:491] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.313278 3912 raft_consensus.cc:3054] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:11:53.313519 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 146ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.314052 3912 raft_consensus.cc:513] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.314164 3912 leader_election.cc:290] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.314347 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db40559d7894bb8b80cf27b546c8f56" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.314386 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db40559d7894bb8b80cf27b546c8f56" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.314427 3280 raft_consensus.cc:3054] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.314451 3415 raft_consensus.cc:3054] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.315250 3280 raft_consensus.cc:2463] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.315286 3415 raft_consensus.cc:2463] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.315491 3485 leader_election.cc:304] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.315575 3912 raft_consensus.cc:2798] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
W20250115 10:11:53.315601 3484 consensus_peers.cc:487] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cbfcedc2f5447a1acb095066d131d52. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.315630 3912 raft_consensus.cc:695] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.315681 3912 consensus_queue.cc:237] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.316555 3095 catalog_manager.cc:5526] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:53.316677 3095 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:53.317901 3666 consensus_queue.cc:1035] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.321358 3666 consensus_queue.cc:1035] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.336032 3663 raft_consensus.cc:491] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.336110 3663 raft_consensus.cc:513] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.336266 3663 leader_election.cc:290] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.336670 3350 leader_election.cc:343] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 95eeaefd108a4f468966db318e5fccd3
W20250115 10:11:53.336745 3350 leader_election.cc:343] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 95eeaefd108a4f468966db318e5fccd3
I20250115 10:11:53.336769 3350 leader_election.cc:304] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.336827 3663 raft_consensus.cc:2743] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.350435 3912 raft_consensus.cc:491] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.350507 3912 raft_consensus.cc:513] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.350699 3912 leader_election.cc:290] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.351024 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3096adefffe04e008f58ecba3c3dd633" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.351135 3280 raft_consensus.cc:2463] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.351328 3485 leader_election.cc:304] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:11:53.351485 3484 leader_election.cc:343] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:53.351562 3912 raft_consensus.cc:2798] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.351589 3912 raft_consensus.cc:491] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.351608 3912 raft_consensus.cc:3054] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.352562 3912 raft_consensus.cc:513] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:11:53.352651 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 146ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.352682 3912 leader_election.cc:290] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.352797 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3096adefffe04e008f58ecba3c3dd633" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.352874 3280 raft_consensus.cc:3054] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:11:53.353067 3484 leader_election.cc:343] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:53.353456 3280 raft_consensus.cc:2463] T 3096adefffe04e008f58ecba3c3dd633 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.353662 3485 leader_election.cc:304] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:53.353735 3912 raft_consensus.cc:2798] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.353780 3912 raft_consensus.cc:695] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.353824 3912 consensus_queue.cc:237] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.354063 3663 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.354120 3663 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.354245 3663 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.354642 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:53.354712 3550 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:53.354854 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.354921 3280 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:11:53.355129 3350 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:11:53.355235 3663 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.355273 3663 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.355290 3663 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.355412 3912 raft_consensus.cc:491] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.355448 3912 raft_consensus.cc:513] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.355556 3912 leader_election.cc:290] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.355675 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f889cc1201404c8691bf01256750e244" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:53.355669 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f889cc1201404c8691bf01256750e244" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:11:53.355748 3280 raft_consensus.cc:2463] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.355767 3414 raft_consensus.cc:2463] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:11:53.355890 3485 leader_election.cc:304] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.355983 3912 raft_consensus.cc:2798] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:11:53.356020 3912 raft_consensus.cc:491] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:53.356043 3912 raft_consensus.cc:3054] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.356069 3663 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.356187 3663 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.356675 3912 raft_consensus.cc:513] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.356786 3912 leader_election.cc:290] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:53.356949 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f889cc1201404c8691bf01256750e244" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:11:53.356961 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:53.356987 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f889cc1201404c8691bf01256750e244" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.357028 3550 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.357028 3414 raft_consensus.cc:3054] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.357048 3278 raft_consensus.cc:3054] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.357648 3550 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:53.357645 3414 raft_consensus.cc:2463] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.357702 3278 raft_consensus.cc:2463] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:53.357779 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:53.357822 3484 leader_election.cc:304] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.357831 3280 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:11:53.357878 3350 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:53.357944 3663 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.357949 3913 raft_consensus.cc:2798] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:11:53.357973 3663 raft_consensus.cc:695] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:11:53.357988 3913 raft_consensus.cc:695] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:53.358011 3663 consensus_queue.cc:237] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.358027 3913 consensus_queue.cc:237] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.358487 3280 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:11:53.358942 3095 catalog_manager.cc:5526] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:11:53.359064 3095 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f889cc1201404c8691bf01256750e244 (table default.Table_e5550426b49241a48cac19af16d12519 [id=1ac3f51295024b83b64f69df31a970d2]). Expected version 1 got 0
W20250115 10:11:53.359282 3484 consensus_peers.cc:487] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ba4b779b29841f69fe72527763ab7a1. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.359320 3092 catalog_manager.cc:5526] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:11:53.359424 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:53.363279 3671 consensus_queue.cc:1035] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.364909 3770 consensus_queue.cc:1035] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.367045 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7e9385b3fcc74c79970da38116ffbe7a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.367180 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e9385b3fcc74c79970da38116ffbe7a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.367491 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4e850da7c02341dc9f165020779181fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.367589 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e850da7c02341dc9f165020779181fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.367759 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_15ac1ea217c84ef8a947fa0d650487e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.367828 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15ac1ea217c84ef8a947fa0d650487e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.368206 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2c20dd3fb6fa4bfbab63a7cf4bc730dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.368290 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c20dd3fb6fa4bfbab63a7cf4bc730dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.369287 3666 consensus_queue.cc:1035] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.369846 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 42ffbcd1216041e5a1e7e0794dc79727 (DEFAULT_TABLE table=default.Table_7e9385b3fcc74c79970da38116ffbe7a [id=58ed6869f82045868c11e668099a04b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.369964 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ffbcd1216041e5a1e7e0794dc79727. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.371268 3908 tablet_bootstrap.cc:492] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.371711 3908 tablet_bootstrap.cc:654] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.372115 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d3f5a868ded94011b7cac2db8eeaccca (DEFAULT_TABLE table=default.Table_15ac1ea217c84ef8a947fa0d650487e2 [id=f1780dea426a4c8c91265cf358fac4ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.372223 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f5a868ded94011b7cac2db8eeaccca. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.372263 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 5c19bb75be624574afd9d3e7149bb228 (DEFAULT_TABLE table=default.Table_4e850da7c02341dc9f165020779181fc [id=c6fe8de8cec64b40be547310332fbb5b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.372359 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c19bb75be624574afd9d3e7149bb228. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.372400 3908 tablet_bootstrap.cc:492] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.372433 3908 ts_tablet_manager.cc:1397] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.372566 3908 raft_consensus.cc:357] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.372609 3908 raft_consensus.cc:383] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.372624 3908 raft_consensus.cc:738] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.372658 3908 consensus_queue.cc:260] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.372798 3908 ts_tablet_manager.cc:1428] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.372810 4127 consensus_queue.cc:1035] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.373409 3908 tablet_bootstrap.cc:492] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.373786 3908 tablet_bootstrap.cc:654] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.374035 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 8dd5539d82ed46b685c80ac5e8a9d49b (DEFAULT_TABLE table=default.Table_2c20dd3fb6fa4bfbab63a7cf4bc730dc [id=97bb2abb27944d3cbc3b124f774b00fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.374128 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dd5539d82ed46b685c80ac5e8a9d49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.374603 3908 tablet_bootstrap.cc:492] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.374650 3908 ts_tablet_manager.cc:1397] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.374794 3908 raft_consensus.cc:357] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.374852 3908 raft_consensus.cc:383] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.374871 3908 raft_consensus.cc:738] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.374929 3908 consensus_queue.cc:260] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.375013 3908 ts_tablet_manager.cc:1428] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.375520 3666 raft_consensus.cc:491] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.375567 3666 raft_consensus.cc:513] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.375667 3666 leader_election.cc:290] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.375792 3908 tablet_bootstrap.cc:492] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:11:53.376017 3350 leader_election.cc:343] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 1bcb79ab62e84c308746055230e73517
W20250115 10:11:53.376286 3350 leader_election.cc:343] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 1bcb79ab62e84c308746055230e73517
I20250115 10:11:53.376341 3350 leader_election.cc:304] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.376302 3908 tablet_bootstrap.cc:654] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.376616 3666 raft_consensus.cc:2743] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.377092 3908 tablet_bootstrap.cc:492] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.377146 3908 ts_tablet_manager.cc:1397] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.377285 3908 raft_consensus.cc:357] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.377321 3908 raft_consensus.cc:383] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.377333 3908 raft_consensus.cc:738] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.377367 3908 consensus_queue.cc:260] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.377451 3908 ts_tablet_manager.cc:1428] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.377497 3908 tablet_bootstrap.cc:492] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.377930 3908 tablet_bootstrap.cc:654] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.378582 3908 tablet_bootstrap.cc:492] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.378628 3908 ts_tablet_manager.cc:1397] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.378788 3908 raft_consensus.cc:357] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.378863 3908 raft_consensus.cc:383] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.378883 3908 raft_consensus.cc:738] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.378932 3908 consensus_queue.cc:260] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.379026 3908 ts_tablet_manager.cc:1428] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.381803 3550 raft_consensus.cc:1270] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.381826 3280 raft_consensus.cc:1270] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:11:53.381989 3666 consensus_queue.cc:1035] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.382059 3663 consensus_queue.cc:1035] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.383313 3923 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.383641 3094 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:53.383810 3921 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.383839 3099 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0]). Expected version 1 got 0
I20250115 10:11:53.384013 4127 raft_consensus.cc:491] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.384075 4127 raft_consensus.cc:513] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.384198 4127 leader_election.cc:290] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.384433 3706 mvcc.cc:204] Tried to move back new op lower bound from 7114489501210517504 to 7114489501114691584. Current Snapshot: MvccSnapshot[applied={T|T < 7114489501210517504}]
I20250115 10:11:53.385141 3919 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:11:53.385411 3350 leader_election.cc:343] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 373997090ec44e6e8632d42a6465067f
I20250115 10:11:53.385874 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e850da7c02341dc9f165020779181fc" } new_table_name: "default.Table_173467cb54b3482dadd85057928fd763" modify_external_catalogs: true
W20250115 10:11:53.386308 3350 leader_election.cc:343] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 373997090ec44e6e8632d42a6465067f
I20250115 10:11:53.386353 3350 leader_election.cc:304] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.386473 4127 raft_consensus.cc:2743] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.387122 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5c19bb75be624574afd9d3e7149bb228 consensus state has no leader
I20250115 10:11:53.387174 3094 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_ae7149f318244b6d8a530cc1324d4c57 [id=64196da99b1440f191bef7bd69aaaff0] alter complete (version 1)
I20250115 10:11:53.387795 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_80e15e6a3c06452b82c2dee7d4960b17" } modify_external_catalogs: true
I20250115 10:11:53.387862 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_80e15e6a3c06452b82c2dee7d4960b17" } modify_external_catalogs: true
I20250115 10:11:53.388895 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 1bcb79ab62e84c308746055230e73517
I20250115 10:11:53.389113 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bcb79ab62e84c308746055230e73517 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.389218 3907 tablet_replica.cc:331] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.389293 3907 raft_consensus.cc:2238] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.389336 3907 raft_consensus.cc:2267] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.389475 3907 ts_tablet_manager.cc:1905] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.390209 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4daaab8a6db143a6a3c6e591553bdddc" } modify_external_catalogs: true
I20250115 10:11:53.390228 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6133daf4f4814267885dfdbc10a9d002" } new_table_name: "default.Table_60d7145e17bd4e908bd70c3302f2ae5e" modify_external_catalogs: true
I20250115 10:11:53.390270 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4daaab8a6db143a6a3c6e591553bdddc" } modify_external_catalogs: true
I20250115 10:11:53.390743 3907 ts_tablet_manager.cc:1918] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.390798 3907 log.cc:1198] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/1bcb79ab62e84c308746055230e73517
I20250115 10:11:53.390964 3907 ts_tablet_manager.cc:1939] T 1bcb79ab62e84c308746055230e73517 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.390961 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_59c103a185524c3f9aaab71834303868" } new_table_name: "default.Table_5a3805d83b0d45a1a6901220d0fb830c" modify_external_catalogs: true
W20250115 10:11:53.391353 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 55fe5ef291454df2a788197943225250 consensus state has no leader
I20250115 10:11:53.391650 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 1bcb79ab62e84c308746055230e73517 (table default.Table_80e15e6a3c06452b82c2dee7d4960b17 [id=d4e6a722d6b74a16b8845fcef95660e9]) successfully deleted
I20250115 10:11:53.391746 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2791e190212c4ceabd14f5cc9127f9a3
W20250115 10:11:53.392105 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f792ae7d54184207825a92d72bc5a323 consensus state has no leader
I20250115 10:11:53.392148 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 2791e190212c4ceabd14f5cc9127f9a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.392293 3907 tablet_replica.cc:331] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.392352 3907 raft_consensus.cc:2238] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.392382 3907 raft_consensus.cc:2267] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.392535 3907 ts_tablet_manager.cc:1905] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.393507 3907 ts_tablet_manager.cc:1918] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.393554 3907 log.cc:1198] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2791e190212c4ceabd14f5cc9127f9a3
I20250115 10:11:53.393723 3907 ts_tablet_manager.cc:1939] T 2791e190212c4ceabd14f5cc9127f9a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.394001 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2791e190212c4ceabd14f5cc9127f9a3 (table default.Table_4daaab8a6db143a6a3c6e591553bdddc [id=c39d051664e94c94be116ecc581c3deb]) successfully deleted
I20250115 10:11:53.397408 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_15ac1ea217c84ef8a947fa0d650487e2" } modify_external_catalogs: true
I20250115 10:11:53.397473 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_15ac1ea217c84ef8a947fa0d650487e2" } modify_external_catalogs: true
I20250115 10:11:53.398391 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d3f5a868ded94011b7cac2db8eeaccca
I20250115 10:11:53.398581 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet d3f5a868ded94011b7cac2db8eeaccca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.398650 3907 tablet_replica.cc:331] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.398730 3907 raft_consensus.cc:2238] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.398757 3907 raft_consensus.cc:2267] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.398939 3907 ts_tablet_manager.cc:1905] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.399780 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2c20dd3fb6fa4bfbab63a7cf4bc730dc" } new_table_name: "default.Table_5cd37320d6f94090b33d5264d7ae3be6" modify_external_catalogs: true
I20250115 10:11:53.400218 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2cd7d0ec9a3945dbaafb729b6cd3b566" } new_table_name: "default.Table_7cf871899adb467e9f4c1d88202574e6" modify_external_catalogs: true
I20250115 10:11:53.400254 3907 ts_tablet_manager.cc:1918] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.400357 3907 log.cc:1198] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d3f5a868ded94011b7cac2db8eeaccca
I20250115 10:11:53.400751 3907 ts_tablet_manager.cc:1939] T d3f5a868ded94011b7cac2db8eeaccca P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.400748 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet f792ae7d54184207825a92d72bc5a323 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:53.401005 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dd5539d82ed46b685c80ac5e8a9d49b consensus state has no leader
I20250115 10:11:53.401180 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d3f5a868ded94011b7cac2db8eeaccca (table default.Table_15ac1ea217c84ef8a947fa0d650487e2 [id=f1780dea426a4c8c91265cf358fac4ab]) successfully deleted
I20250115 10:11:53.401268 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet c679c7c71b3c4f03a0ab05a2dbedf053 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:53.401628 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8f4977e6b174332ad6f5540c0211fd6 consensus state has no leader
I20250115 10:11:53.402107 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f792ae7d54184207825a92d72bc5a323
I20250115 10:11:53.402194 3095 catalog_manager.cc:6596] ReplaceTablet: tablet f792ae7d54184207825a92d72bc5a323 deleted and replaced by tablet 9ed1f31252c648d8bd444d6558483cac
I20250115 10:11:53.402356 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet f792ae7d54184207825a92d72bc5a323 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ed1f31252c648d8bd444d6558483cac) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.402431 3907 tablet_replica.cc:331] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.402483 3907 raft_consensus.cc:2238] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.402519 3907 raft_consensus.cc:2267] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.402730 3907 ts_tablet_manager.cc:1905] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.403115 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2ed244badf544b6e82fa85ddb3a99f78" } modify_external_catalogs: true
I20250115 10:11:53.403178 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2ed244badf544b6e82fa85ddb3a99f78" } modify_external_catalogs: true
I20250115 10:11:53.403209 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet c679c7c71b3c4f03a0ab05a2dbedf053
I20250115 10:11:53.403291 3099 catalog_manager.cc:6596] ReplaceTablet: tablet c679c7c71b3c4f03a0ab05a2dbedf053 deleted and replaced by tablet 9408e398ddef4f5fb49cc4d2fc123ee1
I20250115 10:11:53.403744 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a332652b77747769a1004512912ed09" } modify_external_catalogs: true
I20250115 10:11:53.403775 4127 raft_consensus.cc:491] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.403807 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a332652b77747769a1004512912ed09" } modify_external_catalogs: true
I20250115 10:11:53.403818 4127 raft_consensus.cc:513] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.403916 4127 leader_election.cc:290] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.404065 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet c679c7c71b3c4f03a0ab05a2dbedf053 with delete_type TABLET_DATA_DELETED (replaced by tablet 9408e398ddef4f5fb49cc4d2fc123ee1) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.404487 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet ff31ad7e43e8447192503ed8c65ba512 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:53.404623 3350 leader_election.cc:343] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d8f4977e6b174332ad6f5540c0211fd6
W20250115 10:11:53.404685 3350 leader_election.cc:343] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d8f4977e6b174332ad6f5540c0211fd6
I20250115 10:11:53.404716 3350 leader_election.cc:304] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.404784 4127 raft_consensus.cc:2743] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.405201 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 1f243a63e99f482594780094f904f59f from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.405316 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed1f31252c648d8bd444d6558483cac (DEFAULT_TABLE table=default.Table_5a3805d83b0d45a1a6901220d0fb830c [id=3b158ca8be84467289e8efbfdd4e20f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.405436 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ed1f31252c648d8bd444d6558483cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.405790 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 95eeaefd108a4f468966db318e5fccd3
I20250115 10:11:53.406002 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 95eeaefd108a4f468966db318e5fccd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.406176 3094 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet ff31ad7e43e8447192503ed8c65ba512
I20250115 10:11:53.406241 3094 catalog_manager.cc:6596] ReplaceTablet: tablet ff31ad7e43e8447192503ed8c65ba512 deleted and replaced by tablet d570061356714d7aacad803bdb523454
I20250115 10:11:53.406298 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f9825097e391481da01ad9111c836ec9
I20250115 10:11:53.406534 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet ff31ad7e43e8447192503ed8c65ba512 with delete_type TABLET_DATA_DELETED (replaced by tablet d570061356714d7aacad803bdb523454) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.406801 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bec489977ac0405a935e029c1cbacfd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.406919 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bec489977ac0405a935e029c1cbacfd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.407053 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet f9825097e391481da01ad9111c836ec9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.407616 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 9408e398ddef4f5fb49cc4d2fc123ee1 (DEFAULT_TABLE table=default.Table_54fd3ba51b8d41d0ba009ef52c0d072a [id=34cb1b392a3a493e8c1cec9e4eb1427d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.407722 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9408e398ddef4f5fb49cc4d2fc123ee1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.408702 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d570061356714d7aacad803bdb523454 (DEFAULT_TABLE table=default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.408799 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d570061356714d7aacad803bdb523454. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.408839 3908 tablet_bootstrap.cc:492] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.406131 3907 ts_tablet_manager.cc:1918] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.409263 3907 log.cc:1198] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f792ae7d54184207825a92d72bc5a323
I20250115 10:11:53.409340 3908 tablet_bootstrap.cc:654] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.409422 3907 ts_tablet_manager.cc:1939] T f792ae7d54184207825a92d72bc5a323 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.409631 3907 tablet_replica.cc:331] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.409680 3907 raft_consensus.cc:2238] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.409716 3907 raft_consensus.cc:2267] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.409808 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f792ae7d54184207825a92d72bc5a323 (table default.Table_5a3805d83b0d45a1a6901220d0fb830c [id=3b158ca8be84467289e8efbfdd4e20f9]) successfully deleted
I20250115 10:11:53.409976 3908 tablet_bootstrap.cc:492] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.410018 3908 ts_tablet_manager.cc:1397] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.410035 3907 ts_tablet_manager.cc:1905] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.410187 3908 raft_consensus.cc:357] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.410240 3908 raft_consensus.cc:383] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.410256 3908 raft_consensus.cc:738] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.410297 3908 consensus_queue.cc:260] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.410398 3908 ts_tablet_manager.cc:1428] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.410485 3908 tablet_bootstrap.cc:492] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.410521 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 1f243a63e99f482594780094f904f59f
I20250115 10:11:53.410588 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 1f243a63e99f482594780094f904f59f deleted and replaced by tablet 1a0ff3ac5e2046b6800958a5f1d930d7
I20250115 10:11:53.410841 3908 tablet_bootstrap.cc:654] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.411087 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f243a63e99f482594780094f904f59f with delete_type TABLET_DATA_DELETED (replaced by tablet 1a0ff3ac5e2046b6800958a5f1d930d7) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.411293 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_238340b94d2d44c5b5cf527172ba9d4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.411391 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_238340b94d2d44c5b5cf527172ba9d4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.411777 3907 ts_tablet_manager.cc:1918] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.411818 3907 log.cc:1198] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/c679c7c71b3c4f03a0ab05a2dbedf053
I20250115 10:11:53.411969 3907 ts_tablet_manager.cc:1939] T c679c7c71b3c4f03a0ab05a2dbedf053 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.412264 3907 tablet_replica.cc:331] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.412324 3907 raft_consensus.cc:2238] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.412350 3907 raft_consensus.cc:2267] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.412500 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet c679c7c71b3c4f03a0ab05a2dbedf053 (table default.Table_54fd3ba51b8d41d0ba009ef52c0d072a [id=34cb1b392a3a493e8c1cec9e4eb1427d]) successfully deleted
I20250115 10:11:53.412573 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 2a5c1bcc0c2f4b58b59cf25bce1e2d62 (DEFAULT_TABLE table=default.Table_bec489977ac0405a935e029c1cbacfd2 [id=30bef360b2a84b139484ca47ff6bb807]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.412632 3908 tablet_bootstrap.cc:492] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.412647 3907 ts_tablet_manager.cc:1905] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.412658 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5c1bcc0c2f4b58b59cf25bce1e2d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.412668 3908 ts_tablet_manager.cc:1397] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.412830 3908 raft_consensus.cc:357] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.412899 3908 raft_consensus.cc:383] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.412938 3908 raft_consensus.cc:738] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.412988 3908 consensus_queue.cc:260] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.413076 3908 ts_tablet_manager.cc:1428] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.413139 3908 tablet_bootstrap.cc:492] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.413540 3908 tablet_bootstrap.cc:654] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.413833 3907 ts_tablet_manager.cc:1918] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.413878 3907 log.cc:1198] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/95eeaefd108a4f468966db318e5fccd3
I20250115 10:11:53.414268 3907 ts_tablet_manager.cc:1939] T 95eeaefd108a4f468966db318e5fccd3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.414746 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 1a0ff3ac5e2046b6800958a5f1d930d7 (DEFAULT_TABLE table=default.Table_62d774f73d504686a1fa6c4a416fd557 [id=b3b64b3890f24b7ca49641044b04b40b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.415330 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2cc5b811bbf747c4826887cbeda26663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.415374 3907 tablet_replica.cc:331] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
W20250115 10:11:53.415442 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cc5b811bbf747c4826887cbeda26663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.415465 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0a77ba1a857147ecb9912f9a795ff2ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.415535 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a77ba1a857147ecb9912f9a795ff2ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.415534 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0ff3ac5e2046b6800958a5f1d930d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.415560 3908 tablet_bootstrap.cc:492] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.415717 3908 ts_tablet_manager.cc:1397] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:11:53.415853 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 4f559e7cafb04ae39af12e7681bbaf24 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.415872 3908 raft_consensus.cc:357] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.415927 3908 raft_consensus.cc:383] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.415928 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 95eeaefd108a4f468966db318e5fccd3 (table default.Table_3a332652b77747769a1004512912ed09 [id=8ea43dace1094342a334666aef5b00cc]) successfully deleted
I20250115 10:11:53.415951 3908 raft_consensus.cc:738] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.415977 3908 consensus_queue.cc:260] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.416204 3908 ts_tablet_manager.cc:1428] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.416508 3908 tablet_bootstrap.cc:492] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.416793 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ce872501e66349fc84f96026916c4f38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.416904 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce872501e66349fc84f96026916c4f38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.416983 3908 tablet_bootstrap.cc:654] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.417052 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dca7d059ac2e49289b71f48bb9af91fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.417137 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dca7d059ac2e49289b71f48bb9af91fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.417532 3907 raft_consensus.cc:2238] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.417583 3907 raft_consensus.cc:2267] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:11:53.417589 3214 consensus_peers.cc:487] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4839f8e0539d468ea11077d48f8f8266. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.417711 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:53.417794 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 4f559e7cafb04ae39af12e7681bbaf24 deleted and replaced by tablet 5e9cb3f9bdad490db76d27f7b78218cc
I20250115 10:11:53.417999 3908 tablet_bootstrap.cc:492] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.418112 3908 ts_tablet_manager.cc:1397] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.418092 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f559e7cafb04ae39af12e7681bbaf24 with delete_type TABLET_DATA_DELETED (replaced by tablet 5e9cb3f9bdad490db76d27f7b78218cc) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.418071 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 57d26a520a224a3f9e3ab5861700f650 (DEFAULT_TABLE table=default.Table_238340b94d2d44c5b5cf527172ba9d4a [id=2e150748a33c4179afe9c8697cbb09c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.418248 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d26a520a224a3f9e3ab5861700f650. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.418268 3908 raft_consensus.cc:357] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.418323 3908 raft_consensus.cc:383] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.418340 3908 raft_consensus.cc:738] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.418380 3908 consensus_queue.cc:260] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.418478 3908 ts_tablet_manager.cc:1428] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.418522 3908 tablet_bootstrap.cc:492] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.418855 3908 tablet_bootstrap.cc:654] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.418080 3907 ts_tablet_manager.cc:1905] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.419975 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 3899cfe388894cfba2c5fc1913274b76 (DEFAULT_TABLE table=default.Table_2cc5b811bbf747c4826887cbeda26663 [id=3cd3caf22252453581aa9f7dfce9d06b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.420064 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3899cfe388894cfba2c5fc1913274b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.420238 3908 tablet_bootstrap.cc:492] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.420279 3908 ts_tablet_manager.cc:1397] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.420398 3908 raft_consensus.cc:357] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.420456 3908 raft_consensus.cc:383] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.420477 3908 raft_consensus.cc:738] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.420533 3908 consensus_queue.cc:260] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.420627 3908 ts_tablet_manager.cc:1428] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.420681 3908 tablet_bootstrap.cc:492] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.421036 3908 tablet_bootstrap.cc:654] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.421567 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 91c84b4ba08d4f1ba47147e496a97320 (DEFAULT_TABLE table=default.Table_dca7d059ac2e49289b71f48bb9af91fa [id=454166c8d95d4a44a1326fd1c0bb7e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.421653 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c84b4ba08d4f1ba47147e496a97320. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.421715 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 9ed1f31252c648d8bd444d6558483cac (table default.Table_5a3805d83b0d45a1a6901220d0fb830c [id=3b158ca8be84467289e8efbfdd4e20f9]). Expected version 1 got 0
I20250115 10:11:53.421695 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 6f4e43f651df4f168a9cb701e6eba63a (DEFAULT_TABLE table=default.Table_ce872501e66349fc84f96026916c4f38 [id=ecfb15b88bae4a6b9bb7aed2410b6af8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.421751 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d570061356714d7aacad803bdb523454 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]). Expected version 2 got 0
I20250115 10:11:53.421790 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f4e43f651df4f168a9cb701e6eba63a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:53.421823 3093 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 9ed1f31252c648d8bd444d6558483cac (table default.Table_5a3805d83b0d45a1a6901220d0fb830c [id=3b158ca8be84467289e8efbfdd4e20f9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9ed1f31252c648d8bd444d6558483cac consensus state has no leader
W20250115 10:11:53.421855 3093 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d570061356714d7aacad803bdb523454 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d570061356714d7aacad803bdb523454 consensus state has no leader
I20250115 10:11:53.421655 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 9f9aed809eb74964a1965a5b73807725 (DEFAULT_TABLE table=default.Table_0a77ba1a857147ecb9912f9a795ff2ca [id=7f690847821b44668c41b17a25d4ce37]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.422554 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f9aed809eb74964a1965a5b73807725. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.422930 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 5e9cb3f9bdad490db76d27f7b78218cc (DEFAULT_TABLE table=default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.423018 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9cb3f9bdad490db76d27f7b78218cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.424764 3908 tablet_bootstrap.cc:492] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.424813 3908 ts_tablet_manager.cc:1397] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:11:53.424831 3907 ts_tablet_manager.cc:1918] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.424893 3907 log.cc:1198] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/ff31ad7e43e8447192503ed8c65ba512
I20250115 10:11:53.424957 3908 raft_consensus.cc:357] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.425024 3908 raft_consensus.cc:383] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.425045 3907 ts_tablet_manager.cc:1939] T ff31ad7e43e8447192503ed8c65ba512 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.425046 3908 raft_consensus.cc:738] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.425132 3908 consensus_queue.cc:260] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.425246 3908 ts_tablet_manager.cc:1428] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.425346 3907 tablet_replica.cc:331] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.425390 3907 raft_consensus.cc:2238] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.425428 3907 raft_consensus.cc:2267] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.425475 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet ff31ad7e43e8447192503ed8c65ba512 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:53.425643 3907 ts_tablet_manager.cc:1905] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.425870 3908 tablet_bootstrap.cc:492] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.426506 3908 tablet_bootstrap.cc:654] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.426728 3907 ts_tablet_manager.cc:1918] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.426762 3907 log.cc:1198] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f9825097e391481da01ad9111c836ec9
I20250115 10:11:53.426877 3907 ts_tablet_manager.cc:1939] T f9825097e391481da01ad9111c836ec9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.427013 3908 tablet_bootstrap.cc:492] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.427048 3908 ts_tablet_manager.cc:1397] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.427198 3908 raft_consensus.cc:357] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.427255 3908 raft_consensus.cc:383] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.427273 3908 raft_consensus.cc:738] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.427289 3907 tablet_replica.cc:331] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.427325 3908 consensus_queue.cc:260] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.427348 3907 raft_consensus.cc:2238] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.427376 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f9825097e391481da01ad9111c836ec9 (table default.Table_2ed244badf544b6e82fa85ddb3a99f78 [id=de3371776cbd4e0ab430fb426790aa1b]) successfully deleted
I20250115 10:11:53.427402 3907 raft_consensus.cc:2267] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.427496 3908 ts_tablet_manager.cc:1428] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.427538 3907 ts_tablet_manager.cc:1905] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.427594 3908 tablet_bootstrap.cc:492] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.428164 3908 tablet_bootstrap.cc:654] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.428731 3907 ts_tablet_manager.cc:1918] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.428788 3907 log.cc:1198] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/1f243a63e99f482594780094f904f59f
I20250115 10:11:53.428835 3908 tablet_bootstrap.cc:492] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.428881 3908 ts_tablet_manager.cc:1397] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.428951 3907 ts_tablet_manager.cc:1939] T 1f243a63e99f482594780094f904f59f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.429051 3908 raft_consensus.cc:357] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.429119 3908 raft_consensus.cc:383] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.429143 3908 raft_consensus.cc:738] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.429186 3908 consensus_queue.cc:260] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.429387 3907 tablet_replica.cc:331] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.429486 3907 raft_consensus.cc:2238] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.429535 3907 raft_consensus.cc:2267] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.429595 3908 ts_tablet_manager.cc:1428] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.429672 3908 tablet_bootstrap.cc:492] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.429735 3907 ts_tablet_manager.cc:1905] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.429831 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 1f243a63e99f482594780094f904f59f (table default.Table_62d774f73d504686a1fa6c4a416fd557 [id=b3b64b3890f24b7ca49641044b04b40b]) successfully deleted
I20250115 10:11:53.430493 3908 tablet_bootstrap.cc:654] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.431012 3908 tablet_bootstrap.cc:492] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.431054 3908 ts_tablet_manager.cc:1397] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.431186 3907 ts_tablet_manager.cc:1918] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.431180 3908 raft_consensus.cc:357] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.431272 3907 log.cc:1198] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:53.431273 3908 raft_consensus.cc:383] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.431545 3908 raft_consensus.cc:738] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.431612 3908 consensus_queue.cc:260] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.431676 3907 ts_tablet_manager.cc:1939] T 4f559e7cafb04ae39af12e7681bbaf24 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.431878 3908 ts_tablet_manager.cc:1428] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.431964 3908 tablet_bootstrap.cc:492] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.432039 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4f559e7cafb04ae39af12e7681bbaf24 (table default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7]) successfully deleted
I20250115 10:11:53.432435 3908 tablet_bootstrap.cc:654] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.433117 3908 tablet_bootstrap.cc:492] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.433156 3908 ts_tablet_manager.cc:1397] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.433279 3908 raft_consensus.cc:357] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.433336 3908 raft_consensus.cc:383] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.433362 3908 raft_consensus.cc:738] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.433403 3908 consensus_queue.cc:260] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.433615 3908 ts_tablet_manager.cc:1428] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.433697 3908 tablet_bootstrap.cc:492] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.434083 3908 tablet_bootstrap.cc:654] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.434067 3912 consensus_queue.cc:1035] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.435559 3912 consensus_queue.cc:1035] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.437251 3908 tablet_bootstrap.cc:492] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.437291 3908 ts_tablet_manager.cc:1397] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:11:53.437397 3908 raft_consensus.cc:357] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.437438 3908 raft_consensus.cc:383] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.437458 3908 raft_consensus.cc:738] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.437500 3908 consensus_queue.cc:260] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.437587 3908 ts_tablet_manager.cc:1428] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.438004 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5e9cb3f9bdad490db76d27f7b78218cc (table default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7]). Expected version 1 got 0
W20250115 10:11:53.438081 3093 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 5e9cb3f9bdad490db76d27f7b78218cc (table default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5e9cb3f9bdad490db76d27f7b78218cc consensus state has no leader
I20250115 10:11:53.443686 4127 raft_consensus.cc:491] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.443768 4127 raft_consensus.cc:513] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.443902 4127 leader_election.cc:290] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.444195 3350 leader_election.cc:343] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d570061356714d7aacad803bdb523454
W20250115 10:11:53.445834 3350 leader_election.cc:343] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d570061356714d7aacad803bdb523454
I20250115 10:11:53.445883 3350 leader_election.cc:304] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.445952 4127 raft_consensus.cc:2743] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.451778 4127 raft_consensus.cc:491] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.451831 4127 raft_consensus.cc:513] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.451925 4127 leader_election.cc:290] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.452179 3350 leader_election.cc:343] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: cf7cad91ebd247dc9b1ad9512dd8d347
W20250115 10:11:53.452260 3350 leader_election.cc:343] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: cf7cad91ebd247dc9b1ad9512dd8d347
I20250115 10:11:53.452289 3350 leader_election.cc:304] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.452351 4127 raft_consensus.cc:2743] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.455552 4127 raft_consensus.cc:491] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.455595 4127 raft_consensus.cc:513] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.455686 4127 leader_election.cc:290] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.455978 3350 leader_election.cc:343] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 42ffbcd1216041e5a1e7e0794dc79727
W20250115 10:11:53.456034 3350 leader_election.cc:343] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 42ffbcd1216041e5a1e7e0794dc79727
I20250115 10:11:53.456060 3350 leader_election.cc:304] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.456125 4127 raft_consensus.cc:2743] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.467320 4127 raft_consensus.cc:491] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.467386 4127 raft_consensus.cc:513] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.467492 4127 leader_election.cc:290] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.467780 3350 leader_election.cc:343] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 6c7e5d185b9e43b5b2265cc88de97999
W20250115 10:11:53.467890 3350 leader_election.cc:343] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6c7e5d185b9e43b5b2265cc88de97999
I20250115 10:11:53.467923 3350 leader_election.cc:304] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.467980 4127 raft_consensus.cc:2743] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.469050 3214 consensus_peers.cc:487] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f4dc0c74f2e43db8b87446a236771f2. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.496791 3912 consensus_queue.cc:1035] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.497411 4127 raft_consensus.cc:491] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.497488 4127 raft_consensus.cc:513] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.497630 4127 leader_election.cc:290] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.498225 3484 consensus_peers.cc:487] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7352b551832b40039715e5bf18a31ffb. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:53.499451 3350 leader_election.cc:343] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: bd1c5a31c2ef4d629e0439fbe79d06a4
W20250115 10:11:53.499516 3350 leader_election.cc:343] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: bd1c5a31c2ef4d629e0439fbe79d06a4
I20250115 10:11:53.499536 3350 leader_election.cc:304] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.499606 4127 raft_consensus.cc:2743] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.507777 4127 raft_consensus.cc:491] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.507867 4127 raft_consensus.cc:513] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.508001 4127 leader_election.cc:290] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.508225 3350 leader_election.cc:343] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: a65b655fb9a84e8d9214cb2b6872cceb
W20250115 10:11:53.508304 3350 leader_election.cc:343] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: a65b655fb9a84e8d9214cb2b6872cceb
I20250115 10:11:53.508333 3350 leader_election.cc:304] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.508402 4127 raft_consensus.cc:2743] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.509487 4127 raft_consensus.cc:491] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.509539 4127 raft_consensus.cc:513] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.509549 3912 consensus_queue.cc:1035] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.509632 4127 leader_election.cc:290] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.509876 3350 leader_election.cc:343] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 08bc2865f5c34a05a7d02fbc2e8c0504
W20250115 10:11:53.509954 3350 leader_election.cc:343] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 08bc2865f5c34a05a7d02fbc2e8c0504
I20250115 10:11:53.509990 3350 leader_election.cc:304] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.510062 4127 raft_consensus.cc:2743] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.511312 3093 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]). Expected version 2 got 0
I20250115 10:11:53.511444 3912 consensus_queue.cc:1035] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.511888 4127 raft_consensus.cc:491] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.511950 4127 raft_consensus.cc:513] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.512058 4127 leader_election.cc:290] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.512797 3350 leader_election.cc:343] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 5e9cb3f9bdad490db76d27f7b78218cc
I20250115 10:11:53.512838 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3ab77abe34374a6ba6f30bf3a2bd67de (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]). Expected version 2 got 0
W20250115 10:11:53.512912 3350 leader_election.cc:343] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 5e9cb3f9bdad490db76d27f7b78218cc
I20250115 10:11:53.513048 3350 leader_election.cc:304] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.513123 3663 raft_consensus.cc:2743] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.520781 3770 consensus_queue.cc:1035] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.523303 3663 raft_consensus.cc:491] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.523367 3663 raft_consensus.cc:513] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.523478 3663 leader_election.cc:290] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.523762 3350 leader_election.cc:343] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 55fe5ef291454df2a788197943225250
W20250115 10:11:53.523874 3350 leader_election.cc:343] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 55fe5ef291454df2a788197943225250
I20250115 10:11:53.523905 3350 leader_election.cc:304] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.524000 3663 raft_consensus.cc:2743] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.525211 3952 consensus_queue.cc:1035] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.526818 3671 consensus_queue.cc:1035] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:11:53.528239 3214 consensus_peers.cc:487] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4727b40e9db4460b826fcc1ca67c9c8f. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.532611 3663 raft_consensus.cc:491] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.532666 3663 raft_consensus.cc:513] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.532773 3663 leader_election.cc:290] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.532981 3350 leader_election.cc:343] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 57d26a520a224a3f9e3ab5861700f650
W20250115 10:11:53.533041 3350 leader_election.cc:343] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 57d26a520a224a3f9e3ab5861700f650
I20250115 10:11:53.533071 3350 leader_election.cc:304] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.533142 3663 raft_consensus.cc:2743] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.567662 3484 consensus_peers.cc:487] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3f88d5d54b74f63a94bf88d3a33cfae. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.568925 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bee935a490e8405b98608f6e8d58ef71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.569101 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bee935a490e8405b98608f6e8d58ef71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.569130 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_411a1cb82f3a4db5886867056d2d6513"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.569239 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_411a1cb82f3a4db5886867056d2d6513 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.570540 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.570639 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.572013 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5b91a486a97343dbb17a46e3578b80ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.572125 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b91a486a97343dbb17a46e3578b80ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.572372 3386 tablet_service.cc:1467] Processing CreateTablet for tablet cfcaece8146a4b22af4b47d06feacf9a (DEFAULT_TABLE table=default.Table_bee935a490e8405b98608f6e8d58ef71 [id=7312ffa296ac4354ab60d31e72f1671e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.572384 3384 tablet_service.cc:1467] Processing CreateTablet for tablet b6158fa974ec408bb323f1216b0ff223 (DEFAULT_TABLE table=default.Table_411a1cb82f3a4db5886867056d2d6513 [id=7e0bb36cce704fca84c3fc852b07a3a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.572520 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfcaece8146a4b22af4b47d06feacf9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.573702 3908 tablet_bootstrap.cc:492] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.574044 3908 tablet_bootstrap.cc:654] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.574297 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6158fa974ec408bb323f1216b0ff223. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.576036 3908 tablet_bootstrap.cc:492] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.575985 3671 consensus_queue.cc:1035] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.576081 3908 ts_tablet_manager.cc:1397] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.576198 3908 raft_consensus.cc:357] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.576249 3908 raft_consensus.cc:383] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.576265 3908 raft_consensus.cc:738] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.576303 3908 consensus_queue.cc:260] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.576385 3908 ts_tablet_manager.cc:1428] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.576445 3908 tablet_bootstrap.cc:492] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.576718 3908 tablet_bootstrap.cc:654] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.578781 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 26aea99444b24108883e4fde3f068bad (DEFAULT_TABLE table=default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0 [id=a701448b84194d148b91c6b19d549ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.578881 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26aea99444b24108883e4fde3f068bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.580358 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 83a67ce440634259a36ee85b2db1b215 (DEFAULT_TABLE table=default.Table_5b91a486a97343dbb17a46e3578b80ea [id=4d3a10d579954f9099286160f2a3006d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.580448 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a67ce440634259a36ee85b2db1b215. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.581545 3908 tablet_bootstrap.cc:492] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.581589 3908 ts_tablet_manager.cc:1397] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:11:53.581753 3908 raft_consensus.cc:357] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.581806 3908 raft_consensus.cc:383] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.581827 3908 raft_consensus.cc:738] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.581871 3908 consensus_queue.cc:260] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.581965 3908 ts_tablet_manager.cc:1428] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.582015 3908 tablet_bootstrap.cc:492] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.582401 3908 tablet_bootstrap.cc:654] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.583310 3908 tablet_bootstrap.cc:492] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.583362 3908 ts_tablet_manager.cc:1397] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.583501 3908 raft_consensus.cc:357] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.583578 3908 raft_consensus.cc:383] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.583604 3908 raft_consensus.cc:738] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.583648 3908 consensus_queue.cc:260] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.583766 3908 ts_tablet_manager.cc:1428] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.583829 3908 tablet_bootstrap.cc:492] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.584439 3908 tablet_bootstrap.cc:654] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.585191 3908 tablet_bootstrap.cc:492] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.585242 3908 ts_tablet_manager.cc:1397] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.585386 3908 raft_consensus.cc:357] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.585440 3908 raft_consensus.cc:383] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.585458 3908 raft_consensus.cc:738] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.585497 3908 consensus_queue.cc:260] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.585812 3908 ts_tablet_manager.cc:1428] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.587742 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5f7d3b5c4c684b15bb751f26f4489a43" } new_table_name: "default.Table_e2699e525eac42c6897f2b75b9c505e8" modify_external_catalogs: true
W20250115 10:11:53.588733 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 450ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.588913 4158 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cdb1ea5a27ca44baa3b0fe127143df0b)
I20250115 10:11:53.588968 4158 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:53.589355 4158 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:53.589562 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:53.589953 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_54fd3ba51b8d41d0ba009ef52c0d072a" } modify_external_catalogs: true
I20250115 10:11:53.590013 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_54fd3ba51b8d41d0ba009ef52c0d072a" } modify_external_catalogs: true
I20250115 10:11:53.591274 3923 tablet.cc:1721] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.591526 3921 tablet.cc:1721] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.592574 3770 consensus_queue.cc:1035] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.592892 3919 tablet.cc:1721] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.593039 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e2699e525eac42c6897f2b75b9c505e8" } modify_external_catalogs: true
I20250115 10:11:53.593106 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e2699e525eac42c6897f2b75b9c505e8" } modify_external_catalogs: true
I20250115 10:11:53.593155 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_238340b94d2d44c5b5cf527172ba9d4a" } new_table_name: "default.Table_21b9aca7b4ad47bbb4ef98483a178ee2" modify_external_catalogs: true
I20250115 10:11:53.593047 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_32ddd52e4b2c40e3aeae38afe9c03eff" } new_table_name: "default.Table_abc8b1a96d6a41f2815b44361e6282e3" modify_external_catalogs: true
I20250115 10:11:53.594261 3094 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ec9406dc72bb4e489d76011a69ee2838 (table default.Table_e2699e525eac42c6897f2b75b9c505e8 [id=30103cae3a884979923c62212950f5e1]). Expected version 1 got 0
I20250115 10:11:53.594801 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 9408e398ddef4f5fb49cc4d2fc123ee1
I20250115 10:11:53.594882 3702 consensus_queue.cc:1035] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.595062 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 9408e398ddef4f5fb49cc4d2fc123ee1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.595144 3907 tablet_replica.cc:331] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.595197 3907 raft_consensus.cc:2238] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.595230 3907 raft_consensus.cc:2267] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.595409 3907 ts_tablet_manager.cc:1905] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.595849 3671 consensus_queue.cc:1035] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.596737 3907 ts_tablet_manager.cc:1918] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.596782 3907 log.cc:1198] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/9408e398ddef4f5fb49cc4d2fc123ee1
I20250115 10:11:53.596935 3907 ts_tablet_manager.cc:1939] T 9408e398ddef4f5fb49cc4d2fc123ee1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.597782 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 9408e398ddef4f5fb49cc4d2fc123ee1 (table default.Table_54fd3ba51b8d41d0ba009ef52c0d072a [id=34cb1b392a3a493e8c1cec9e4eb1427d]) successfully deleted
I20250115 10:11:53.598713 3098 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_e2699e525eac42c6897f2b75b9c505e8 [id=30103cae3a884979923c62212950f5e1] alter complete (version 1)
W20250115 10:11:53.599054 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 57d26a520a224a3f9e3ab5861700f650 consensus state has no leader
I20250115 10:11:53.599300 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bec489977ac0405a935e029c1cbacfd2" } modify_external_catalogs: true
I20250115 10:11:53.599349 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bec489977ac0405a935e029c1cbacfd2" } modify_external_catalogs: true
I20250115 10:11:53.599843 3092 catalog_manager.cc:5526] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } }
I20250115 10:11:53.599923 3092 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 6e56c83017b54e65a066e8e377293b13 (table default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a [id=97e1085cf3bc494c8a0a05662b4c2701]). Expected version 1 got 0
I20250115 10:11:53.600992 3923 tablet.cc:1721] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.601063 3919 tablet.cc:1721] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.601610 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:53.601742 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2a5c1bcc0c2f4b58b59cf25bce1e2d62
I20250115 10:11:53.602487 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet ec9406dc72bb4e489d76011a69ee2838 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.602505 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a5c1bcc0c2f4b58b59cf25bce1e2d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.602972 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_411a1cb82f3a4db5886867056d2d6513" } new_table_name: "default.Table_7f7098540b954667b0d1cb7d61e10b23" modify_external_catalogs: true
I20250115 10:11:53.603147 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_74dbe28e3a4f4af69edff5bbb4beae07" } new_table_name: "default.Table_70caeb4fbfda4cfa8cc306d6aac1f734" modify_external_catalogs: true
I20250115 10:11:53.603416 3921 tablet.cc:1721] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:11:53.605463 3099 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6e56c83017b54e65a066e8e377293b13 (table default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a [id=97e1085cf3bc494c8a0a05662b4c2701]). Expected version 1 got 0
I20250115 10:11:53.605609 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 83a67ce440634259a36ee85b2db1b215 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.605649 3907 tablet_replica.cc:331] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.605700 3907 raft_consensus.cc:2238] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:53.605752 3907 raft_consensus.cc:2267] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.605996 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet 26aea99444b24108883e4fde3f068bad from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.606247 3907 ts_tablet_manager.cc:1905] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.606693 3094 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_abc8b1a96d6a41f2815b44361e6282e3 [id=dc0b1482ff3849cebb7afb525dc04264] alter complete (version 1)
W20250115 10:11:53.606904 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6158fa974ec408bb323f1216b0ff223 consensus state has no leader
I20250115 10:11:53.607762 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_358b4ece271b412c8380fe9634da76af" } modify_external_catalogs: true
I20250115 10:11:53.607846 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_358b4ece271b412c8380fe9634da76af" } modify_external_catalogs: true
I20250115 10:11:53.607781 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23e69e38d12043a7aa2f13b9b52848a2" } modify_external_catalogs: true
I20250115 10:11:53.608023 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23e69e38d12043a7aa2f13b9b52848a2" } modify_external_catalogs: true
I20250115 10:11:53.608207 3907 ts_tablet_manager.cc:1918] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:53.608251 3907 log.cc:1198] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:53.608446 3907 ts_tablet_manager.cc:1939] T ec9406dc72bb4e489d76011a69ee2838 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.608609 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 83a67ce440634259a36ee85b2db1b215
I20250115 10:11:53.608680 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 83a67ce440634259a36ee85b2db1b215 deleted and replaced by tablet fb653c1d93014055bf2ef51e14d6e227
I20250115 10:11:53.608783 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 26aea99444b24108883e4fde3f068bad
I20250115 10:11:53.608863 3093 catalog_manager.cc:6596] ReplaceTablet: tablet 26aea99444b24108883e4fde3f068bad deleted and replaced by tablet 6b1e5233cbfb4d438d1afc76ff530e67
I20250115 10:11:53.608909 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 83a67ce440634259a36ee85b2db1b215 with delete_type TABLET_DATA_DELETED (replaced by tablet fb653c1d93014055bf2ef51e14d6e227) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.608968 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 26aea99444b24108883e4fde3f068bad with delete_type TABLET_DATA_DELETED (replaced by tablet 6b1e5233cbfb4d438d1afc76ff530e67) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.608996 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet ec9406dc72bb4e489d76011a69ee2838 (table default.Table_e2699e525eac42c6897f2b75b9c505e8 [id=30103cae3a884979923c62212950f5e1]) successfully deleted
I20250115 10:11:53.609053 3907 tablet_replica.cc:331] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.609107 3907 raft_consensus.cc:2238] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.609184 3907 raft_consensus.cc:2267] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.609184 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet 83a67ce440634259a36ee85b2db1b215 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.609400 3907 ts_tablet_manager.cc:1905] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.609937 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d570061356714d7aacad803bdb523454
I20250115 10:11:53.609993 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:11:53.610183 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet d570061356714d7aacad803bdb523454 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.610179 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d9ba8ec3c47340f4a6a1d9425258380e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.610287 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9ba8ec3c47340f4a6a1d9425258380e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.610414 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 13abbfea00154474b1082cf8ccd14899 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.611688 3386 tablet_service.cc:1467] Processing CreateTablet for tablet fb653c1d93014055bf2ef51e14d6e227 (DEFAULT_TABLE table=default.Table_5b91a486a97343dbb17a46e3578b80ea [id=4d3a10d579954f9099286160f2a3006d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.611733 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 6b1e5233cbfb4d438d1afc76ff530e67 (DEFAULT_TABLE table=default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0 [id=a701448b84194d148b91c6b19d549ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.611820 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb653c1d93014055bf2ef51e14d6e227. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.611943 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b1e5233cbfb4d438d1afc76ff530e67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.612597 3907 ts_tablet_manager.cc:1918] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.612682 3907 log.cc:1198] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2a5c1bcc0c2f4b58b59cf25bce1e2d62
I20250115 10:11:53.612800 3908 tablet_bootstrap.cc:492] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.612869 3907 ts_tablet_manager.cc:1939] T 2a5c1bcc0c2f4b58b59cf25bce1e2d62 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.613277 3908 tablet_bootstrap.cc:654] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.613296 3907 tablet_replica.cc:331] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.613360 3907 raft_consensus.cc:2238] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.613394 3907 raft_consensus.cc:2267] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.613543 3907 ts_tablet_manager.cc:1905] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.613674 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 57d26a520a224a3f9e3ab5861700f650 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.613694 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6e74cc6d45294bcb8341decf3208c794"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.613822 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e74cc6d45294bcb8341decf3208c794 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.614003 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2a5c1bcc0c2f4b58b59cf25bce1e2d62 (table default.Table_bec489977ac0405a935e029c1cbacfd2 [id=30bef360b2a84b139484ca47ff6bb807]) successfully deleted
I20250115 10:11:53.614167 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 7900577b476b46cda59f4010f8e5ddaf (DEFAULT_TABLE table=default.Table_d9ba8ec3c47340f4a6a1d9425258380e [id=75afc9a4cb0945638d6608c44ce822fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.614178 4164 raft_consensus.cc:491] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.614272 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7900577b476b46cda59f4010f8e5ddaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.614373 4164 raft_consensus.cc:513] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
W20250115 10:11:53.614895 3350 leader_election.cc:343] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8dd5539d82ed46b685c80ac5e8a9d49b
I20250115 10:11:53.615180 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 57d26a520a224a3f9e3ab5861700f650
I20250115 10:11:53.615286 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 57d26a520a224a3f9e3ab5861700f650 deleted and replaced by tablet 810a9e36713041b091f3db1f25e11eb3
I20250115 10:11:53.615409 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d26a520a224a3f9e3ab5861700f650 with delete_type TABLET_DATA_DELETED (replaced by tablet 810a9e36713041b091f3db1f25e11eb3) from {username='slave'} at 127.0.0.1:33874
W20250115 10:11:53.615415 3350 leader_election.cc:343] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 8dd5539d82ed46b685c80ac5e8a9d49b
I20250115 10:11:53.615563 3350 leader_election.cc:304] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.615651 4159 raft_consensus.cc:2743] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.615869 4164 leader_election.cc:290] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.616358 3907 ts_tablet_manager.cc:1918] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.616444 3907 log.cc:1198] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/83a67ce440634259a36ee85b2db1b215
I20250115 10:11:53.616658 3907 ts_tablet_manager.cc:1939] T 83a67ce440634259a36ee85b2db1b215 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.616801 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 810a9e36713041b091f3db1f25e11eb3 (DEFAULT_TABLE table=default.Table_21b9aca7b4ad47bbb4ef98483a178ee2 [id=2e150748a33c4179afe9c8697cbb09c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.616894 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 810a9e36713041b091f3db1f25e11eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.617230 3907 tablet_replica.cc:331] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.617331 3907 raft_consensus.cc:2238] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.617344 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 83a67ce440634259a36ee85b2db1b215 (table default.Table_5b91a486a97343dbb17a46e3578b80ea [id=4d3a10d579954f9099286160f2a3006d]) successfully deleted
I20250115 10:11:53.617444 3907 raft_consensus.cc:2267] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.617743 3907 ts_tablet_manager.cc:1905] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.618089 3389 tablet_service.cc:1467] Processing CreateTablet for tablet c0b9be67ae5a44b680e156a7a3536536 (DEFAULT_TABLE table=default.Table_6e74cc6d45294bcb8341decf3208c794 [id=a0f32cfd7db54958806da33c5f429db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.618167 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b9be67ae5a44b680e156a7a3536536. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.618173 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1c51ee8c859f48329d8df6e4ae91b428"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.618271 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c51ee8c859f48329d8df6e4ae91b428 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.618431 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cef254ab258d429a941224cdf63c00a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.618522 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cef254ab258d429a941224cdf63c00a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.619166 3907 ts_tablet_manager.cc:1918] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.619208 3907 log.cc:1198] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/26aea99444b24108883e4fde3f068bad
I20250115 10:11:53.619360 3907 ts_tablet_manager.cc:1939] T 26aea99444b24108883e4fde3f068bad P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.619812 3907 tablet_replica.cc:331] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.619910 3907 raft_consensus.cc:2238] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.619941 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 26aea99444b24108883e4fde3f068bad (table default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0 [id=a701448b84194d148b91c6b19d549ccd]) successfully deleted
I20250115 10:11:53.619982 3907 raft_consensus.cc:2267] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.620075 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 3ab77abe34374a6ba6f30bf3a2bd67de from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.620186 3907 ts_tablet_manager.cc:1905] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.620201 3908 tablet_bootstrap.cc:492] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.620234 3908 ts_tablet_manager.cc:1397] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:11:53.620366 3908 raft_consensus.cc:357] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.620649 3908 raft_consensus.cc:383] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.620663 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_92c3df7773a0409fa3515d97fc032468"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.620703 3908 raft_consensus.cc:738] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:11:53.620755 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92c3df7773a0409fa3515d97fc032468 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.620759 3908 consensus_queue.cc:260] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.620867 3908 ts_tablet_manager.cc:1428] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.620939 3908 tablet_bootstrap.cc:492] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.621428 3908 tablet_bootstrap.cc:654] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.621554 3907 ts_tablet_manager.cc:1918] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.621603 3907 log.cc:1198] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d570061356714d7aacad803bdb523454
I20250115 10:11:53.621760 3907 ts_tablet_manager.cc:1939] T d570061356714d7aacad803bdb523454 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.621789 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4c8b7687d6614ea18a5377539659492c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.621891 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c8b7687d6614ea18a5377539659492c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.622138 3908 tablet_bootstrap.cc:492] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.622182 3908 ts_tablet_manager.cc:1397] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.622335 3908 raft_consensus.cc:357] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.622408 3908 raft_consensus.cc:383] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.622433 3908 raft_consensus.cc:738] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.622478 3908 consensus_queue.cc:260] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.622511 3907 tablet_replica.cc:331] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.622623 3908 ts_tablet_manager.cc:1428] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:11:53.622669 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d570061356714d7aacad803bdb523454 (table default.Table_23e69e38d12043a7aa2f13b9b52848a2 [id=72870ee419d64f87a3c24c163a7202cb]) successfully deleted
I20250115 10:11:53.622638 3907 raft_consensus.cc:2238] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:53.622867 3907 pending_rounds.cc:62] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:11:53.622896 3907 pending_rounds.cc:69] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489500197474304 op_type: NO_OP noop_request { }
I20250115 10:11:53.622928 3907 raft_consensus.cc:2883] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:11:53.622956 3907 raft_consensus.cc:2267] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.622686 3908 tablet_bootstrap.cc:492] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.623467 3908 tablet_bootstrap.cc:654] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.623780 3907 ts_tablet_manager.cc:1905] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.624207 3908 tablet_bootstrap.cc:492] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.624255 3908 ts_tablet_manager.cc:1397] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.624388 3908 raft_consensus.cc:357] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.624435 3908 raft_consensus.cc:383] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.624460 3908 raft_consensus.cc:738] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.624505 3908 consensus_queue.cc:260] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.624644 3908 ts_tablet_manager.cc:1428] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.624711 3908 tablet_bootstrap.cc:492] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.625092 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:53.625136 3908 tablet_bootstrap.cc:654] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.625170 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 3ab77abe34374a6ba6f30bf3a2bd67de deleted and replaced by tablet 199eeec5997f4223b2208eb2634b0cce
I20250115 10:11:53.625840 3908 tablet_bootstrap.cc:492] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.625885 3908 ts_tablet_manager.cc:1397] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.626011 3908 raft_consensus.cc:357] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.626070 3908 raft_consensus.cc:383] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.626106 3908 raft_consensus.cc:738] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.626147 3908 consensus_queue.cc:260] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.626250 3908 ts_tablet_manager.cc:1428] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.626299 3908 tablet_bootstrap.cc:492] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.626698 3908 tablet_bootstrap.cc:654] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.626668 3907 ts_tablet_manager.cc:1918] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.627321 3907 log.cc:1198] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/13abbfea00154474b1082cf8ccd14899
I20250115 10:11:53.627943 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ab77abe34374a6ba6f30bf3a2bd67de with delete_type TABLET_DATA_DELETED (replaced by tablet 199eeec5997f4223b2208eb2634b0cce) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.627949 3907 ts_tablet_manager.cc:1939] T 13abbfea00154474b1082cf8ccd14899 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.628129 3386 tablet_service.cc:1467] Processing CreateTablet for tablet fb6f3f6cdd1b40fe802d16d9c07db283 (DEFAULT_TABLE table=default.Table_1c51ee8c859f48329d8df6e4ae91b428 [id=aa4802b1f2d64fe3973358a17c5ed127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.628218 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb6f3f6cdd1b40fe802d16d9c07db283. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.628338 3907 tablet_replica.cc:331] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.628404 3907 raft_consensus.cc:2238] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.628458 3907 raft_consensus.cc:2267] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.628657 3907 ts_tablet_manager.cc:1905] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.628724 3908 tablet_bootstrap.cc:492] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.628768 3908 ts_tablet_manager.cc:1397] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.628901 3908 raft_consensus.cc:357] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.628947 3908 raft_consensus.cc:383] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.628963 3908 raft_consensus.cc:738] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.628998 3908 consensus_queue.cc:260] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.629066 3908 ts_tablet_manager.cc:1428] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.629571 3908 tablet_bootstrap.cc:492] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.630029 3908 tablet_bootstrap.cc:654] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.630322 3907 ts_tablet_manager.cc:1918] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.630427 3907 log.cc:1198] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/57d26a520a224a3f9e3ab5861700f650
I20250115 10:11:53.630672 3389 tablet_service.cc:1467] Processing CreateTablet for tablet b37d2f57618e4f808e8799fd246b97d1 (DEFAULT_TABLE table=default.Table_cef254ab258d429a941224cdf63c00a4 [id=a4785133cc31487791b54f5858d33e57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.630676 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 13abbfea00154474b1082cf8ccd14899 (table default.Table_358b4ece271b412c8380fe9634da76af [id=2e7d46ae77eb4445ad58baf56cc55cb8]) successfully deleted
I20250115 10:11:53.630722 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 199eeec5997f4223b2208eb2634b0cce (DEFAULT_TABLE table=default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.630784 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37d2f57618e4f808e8799fd246b97d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.630895 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 199eeec5997f4223b2208eb2634b0cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.631436 3908 tablet_bootstrap.cc:492] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.631476 3908 ts_tablet_manager.cc:1397] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.631593 3908 raft_consensus.cc:357] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.631646 3908 raft_consensus.cc:383] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.631669 3908 raft_consensus.cc:738] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.631729 3908 consensus_queue.cc:260] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.631804 3908 ts_tablet_manager.cc:1428] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.632177 3908 tablet_bootstrap.cc:492] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.632210 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 6369536ece374beb836277c7fadeafff (DEFAULT_TABLE table=default.Table_4c8b7687d6614ea18a5377539659492c [id=03b48d4b08244c53bba7b29e9939212a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.632364 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6369536ece374beb836277c7fadeafff. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:11:53.632615 3088 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet b6158fa974ec408bb323f1216b0ff223 (table default.Table_7f7098540b954667b0d1cb7d61e10b23 [id=7e0bb36cce704fca84c3fc852b07a3a7], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b6158fa974ec408bb323f1216b0ff223 consensus state has no leader
I20250115 10:11:53.632637 3908 tablet_bootstrap.cc:654] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.630895 3386 tablet_service.cc:1467] Processing CreateTablet for tablet a996658cf9cf41af8ba6952ef998c676 (DEFAULT_TABLE table=default.Table_92c3df7773a0409fa3515d97fc032468 [id=6e4655f4f7484191843186993a29831b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.633353 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a996658cf9cf41af8ba6952ef998c676. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.633839 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 810a9e36713041b091f3db1f25e11eb3 (table default.Table_21b9aca7b4ad47bbb4ef98483a178ee2 [id=2e150748a33c4179afe9c8697cbb09c7]). Expected version 1 got 0
W20250115 10:11:53.633945 3092 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 810a9e36713041b091f3db1f25e11eb3 (table default.Table_21b9aca7b4ad47bbb4ef98483a178ee2 [id=2e150748a33c4179afe9c8697cbb09c7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 810a9e36713041b091f3db1f25e11eb3 consensus state has no leader
I20250115 10:11:53.634907 3907 ts_tablet_manager.cc:1939] T 57d26a520a224a3f9e3ab5861700f650 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.635129 3907 tablet_replica.cc:331] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.635192 3907 raft_consensus.cc:2238] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.635201 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 57d26a520a224a3f9e3ab5861700f650 (table default.Table_21b9aca7b4ad47bbb4ef98483a178ee2 [id=2e150748a33c4179afe9c8697cbb09c7]) successfully deleted
I20250115 10:11:53.635298 3907 raft_consensus.cc:2267] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.635556 3907 ts_tablet_manager.cc:1905] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.635602 3908 tablet_bootstrap.cc:492] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.635656 3908 ts_tablet_manager.cc:1397] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:11:53.635807 3908 raft_consensus.cc:357] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.635861 3908 raft_consensus.cc:383] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.635881 3908 raft_consensus.cc:738] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.635921 3908 consensus_queue.cc:260] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.636005 3908 ts_tablet_manager.cc:1428] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.636050 3908 tablet_bootstrap.cc:492] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.636595 3908 tablet_bootstrap.cc:654] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.637208 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 199eeec5997f4223b2208eb2634b0cce (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]). Expected version 2 got 0
W20250115 10:11:53.637277 3092 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 199eeec5997f4223b2208eb2634b0cce (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 199eeec5997f4223b2208eb2634b0cce consensus state has no leader
I20250115 10:11:53.637393 3907 ts_tablet_manager.cc:1918] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.637468 3907 log.cc:1198] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:53.637614 3908 tablet_bootstrap.cc:492] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.637660 3908 ts_tablet_manager.cc:1397] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:11:53.637696 3907 ts_tablet_manager.cc:1939] T 3ab77abe34374a6ba6f30bf3a2bd67de P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.637807 3908 raft_consensus.cc:357] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.637859 3908 raft_consensus.cc:383] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.637877 3908 raft_consensus.cc:738] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.637912 3908 consensus_queue.cc:260] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.637996 3908 ts_tablet_manager.cc:1428] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.637995 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3ab77abe34374a6ba6f30bf3a2bd67de (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]) successfully deleted
I20250115 10:11:53.638047 3908 tablet_bootstrap.cc:492] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.638412 3908 tablet_bootstrap.cc:654] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.639257 3908 tablet_bootstrap.cc:492] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.639300 3908 ts_tablet_manager.cc:1397] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.639665 3908 raft_consensus.cc:357] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.639742 3908 raft_consensus.cc:383] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.639766 3908 raft_consensus.cc:738] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.639824 3908 consensus_queue.cc:260] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.640285 3908 ts_tablet_manager.cc:1428] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.640784 3908 tablet_bootstrap.cc:492] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.641454 3908 tablet_bootstrap.cc:654] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.641959 3908 tablet_bootstrap.cc:492] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.642010 3908 ts_tablet_manager.cc:1397] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.642171 3908 raft_consensus.cc:357] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.642243 3908 raft_consensus.cc:383] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.642273 3908 raft_consensus.cc:738] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.642318 3908 consensus_queue.cc:260] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
W20250115 10:11:53.642488 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 450ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.642469 3908 ts_tablet_manager.cc:1428] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
W20250115 10:11:53.643237 3214 consensus_peers.cc:487] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f792ae7d54184207825a92d72bc5a323. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.669582 4164 raft_consensus.cc:491] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.669672 4164 raft_consensus.cc:513] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.669816 4164 leader_election.cc:290] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.670190 3350 leader_election.cc:343] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: b6158fa974ec408bb323f1216b0ff223
W20250115 10:11:53.670274 3350 leader_election.cc:343] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: b6158fa974ec408bb323f1216b0ff223
I20250115 10:11:53.670315 3350 leader_election.cc:304] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.670397 4164 raft_consensus.cc:2743] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.671639 3770 consensus_queue.cc:1035] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.672708 4164 raft_consensus.cc:491] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.672780 4164 raft_consensus.cc:513] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.672899 4164 leader_election.cc:290] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.673101 3214 consensus_peers.cc:487] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9825097e391481da01ad9111c836ec9. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:53.673223 3350 leader_election.cc:343] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6b1e5233cbfb4d438d1afc76ff530e67
W20250115 10:11:53.673295 3350 leader_election.cc:343] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 6b1e5233cbfb4d438d1afc76ff530e67
I20250115 10:11:53.673316 3350 leader_election.cc:304] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.673395 4164 raft_consensus.cc:2743] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.674880 4164 raft_consensus.cc:491] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.674943 4164 raft_consensus.cc:513] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.675073 4164 leader_election.cc:290] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.675276 3350 leader_election.cc:343] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 1a0ff3ac5e2046b6800958a5f1d930d7
W20250115 10:11:53.675338 3350 leader_election.cc:343] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 1a0ff3ac5e2046b6800958a5f1d930d7
I20250115 10:11:53.675372 3350 leader_election.cc:304] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.675441 4164 raft_consensus.cc:2743] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.683583 3214 consensus_peers.cc:487] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86d086cd94664d40a653d64d06438bda. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.702791 3912 consensus_queue.cc:1035] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.703788 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:53.704159 4164 raft_consensus.cc:491] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.704232 4164 raft_consensus.cc:513] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.704284 3092 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:53.704285 3913 consensus_queue.cc:1035] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.704378 4164 leader_election.cc:290] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.704838 4164 raft_consensus.cc:491] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.704900 4164 raft_consensus.cc:513] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.704998 4164 leader_election.cc:290] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.706175 3350 leader_election.cc:343] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 5c19bb75be624574afd9d3e7149bb228
W20250115 10:11:53.706238 3350 leader_election.cc:343] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 5c19bb75be624574afd9d3e7149bb228
I20250115 10:11:53.706270 3350 leader_election.cc:304] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:11:53.706341 3350 leader_election.cc:343] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 6f4e43f651df4f168a9cb701e6eba63a
I20250115 10:11:53.706457 4164 raft_consensus.cc:2743] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.706573 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
W20250115 10:11:53.706851 3350 leader_election.cc:343] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6f4e43f651df4f168a9cb701e6eba63a
I20250115 10:11:53.706895 3350 leader_election.cc:304] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.706950 4164 raft_consensus.cc:2743] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.733664 4164 raft_consensus.cc:491] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.733755 4164 raft_consensus.cc:513] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.733899 4164 leader_election.cc:290] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.734241 3350 leader_election.cc:343] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 91c84b4ba08d4f1ba47147e496a97320
W20250115 10:11:53.734318 3350 leader_election.cc:343] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 91c84b4ba08d4f1ba47147e496a97320
I20250115 10:11:53.734369 3350 leader_election.cc:304] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.734452 4164 raft_consensus.cc:2743] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.738413 4164 raft_consensus.cc:491] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.738499 4164 raft_consensus.cc:513] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.738615 4164 leader_election.cc:290] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.738914 3350 leader_election.cc:343] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 3899cfe388894cfba2c5fc1913274b76
W20250115 10:11:53.738982 3350 leader_election.cc:343] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 3899cfe388894cfba2c5fc1913274b76
I20250115 10:11:53.739005 3350 leader_election.cc:304] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.739065 4164 raft_consensus.cc:2743] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.771129 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_16f774398cbf48c1995d52cd78cdcc93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.771124 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a0fd6052878a42b0b92049669e67dd64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.771344 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f774398cbf48c1995d52cd78cdcc93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:53.771344 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0fd6052878a42b0b92049669e67dd64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.772308 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_05b83e6e2d324d81aa573dbed2412e1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.772423 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05b83e6e2d324d81aa573dbed2412e1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.775944 3386 tablet_service.cc:1467] Processing CreateTablet for tablet bdbdb7427a4f46e389e25bae578d6d8f (DEFAULT_TABLE table=default.Table_16f774398cbf48c1995d52cd78cdcc93 [id=a6864620deaa43bd9734792075941374]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.776134 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdbdb7427a4f46e389e25bae578d6d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.776993 3383 tablet_service.cc:1467] Processing CreateTablet for tablet aa02b378d64e47dba427c1b3fb343786 (DEFAULT_TABLE table=default.Table_05b83e6e2d324d81aa573dbed2412e1d [id=ae8268a5c16147e398da7a47f25ce930]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.777132 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa02b378d64e47dba427c1b3fb343786. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.777618 3908 tablet_bootstrap.cc:492] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.778076 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c87172155ace48d08e75ed7a09b22b49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.778179 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c87172155ace48d08e75ed7a09b22b49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.778215 3908 tablet_bootstrap.cc:654] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.777014 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d87cc0f336ac40678dbc136072425740 (DEFAULT_TABLE table=default.Table_a0fd6052878a42b0b92049669e67dd64 [id=7e51cdd4dc3c4055a6d1cabf8dd065e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.778378 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d87cc0f336ac40678dbc136072425740. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.778834 3908 tablet_bootstrap.cc:492] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.778885 3908 ts_tablet_manager.cc:1397] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.779044 3908 raft_consensus.cc:357] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.779107 3908 raft_consensus.cc:383] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.779131 3908 raft_consensus.cc:738] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.779181 3908 consensus_queue.cc:260] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.779314 3908 ts_tablet_manager.cc:1428] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.779366 3908 tablet_bootstrap.cc:492] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.780436 3908 tablet_bootstrap.cc:654] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.781155 3908 tablet_bootstrap.cc:492] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.781204 3908 ts_tablet_manager.cc:1397] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.781361 3908 raft_consensus.cc:357] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.781412 3908 raft_consensus.cc:383] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.781430 3908 raft_consensus.cc:738] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.781457 3908 consensus_queue.cc:260] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.781553 3908 ts_tablet_manager.cc:1428] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.781606 3908 tablet_bootstrap.cc:492] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.782006 3908 tablet_bootstrap.cc:654] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.782523 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 2e0dc7d9d82d46d482d516453d419fd8 (DEFAULT_TABLE table=default.Table_c87172155ace48d08e75ed7a09b22b49 [id=f4ea801fc9d34c1fba554d5ac8b081ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.782624 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e0dc7d9d82d46d482d516453d419fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.783411 3908 tablet_bootstrap.cc:492] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.783452 3908 ts_tablet_manager.cc:1397] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.783558 3908 raft_consensus.cc:357] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.783607 3908 raft_consensus.cc:383] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.783628 3908 raft_consensus.cc:738] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.783679 3908 consensus_queue.cc:260] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.783792 3908 ts_tablet_manager.cc:1428] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.783871 3908 tablet_bootstrap.cc:492] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.784355 3908 tablet_bootstrap.cc:654] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.785069 3908 tablet_bootstrap.cc:492] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.785118 3908 ts_tablet_manager.cc:1397] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.785272 3908 raft_consensus.cc:357] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.785334 3908 raft_consensus.cc:383] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.785365 3908 raft_consensus.cc:738] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.785405 3908 consensus_queue.cc:260] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.785596 3908 ts_tablet_manager.cc:1428] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.789965 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5b91a486a97343dbb17a46e3578b80ea" } new_table_name: "default.Table_bef3ed34ff6c40de921f8b991814dd65" modify_external_catalogs: true
W20250115 10:11:53.790822 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb653c1d93014055bf2ef51e14d6e227 consensus state has no leader
W20250115 10:11:53.792804 3484 consensus_peers.cc:487] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3096adefffe04e008f58ecba3c3dd633. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.793516 4164 raft_consensus.cc:491] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.793565 4164 raft_consensus.cc:513] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.793696 4164 leader_election.cc:290] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.793941 3350 leader_election.cc:343] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 9f9aed809eb74964a1965a5b73807725
W20250115 10:11:53.794013 3350 leader_election.cc:343] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 9f9aed809eb74964a1965a5b73807725
I20250115 10:11:53.794044 3350 leader_election.cc:304] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.794124 4164 raft_consensus.cc:2743] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.795418 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ad50056dab124052a1c2db8288f01386" } modify_external_catalogs: true
I20250115 10:11:53.795472 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ad50056dab124052a1c2db8288f01386" } modify_external_catalogs: true
I20250115 10:11:53.796397 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:11:53.796574 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 01a8681daa9b459ba85dea9410d83256 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.796658 3907 tablet_replica.cc:331] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.796717 3907 raft_consensus.cc:2238] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.796756 3907 raft_consensus.cc:2267] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.796904 3907 ts_tablet_manager.cc:1905] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.797886 4164 raft_consensus.cc:491] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.797940 4164 raft_consensus.cc:513] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.798054 4164 leader_election.cc:290] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.798445 3350 leader_election.cc:343] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: a996658cf9cf41af8ba6952ef998c676
W20250115 10:11:53.798457 3214 consensus_peers.cc:487] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.798460 3770 consensus_queue.cc:1035] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:11:53.798697 3350 leader_election.cc:343] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: a996658cf9cf41af8ba6952ef998c676
I20250115 10:11:53.798746 3350 leader_election.cc:304] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.798821 4164 raft_consensus.cc:2743] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.798709 3907 ts_tablet_manager.cc:1918] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:53.798990 3907 log.cc:1198] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/01a8681daa9b459ba85dea9410d83256
I20250115 10:11:53.799188 3907 ts_tablet_manager.cc:1939] T 01a8681daa9b459ba85dea9410d83256 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.799491 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0805564dd00b4390a58f127f7f1e316c" } new_table_name: "default.Table_2aac3f8e33724b08aef2d33299a13414" modify_external_catalogs: true
I20250115 10:11:53.799590 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 01a8681daa9b459ba85dea9410d83256 (table default.Table_ad50056dab124052a1c2db8288f01386 [id=9b3ecdf3104a477199cf73b7b0d78155]) successfully deleted
I20250115 10:11:53.799628 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_21b9aca7b4ad47bbb4ef98483a178ee2" } new_table_name: "default.Table_7697fdce596b4cae9d978e17f38985ca" modify_external_catalogs: true
W20250115 10:11:53.801291 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 810a9e36713041b091f3db1f25e11eb3 consensus state has no leader
I20250115 10:11:53.802460 3923 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:53.802572 3921 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:53.802706 3919 tablet.cc:1721] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:53.803138 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_58352e733c08438aa7c9e60115cd00d9" } modify_external_catalogs: true
I20250115 10:11:53.803192 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_58352e733c08438aa7c9e60115cd00d9" } modify_external_catalogs: true
I20250115 10:11:53.803437 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5cd37320d6f94090b33d5264d7ae3be6" } modify_external_catalogs: true
I20250115 10:11:53.803488 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5cd37320d6f94090b33d5264d7ae3be6" } modify_external_catalogs: true
I20250115 10:11:53.804250 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 373997090ec44e6e8632d42a6465067f
I20250115 10:11:53.805073 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 8dd5539d82ed46b685c80ac5e8a9d49b
I20250115 10:11:53.805823 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 8dd5539d82ed46b685c80ac5e8a9d49b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.805904 3907 tablet_replica.cc:331] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.805944 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 373997090ec44e6e8632d42a6465067f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.805974 3907 raft_consensus.cc:2238] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.806005 3907 raft_consensus.cc:2267] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.806188 3907 ts_tablet_manager.cc:1905] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.806420 3093 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_2aac3f8e33724b08aef2d33299a13414 [id=ab569ac74bbb44f1913506709002a4c4] alter complete (version 2)
I20250115 10:11:53.807375 3907 ts_tablet_manager.cc:1918] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.807416 3907 log.cc:1198] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/8dd5539d82ed46b685c80ac5e8a9d49b
I20250115 10:11:53.807574 3907 ts_tablet_manager.cc:1939] T 8dd5539d82ed46b685c80ac5e8a9d49b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.807886 3907 tablet_replica.cc:331] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.807987 3907 raft_consensus.cc:2238] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.807982 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 8dd5539d82ed46b685c80ac5e8a9d49b (table default.Table_5cd37320d6f94090b33d5264d7ae3be6 [id=97bb2abb27944d3cbc3b124f774b00fd]) successfully deleted
I20250115 10:11:53.808082 3907 raft_consensus.cc:2267] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.808157 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a0fd6052878a42b0b92049669e67dd64" } new_table_name: "default.Table_82afd111262349548f34d91b87848649" modify_external_catalogs: true
I20250115 10:11:53.808192 3907 ts_tablet_manager.cc:1905] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.808336 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_67925ff15a2f42ef822f05595f8587a9" } new_table_name: "default.Table_5c8aa519960344fba99ce14770b775e8" modify_external_catalogs: true
W20250115 10:11:53.809175 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d87cc0f336ac40678dbc136072425740 consensus state has no leader
I20250115 10:11:53.809273 3907 ts_tablet_manager.cc:1918] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.809311 3907 log.cc:1198] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/373997090ec44e6e8632d42a6465067f
I20250115 10:11:53.809603 3907 ts_tablet_manager.cc:1939] T 373997090ec44e6e8632d42a6465067f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.810056 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 373997090ec44e6e8632d42a6465067f (table default.Table_58352e733c08438aa7c9e60115cd00d9 [id=153421886fa64ff88c4c955b3563eb0d]) successfully deleted
I20250115 10:11:53.810534 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet 55fe5ef291454df2a788197943225250 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.810626 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a071d084a3a040bfb3bc742b2d550241" } modify_external_catalogs: true
W20250115 10:11:53.810544 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a65b655fb9a84e8d9214cb2b6872cceb consensus state has no leader
I20250115 10:11:53.810689 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a071d084a3a040bfb3bc742b2d550241" } modify_external_catalogs: true
I20250115 10:11:53.810811 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet a996658cf9cf41af8ba6952ef998c676 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.811017 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_16f774398cbf48c1995d52cd78cdcc93" } modify_external_catalogs: true
I20250115 10:11:53.811061 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_16f774398cbf48c1995d52cd78cdcc93" } modify_external_catalogs: true
I20250115 10:11:53.811837 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 55fe5ef291454df2a788197943225250
I20250115 10:11:53.811905 3093 catalog_manager.cc:6596] ReplaceTablet: tablet 55fe5ef291454df2a788197943225250 deleted and replaced by tablet 8133c8cadd73432d8c9cd8affb930359
I20250115 10:11:53.812002 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 3899cfe388894cfba2c5fc1913274b76 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.812104 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 55fe5ef291454df2a788197943225250 with delete_type TABLET_DATA_DELETED (replaced by tablet 8133c8cadd73432d8c9cd8affb930359) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.812127 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cc3e18bf8fbf480c9b35e7d05c3dd3e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.812223 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc3e18bf8fbf480c9b35e7d05c3dd3e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.812304 3907 tablet_replica.cc:331] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.812358 3907 raft_consensus.cc:2238] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.812402 3907 raft_consensus.cc:2267] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.812489 3907 ts_tablet_manager.cc:1905] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.812629 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet a996658cf9cf41af8ba6952ef998c676
I20250115 10:11:53.812670 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 08bc2865f5c34a05a7d02fbc2e8c0504
I20250115 10:11:53.812700 3095 catalog_manager.cc:6596] ReplaceTablet: tablet a996658cf9cf41af8ba6952ef998c676 deleted and replaced by tablet 1730b88414f04cad8b2991a2ef95f39d
I20250115 10:11:53.812755 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet bdbdb7427a4f46e389e25bae578d6d8f
I20250115 10:11:53.813213 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 08bc2865f5c34a05a7d02fbc2e8c0504 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.813294 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbdb7427a4f46e389e25bae578d6d8f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.813333 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet a996658cf9cf41af8ba6952ef998c676 with delete_type TABLET_DATA_DELETED (replaced by tablet 1730b88414f04cad8b2991a2ef95f39d) from {username='slave'} at 127.0.0.1:33874
W20250115 10:11:53.813542 3484 consensus_peers.cc:487] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f559e7cafb04ae39af12e7681bbaf24. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.813652 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 3899cfe388894cfba2c5fc1913274b76
I20250115 10:11:53.813712 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 3899cfe388894cfba2c5fc1913274b76 deleted and replaced by tablet ad9e93adb127417abfa699aa1af03b49
I20250115 10:11:53.813851 3907 ts_tablet_manager.cc:1918] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.813896 3907 log.cc:1198] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/55fe5ef291454df2a788197943225250
I20250115 10:11:53.814038 3907 ts_tablet_manager.cc:1939] T 55fe5ef291454df2a788197943225250 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.814411 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3899cfe388894cfba2c5fc1913274b76 with delete_type TABLET_DATA_DELETED (replaced by tablet ad9e93adb127417abfa699aa1af03b49) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.814518 3907 tablet_replica.cc:331] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.814602 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 55fe5ef291454df2a788197943225250 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96]) successfully deleted
I20250115 10:11:53.814612 3907 raft_consensus.cc:2238] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.814649 3907 raft_consensus.cc:2267] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.814743 3907 ts_tablet_manager.cc:1905] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.815655 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 1730b88414f04cad8b2991a2ef95f39d (DEFAULT_TABLE table=default.Table_92c3df7773a0409fa3515d97fc032468 [id=6e4655f4f7484191843186993a29831b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.815699 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 8133c8cadd73432d8c9cd8affb930359 (DEFAULT_TABLE table=default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.815778 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1730b88414f04cad8b2991a2ef95f39d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.815829 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8133c8cadd73432d8c9cd8affb930359. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.815930 3383 tablet_service.cc:1467] Processing CreateTablet for tablet ad9e93adb127417abfa699aa1af03b49 (DEFAULT_TABLE table=default.Table_2cc5b811bbf747c4826887cbeda26663 [id=3cd3caf22252453581aa9f7dfce9d06b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.816042 3907 ts_tablet_manager.cc:1918] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.816067 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9e93adb127417abfa699aa1af03b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.816082 3907 log.cc:1198] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/08bc2865f5c34a05a7d02fbc2e8c0504
I20250115 10:11:53.816224 3907 ts_tablet_manager.cc:1939] T 08bc2865f5c34a05a7d02fbc2e8c0504 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.816543 3907 tablet_replica.cc:331] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.816589 3907 raft_consensus.cc:2238] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.816614 3907 raft_consensus.cc:2267] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.817124 3907 ts_tablet_manager.cc:1905] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.817298 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 08bc2865f5c34a05a7d02fbc2e8c0504 (table default.Table_a071d084a3a040bfb3bc742b2d550241 [id=176f8d4264144007a0d874e4d96e6612]) successfully deleted
I20250115 10:11:53.817481 3908 tablet_bootstrap.cc:492] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.817902 3908 tablet_bootstrap.cc:654] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.818547 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet cf7cad91ebd247dc9b1ad9512dd8d347 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.818576 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 53126db6f3d74300a68c2d507bdc7be9 (DEFAULT_TABLE table=default.Table_cc3e18bf8fbf480c9b35e7d05c3dd3e7 [id=16679f57872941e0b18e771e0fa4fa8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.818648 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53126db6f3d74300a68c2d507bdc7be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.818821 3907 ts_tablet_manager.cc:1918] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.818872 3907 log.cc:1198] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/bdbdb7427a4f46e389e25bae578d6d8f
I20250115 10:11:53.818928 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1571f3da02b9481a8163c00c581f3f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.819016 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1571f3da02b9481a8163c00c581f3f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.819072 3907 ts_tablet_manager.cc:1939] T bdbdb7427a4f46e389e25bae578d6d8f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.819396 3907 tablet_replica.cc:331] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.819402 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet bdbdb7427a4f46e389e25bae578d6d8f (table default.Table_16f774398cbf48c1995d52cd78cdcc93 [id=a6864620deaa43bd9734792075941374]) successfully deleted
I20250115 10:11:53.819453 3908 tablet_bootstrap.cc:492] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.819500 3907 raft_consensus.cc:2238] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.819494 3908 ts_tablet_manager.cc:1397] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.819551 3907 raft_consensus.cc:2267] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.819685 3907 ts_tablet_manager.cc:1905] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.819692 3908 raft_consensus.cc:357] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.819794 3908 raft_consensus.cc:383] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.819818 3908 raft_consensus.cc:738] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.819876 3908 consensus_queue.cc:260] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.820066 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dc8f47a21c744ecc997b03e11e66c014"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.820164 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc8f47a21c744ecc997b03e11e66c014 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.820241 3908 ts_tablet_manager.cc:1428] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.820297 3908 tablet_bootstrap.cc:492] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.820585 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet cf7cad91ebd247dc9b1ad9512dd8d347
I20250115 10:11:53.820649 3099 catalog_manager.cc:6596] ReplaceTablet: tablet cf7cad91ebd247dc9b1ad9512dd8d347 deleted and replaced by tablet 76db7eec08534e86b14b11b13205e43a
I20250115 10:11:53.821003 3908 tablet_bootstrap.cc:654] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.821125 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet cf7cad91ebd247dc9b1ad9512dd8d347 with delete_type TABLET_DATA_DELETED (replaced by tablet 76db7eec08534e86b14b11b13205e43a) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.821825 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b5f15867176642cca77684583cdacba2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.821913 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5f15867176642cca77684583cdacba2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.822243 3907 ts_tablet_manager.cc:1918] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.822314 3907 log.cc:1198] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/a996658cf9cf41af8ba6952ef998c676
I20250115 10:11:53.822350 3908 tablet_bootstrap.cc:492] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.822399 3908 ts_tablet_manager.cc:1397] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.822564 3907 ts_tablet_manager.cc:1939] T a996658cf9cf41af8ba6952ef998c676 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.822676 3908 raft_consensus.cc:357] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.822769 3908 raft_consensus.cc:383] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.822788 3908 raft_consensus.cc:738] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.822830 3908 consensus_queue.cc:260] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.822793 3907 tablet_replica.cc:331] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.822991 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet a996658cf9cf41af8ba6952ef998c676 (table default.Table_92c3df7773a0409fa3515d97fc032468 [id=6e4655f4f7484191843186993a29831b]) successfully deleted
I20250115 10:11:53.823036 3908 ts_tablet_manager.cc:1428] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.823179 3908 tablet_bootstrap.cc:492] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.823241 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 76db7eec08534e86b14b11b13205e43a (DEFAULT_TABLE table=default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.823323 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76db7eec08534e86b14b11b13205e43a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.824105 3908 tablet_bootstrap.cc:654] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.824219 3907 raft_consensus.cc:2238] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.824257 3907 raft_consensus.cc:2267] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.824594 3095 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8133c8cadd73432d8c9cd8affb930359 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96]). Expected version 1 got 0
W20250115 10:11:53.824666 3095 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8133c8cadd73432d8c9cd8affb930359 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8133c8cadd73432d8c9cd8affb930359 consensus state has no leader
I20250115 10:11:53.824735 3908 tablet_bootstrap.cc:492] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.824781 3908 ts_tablet_manager.cc:1397] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.824923 3908 raft_consensus.cc:357] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.824981 3908 raft_consensus.cc:383] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.825001 3908 raft_consensus.cc:738] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.825039 3908 consensus_queue.cc:260] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.825122 3908 ts_tablet_manager.cc:1428] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.825167 3908 tablet_bootstrap.cc:492] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.825528 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 2d4c2f9d44764e8d88fffd93fe947f78 (DEFAULT_TABLE table=default.Table_1571f3da02b9481a8163c00c581f3f80 [id=99fd0a07ef8942858c09fbf1907d0f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.825575 3907 ts_tablet_manager.cc:1905] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.825595 3908 tablet_bootstrap.cc:654] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.825632 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d4c2f9d44764e8d88fffd93fe947f78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.826432 3908 tablet_bootstrap.cc:492] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.826471 3908 ts_tablet_manager.cc:1397] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.826577 3908 raft_consensus.cc:357] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.826619 3908 raft_consensus.cc:383] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.826633 3908 raft_consensus.cc:738] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.826668 3908 consensus_queue.cc:260] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.826757 3908 ts_tablet_manager.cc:1428] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.826812 3908 tablet_bootstrap.cc:492] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.827016 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 461bf67c7b1c43ecb5e503f40fdb882a (DEFAULT_TABLE table=default.Table_b5f15867176642cca77684583cdacba2 [id=8c1e3e6aaf844789b91efddc0ef93873]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.827105 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461bf67c7b1c43ecb5e503f40fdb882a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.827056 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_446ee97b467b48fa80421dafe8cb58d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.827147 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_446ee97b467b48fa80421dafe8cb58d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.827880 3093 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8133c8cadd73432d8c9cd8affb930359 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96]). Expected version 1 got 0
I20250115 10:11:53.828125 3908 tablet_bootstrap.cc:654] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.828275 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f14d6f9b79af4d54a2392bd9c010335a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.828372 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f14d6f9b79af4d54a2392bd9c010335a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.828639 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet c0b9be67ae5a44b680e156a7a3536536 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:53.829119 3389 tablet_service.cc:1467] Processing CreateTablet for tablet e3d09b8bb1cc4a1083848d28e7e09fea (DEFAULT_TABLE table=default.Table_dc8f47a21c744ecc997b03e11e66c014 [id=a6f1ba8d7d0f478ab5280106e7e5a215]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.829222 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3d09b8bb1cc4a1083848d28e7e09fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.830173 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet c0b9be67ae5a44b680e156a7a3536536
I20250115 10:11:53.830245 3092 catalog_manager.cc:6596] ReplaceTablet: tablet c0b9be67ae5a44b680e156a7a3536536 deleted and replaced by tablet 2de54990820943df99bfc6c61cce292c
I20250115 10:11:53.830448 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet c0b9be67ae5a44b680e156a7a3536536 with delete_type TABLET_DATA_DELETED (replaced by tablet 2de54990820943df99bfc6c61cce292c) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.830988 3907 ts_tablet_manager.cc:1918] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.831038 3907 log.cc:1198] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3899cfe388894cfba2c5fc1913274b76
I20250115 10:11:53.831257 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 6137a5bb4b2c4df29253ecd340653159 (DEFAULT_TABLE table=default.Table_446ee97b467b48fa80421dafe8cb58d2 [id=bc38bb8a517d4c83b535fb7031ef8295]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.831349 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6137a5bb4b2c4df29253ecd340653159. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.831467 3907 ts_tablet_manager.cc:1939] T 3899cfe388894cfba2c5fc1913274b76 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.831693 3907 tablet_replica.cc:331] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.831802 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3899cfe388894cfba2c5fc1913274b76 (table default.Table_2cc5b811bbf747c4826887cbeda26663 [id=3cd3caf22252453581aa9f7dfce9d06b]) successfully deleted
I20250115 10:11:53.831809 3907 raft_consensus.cc:2238] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.831844 3907 raft_consensus.cc:2267] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.831930 3907 ts_tablet_manager.cc:1905] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.832351 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4f45edb2d9cb4cb5bba2110991d1f164 (DEFAULT_TABLE table=default.Table_f14d6f9b79af4d54a2392bd9c010335a [id=f82c6aec629f4a298f4382ab7359b1ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.832384 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 2de54990820943df99bfc6c61cce292c (DEFAULT_TABLE table=default.Table_6e74cc6d45294bcb8341decf3208c794 [id=a0f32cfd7db54958806da33c5f429db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.832638 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de54990820943df99bfc6c61cce292c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.833017 3907 ts_tablet_manager.cc:1918] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.833055 3907 log.cc:1198] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/cf7cad91ebd247dc9b1ad9512dd8d347
I20250115 10:11:53.833199 3907 ts_tablet_manager.cc:1939] T cf7cad91ebd247dc9b1ad9512dd8d347 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.833469 3907 tablet_replica.cc:331] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.833518 3907 raft_consensus.cc:2238] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.833565 3907 raft_consensus.cc:2267] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.833637 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f45edb2d9cb4cb5bba2110991d1f164. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.833707 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet cf7cad91ebd247dc9b1ad9512dd8d347 (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:53.833788 3907 ts_tablet_manager.cc:1905] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:53.833799 3908 tablet_bootstrap.cc:492] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.833855 3908 ts_tablet_manager.cc:1397] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:11:53.833977 3908 raft_consensus.cc:357] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.834038 3908 raft_consensus.cc:383] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.834064 3908 raft_consensus.cc:738] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.834105 3908 consensus_queue.cc:260] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.834445 3908 ts_tablet_manager.cc:1428] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:11:53.834513 3908 tablet_bootstrap.cc:492] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.834967 3907 ts_tablet_manager.cc:1918] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:53.835023 3907 log.cc:1198] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/c0b9be67ae5a44b680e156a7a3536536
I20250115 10:11:53.835177 3908 tablet_bootstrap.cc:654] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.835194 3907 ts_tablet_manager.cc:1939] T c0b9be67ae5a44b680e156a7a3536536 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:53.835472 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet c0b9be67ae5a44b680e156a7a3536536 (table default.Table_6e74cc6d45294bcb8341decf3208c794 [id=a0f32cfd7db54958806da33c5f429db8]) successfully deleted
I20250115 10:11:53.835672 3908 tablet_bootstrap.cc:492] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.835734 3908 ts_tablet_manager.cc:1397] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.835774 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 76db7eec08534e86b14b11b13205e43a (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]). Expected version 3 got 0
W20250115 10:11:53.835848 3092 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 76db7eec08534e86b14b11b13205e43a (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 76db7eec08534e86b14b11b13205e43a consensus state has no leader
I20250115 10:11:53.835908 3908 raft_consensus.cc:357] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.835975 3908 raft_consensus.cc:383] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.835994 3908 raft_consensus.cc:738] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.836031 3908 consensus_queue.cc:260] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.836136 3908 ts_tablet_manager.cc:1428] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.836210 3908 tablet_bootstrap.cc:492] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.836771 3908 tablet_bootstrap.cc:654] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.837411 3908 tablet_bootstrap.cc:492] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.837459 3908 ts_tablet_manager.cc:1397] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.837613 3908 raft_consensus.cc:357] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.837669 3908 raft_consensus.cc:383] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.837685 3908 raft_consensus.cc:738] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.837730 3908 consensus_queue.cc:260] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.837808 3908 ts_tablet_manager.cc:1428] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.837865 3908 tablet_bootstrap.cc:492] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.838243 3908 tablet_bootstrap.cc:654] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.838937 3908 tablet_bootstrap.cc:492] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.838979 3908 ts_tablet_manager.cc:1397] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.839159 3908 raft_consensus.cc:357] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.839210 3908 raft_consensus.cc:383] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.839233 3908 raft_consensus.cc:738] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.839273 3908 consensus_queue.cc:260] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.839380 3908 ts_tablet_manager.cc:1428] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.839485 3908 tablet_bootstrap.cc:492] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.839872 3908 tablet_bootstrap.cc:654] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.840446 3908 tablet_bootstrap.cc:492] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.840489 3908 ts_tablet_manager.cc:1397] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.840622 3908 raft_consensus.cc:357] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.840687 3908 raft_consensus.cc:383] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.840706 3908 raft_consensus.cc:738] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.840757 3908 consensus_queue.cc:260] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.840859 3908 ts_tablet_manager.cc:1428] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.840939 3908 tablet_bootstrap.cc:492] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.841100 4164 raft_consensus.cc:491] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.841157 4164 raft_consensus.cc:513] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.841246 4164 leader_election.cc:290] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:53.841464 3908 tablet_bootstrap.cc:654] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:11:53.841647 3350 leader_election.cc:343] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: fb6f3f6cdd1b40fe802d16d9c07db283
W20250115 10:11:53.842351 3350 leader_election.cc:343] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: fb6f3f6cdd1b40fe802d16d9c07db283
I20250115 10:11:53.842481 3350 leader_election.cc:304] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.842551 4164 raft_consensus.cc:2743] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.842559 3908 tablet_bootstrap.cc:492] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.842608 3908 ts_tablet_manager.cc:1397] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.842787 3908 raft_consensus.cc:357] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.842846 3908 raft_consensus.cc:383] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.842864 3908 raft_consensus.cc:738] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.842941 3908 consensus_queue.cc:260] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.843156 3908 ts_tablet_manager.cc:1428] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.843308 3908 tablet_bootstrap.cc:492] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.843855 3908 tablet_bootstrap.cc:654] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.844691 3908 tablet_bootstrap.cc:492] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.844739 3908 ts_tablet_manager.cc:1397] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.844877 3908 raft_consensus.cc:357] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.844949 3908 raft_consensus.cc:383] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.845007 3908 raft_consensus.cc:738] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.845072 3908 consensus_queue.cc:260] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.845170 3908 ts_tablet_manager.cc:1428] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.859458 4164 raft_consensus.cc:491] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.859548 4164 raft_consensus.cc:513] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:53.859675 4164 leader_election.cc:290] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.860087 3350 leader_election.cc:343] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 9ed1f31252c648d8bd444d6558483cac
W20250115 10:11:53.860165 3350 leader_election.cc:343] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 9ed1f31252c648d8bd444d6558483cac
I20250115 10:11:53.860194 3350 leader_election.cc:304] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.860263 4164 raft_consensus.cc:2743] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.863626 3912 consensus_queue.cc:1035] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:11:53.870263 2944 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01285bc3401243e9bcbba5062c80dbfa consensus state has no leader
I20250115 10:11:53.871369 4164 raft_consensus.cc:491] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.871424 4164 raft_consensus.cc:513] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.871573 4164 leader_election.cc:290] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.871873 3350 leader_election.cc:343] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 6369536ece374beb836277c7fadeafff
W20250115 10:11:53.871946 3350 leader_election.cc:343] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6369536ece374beb836277c7fadeafff
I20250115 10:11:53.871982 3350 leader_election.cc:304] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.872054 4164 raft_consensus.cc:2743] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.873752 3702 consensus_queue.cc:1035] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.875608 3912 consensus_queue.cc:1035] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:11:53.876192 3092 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f889cc1201404c8691bf01256750e244 (table default.Table_e5550426b49241a48cac19af16d12519 [id=1ac3f51295024b83b64f69df31a970d2]). Expected version 1 got 0
I20250115 10:11:53.876639 3092 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f889cc1201404c8691bf01256750e244 (table default.Table_e5550426b49241a48cac19af16d12519 [id=1ac3f51295024b83b64f69df31a970d2]). Expected version 1 got 0
W20250115 10:11:53.881254 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 740ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.901115 4164 raft_consensus.cc:491] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.901197 4164 raft_consensus.cc:513] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.901327 4164 leader_election.cc:290] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.901926 3350 leader_election.cc:343] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 1730b88414f04cad8b2991a2ef95f39d
W20250115 10:11:53.902010 3350 leader_election.cc:343] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 1730b88414f04cad8b2991a2ef95f39d
I20250115 10:11:53.902041 3350 leader_election.cc:304] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.902127 4164 raft_consensus.cc:2743] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.916003 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 740ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:53.917297 4164 raft_consensus.cc:491] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.917363 4164 raft_consensus.cc:513] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.917498 4164 leader_election.cc:290] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.917819 3350 leader_election.cc:343] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: b37d2f57618e4f808e8799fd246b97d1
W20250115 10:11:53.917893 3350 leader_election.cc:343] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: b37d2f57618e4f808e8799fd246b97d1
I20250115 10:11:53.917915 3350 leader_election.cc:304] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.917980 4164 raft_consensus.cc:2743] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:53.962188 3484 consensus_peers.cc:487] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ab77abe34374a6ba6f30bf3a2bd67de. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:53.963184 4164 raft_consensus.cc:491] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.963274 4164 raft_consensus.cc:513] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.963397 4164 leader_election.cc:290] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.963691 3350 leader_election.cc:343] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: ad9e93adb127417abfa699aa1af03b49
W20250115 10:11:53.963784 3350 leader_election.cc:343] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: ad9e93adb127417abfa699aa1af03b49
I20250115 10:11:53.963814 3350 leader_election.cc:304] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.963900 4164 raft_consensus.cc:2743] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.974383 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c93e104be3004c1ebcfb3a75b1de30a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:53.974406 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_af73bb16736c4ae794942a4464f7ad3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.974556 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93e104be3004c1ebcfb3a75b1de30a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:53.974583 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af73bb16736c4ae794942a4464f7ad3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.975250 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3f969226dcf64b9e8d5d6e561088c83d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.975348 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f969226dcf64b9e8d5d6e561088c83d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.978011 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4e6a33be02774b7e888193b60ba21923 (DEFAULT_TABLE table=default.Table_af73bb16736c4ae794942a4464f7ad3d [id=eab8a311779041dcbfae08dc483a9b6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.978163 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e6a33be02774b7e888193b60ba21923. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.978889 3383 tablet_service.cc:1467] Processing CreateTablet for tablet f5ee2fd58ed741218b4ee6461b6f6c51 (DEFAULT_TABLE table=default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.978917 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 7b008f956a8e46b583b951b2e605c630 (DEFAULT_TABLE table=default.Table_c93e104be3004c1ebcfb3a75b1de30a8 [id=a4e2127fb8624f16afed55f89d949842]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.979005 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ee2fd58ed741218b4ee6461b6f6c51. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.979113 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b008f956a8e46b583b951b2e605c630. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.979635 3908 tablet_bootstrap.cc:492] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.980161 3908 tablet_bootstrap.cc:654] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.980734 3908 tablet_bootstrap.cc:492] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.980787 3908 ts_tablet_manager.cc:1397] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.980865 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bd5e675da7244cc5abfbb44a3e302520"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:53.980953 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd5e675da7244cc5abfbb44a3e302520 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:53.980935 3908 raft_consensus.cc:357] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.980988 3908 raft_consensus.cc:383] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.981009 3908 raft_consensus.cc:738] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.981055 3908 consensus_queue.cc:260] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.981168 3908 ts_tablet_manager.cc:1428] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.981216 3908 tablet_bootstrap.cc:492] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.981520 3908 tablet_bootstrap.cc:654] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.982336 3908 tablet_bootstrap.cc:492] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.982380 3908 ts_tablet_manager.cc:1397] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:53.982548 3908 raft_consensus.cc:357] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.982609 3908 raft_consensus.cc:383] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.982630 3908 raft_consensus.cc:738] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.982677 3908 consensus_queue.cc:260] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.982820 3908 ts_tablet_manager.cc:1428] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.982889 3908 tablet_bootstrap.cc:492] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.983434 3908 tablet_bootstrap.cc:654] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.984441 3908 tablet_bootstrap.cc:492] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.984488 3908 ts_tablet_manager.cc:1397] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:11:53.984500 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4544187adde94a72a2ceafc0bfea9a3e (DEFAULT_TABLE table=default.Table_bd5e675da7244cc5abfbb44a3e302520 [id=37b88cda84214471b3d4f26ebdfb475e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:11:53.984606 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4544187adde94a72a2ceafc0bfea9a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:11:53.984622 3908 raft_consensus.cc:357] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.984679 3908 raft_consensus.cc:383] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.984699 3908 raft_consensus.cc:738] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.984741 3908 consensus_queue.cc:260] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.984823 3908 ts_tablet_manager.cc:1428] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.985885 3908 tablet_bootstrap.cc:492] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:11:53.986279 3908 tablet_bootstrap.cc:654] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:11:53.986755 3908 tablet_bootstrap.cc:492] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:11:53.986796 3908 ts_tablet_manager.cc:1397] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:53.986913 3908 raft_consensus.cc:357] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.986958 3908 raft_consensus.cc:383] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:11:53.986971 3908 raft_consensus.cc:738] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:11:53.987005 3908 consensus_queue.cc:260] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.987093 3908 ts_tablet_manager.cc:1428] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:53.991290 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_446ee97b467b48fa80421dafe8cb58d2" } new_table_name: "default.Table_9cdf22ad1fd140bb9a95640f58137d75" modify_external_catalogs: true
W20250115 10:11:53.992193 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6137a5bb4b2c4df29253ecd340653159 consensus state has no leader
I20250115 10:11:53.994125 4164 raft_consensus.cc:491] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.994169 4164 raft_consensus.cc:513] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.994266 4164 leader_election.cc:290] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.994508 3350 leader_election.cc:343] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 4f45edb2d9cb4cb5bba2110991d1f164
W20250115 10:11:53.994588 3350 leader_election.cc:343] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4f45edb2d9cb4cb5bba2110991d1f164
I20250115 10:11:53.994619 3350 leader_election.cc:304] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.994692 4164 raft_consensus.cc:2743] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.996956 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8188fd66d87540ba91dfa4cae707dc68" } modify_external_catalogs: true
I20250115 10:11:53.997027 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8188fd66d87540ba91dfa4cae707dc68" } modify_external_catalogs: true
I20250115 10:11:53.997288 4164 raft_consensus.cc:491] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:53.997352 4164 raft_consensus.cc:513] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:53.997457 4164 leader_election.cc:290] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:53.997665 3350 leader_election.cc:343] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: fb653c1d93014055bf2ef51e14d6e227
W20250115 10:11:53.997740 3350 leader_election.cc:343] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: fb653c1d93014055bf2ef51e14d6e227
I20250115 10:11:53.997771 3350 leader_election.cc:304] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:53.997833 4164 raft_consensus.cc:2743] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:53.998239 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 5e9cb3f9bdad490db76d27f7b78218cc
I20250115 10:11:53.998478 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e9cb3f9bdad490db76d27f7b78218cc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:53 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:53.998570 3907 tablet_replica.cc:331] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:53.998649 3907 raft_consensus.cc:2238] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:53.998703 3907 raft_consensus.cc:2267] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:53.998809 3907 ts_tablet_manager.cc:1905] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.000227 3907 ts_tablet_manager.cc:1918] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.000283 3907 log.cc:1198] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5e9cb3f9bdad490db76d27f7b78218cc
I20250115 10:11:54.000443 3907 ts_tablet_manager.cc:1939] T 5e9cb3f9bdad490db76d27f7b78218cc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.000761 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5e9cb3f9bdad490db76d27f7b78218cc (table default.Table_8188fd66d87540ba91dfa4cae707dc68 [id=cfbe9a43f4cb404c90f893f1fc3c40c7]) successfully deleted
I20250115 10:11:54.001399 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7697fdce596b4cae9d978e17f38985ca" } new_table_name: "default.Table_4be05c9961a84c11a43d04ac34471aaa" modify_external_catalogs: true
I20250115 10:11:54.002190 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5a3805d83b0d45a1a6901220d0fb830c" } new_table_name: "default.Table_5dd8117d6ff545539da3827d0230d301" modify_external_catalogs: true
W20250115 10:11:54.002394 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 810a9e36713041b091f3db1f25e11eb3 consensus state has no leader
W20250115 10:11:54.003106 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ed1f31252c648d8bd444d6558483cac consensus state has no leader
I20250115 10:11:54.004400 4164 raft_consensus.cc:491] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.004452 4164 raft_consensus.cc:513] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:54.004583 4164 leader_election.cc:290] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.004863 3350 leader_election.cc:343] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 199eeec5997f4223b2208eb2634b0cce
W20250115 10:11:54.004928 3350 leader_election.cc:343] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 199eeec5997f4223b2208eb2634b0cce
I20250115 10:11:54.004902 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c87172155ace48d08e75ed7a09b22b49" } modify_external_catalogs: true
I20250115 10:11:54.004956 3350 leader_election.cc:304] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.004961 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c87172155ace48d08e75ed7a09b22b49" } modify_external_catalogs: true
I20250115 10:11:54.005023 4164 raft_consensus.cc:2743] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.005570 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1c51ee8c859f48329d8df6e4ae91b428" } modify_external_catalogs: true
I20250115 10:11:54.005630 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1c51ee8c859f48329d8df6e4ae91b428" } modify_external_catalogs: true
I20250115 10:11:54.006038 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2e0dc7d9d82d46d482d516453d419fd8
I20250115 10:11:54.006256 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e0dc7d9d82d46d482d516453d419fd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.006351 3907 tablet_replica.cc:331] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.006409 3907 raft_consensus.cc:2238] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.006443 3907 raft_consensus.cc:2267] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.006656 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet fb6f3f6cdd1b40fe802d16d9c07db283
I20250115 10:11:54.006693 3907 ts_tablet_manager.cc:1905] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.007725 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet fb6f3f6cdd1b40fe802d16d9c07db283 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.007920 3907 ts_tablet_manager.cc:1918] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.007963 3907 log.cc:1198] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2e0dc7d9d82d46d482d516453d419fd8
I20250115 10:11:54.008117 3907 ts_tablet_manager.cc:1939] T 2e0dc7d9d82d46d482d516453d419fd8 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.008301 3907 tablet_replica.cc:331] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.008358 3907 raft_consensus.cc:2238] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.008373 4164 raft_consensus.cc:491] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.008373 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2e0dc7d9d82d46d482d516453d419fd8 (table default.Table_c87172155ace48d08e75ed7a09b22b49 [id=f4ea801fc9d34c1fba554d5ac8b081ee]) successfully deleted
I20250115 10:11:54.008395 3907 raft_consensus.cc:2267] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.008442 4164 raft_consensus.cc:513] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.008546 4164 leader_election.cc:290] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:54.008548 3907 ts_tablet_manager.cc:1905] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:11:54.008809 3350 leader_election.cc:343] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: e3d09b8bb1cc4a1083848d28e7e09fea
W20250115 10:11:54.008882 3350 leader_election.cc:343] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: e3d09b8bb1cc4a1083848d28e7e09fea
I20250115 10:11:54.008910 3350 leader_election.cc:304] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.008976 4164 raft_consensus.cc:2743] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.009641 3907 ts_tablet_manager.cc:1918] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.009693 3907 log.cc:1198] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/fb6f3f6cdd1b40fe802d16d9c07db283
I20250115 10:11:54.009845 3907 ts_tablet_manager.cc:1939] T fb6f3f6cdd1b40fe802d16d9c07db283 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.009806 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_312bea7f87e54c19b580055bf9a92136" } new_table_name: "default.Table_689903396b5f4091a2df2cb00a826e64" modify_external_catalogs: true
I20250115 10:11:54.010151 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet fb6f3f6cdd1b40fe802d16d9c07db283 (table default.Table_1c51ee8c859f48329d8df6e4ae91b428 [id=aa4802b1f2d64fe3973358a17c5ed127]) successfully deleted
W20250115 10:11:54.010629 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd1c5a31c2ef4d629e0439fbe79d06a4 consensus state has no leader
I20250115 10:11:54.011243 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1571f3da02b9481a8163c00c581f3f80" } new_table_name: "default.Table_a4f892bed9004ba09ced98ce716023d4" modify_external_catalogs: true
W20250115 10:11:54.012238 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d4c2f9d44764e8d88fffd93fe947f78 consensus state has no leader
I20250115 10:11:54.013401 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 7900577b476b46cda59f4010f8e5ddaf from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.013453 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2aac3f8e33724b08aef2d33299a13414" } modify_external_catalogs: true
I20250115 10:11:54.013494 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2aac3f8e33724b08aef2d33299a13414" } modify_external_catalogs: true
I20250115 10:11:54.013465 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a4f892bed9004ba09ced98ce716023d4" } modify_external_catalogs: true
I20250115 10:11:54.013527 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a4f892bed9004ba09ced98ce716023d4" } modify_external_catalogs: true
I20250115 10:11:54.014364 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 2de54990820943df99bfc6c61cce292c from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.014976 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2985a8cb58684bf0b3340ce326ebc1fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.015082 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2985a8cb58684bf0b3340ce326ebc1fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.015215 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2d4c2f9d44764e8d88fffd93fe947f78
I20250115 10:11:54.015305 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d667834206fe4410a22b4944b3494462
I20250115 10:11:54.015419 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 7900577b476b46cda59f4010f8e5ddaf
I20250115 10:11:54.015494 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 7900577b476b46cda59f4010f8e5ddaf deleted and replaced by tablet 321386e0657c425491b8ffa449e7acb9
I20250115 10:11:54.015549 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet d667834206fe4410a22b4944b3494462 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.015801 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d4c2f9d44764e8d88fffd93fe947f78 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.015869 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 6f4e43f651df4f168a9cb701e6eba63a from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.015805 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 7900577b476b46cda59f4010f8e5ddaf with delete_type TABLET_DATA_DELETED (replaced by tablet 321386e0657c425491b8ffa449e7acb9) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.015895 3907 tablet_replica.cc:331] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.015935 3907 raft_consensus.cc:2238] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:54.015998 3907 raft_consensus.cc:2267] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.016180 3907 ts_tablet_manager.cc:1905] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.016188 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2de54990820943df99bfc6c61cce292c
I20250115 10:11:54.016253 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 2de54990820943df99bfc6c61cce292c deleted and replaced by tablet b24b053f813446fb87d334dae591d393
I20250115 10:11:54.016476 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 2de54990820943df99bfc6c61cce292c with delete_type TABLET_DATA_DELETED (replaced by tablet b24b053f813446fb87d334dae591d393) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.017244 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6f4e43f651df4f168a9cb701e6eba63a
I20250115 10:11:54.017316 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 6f4e43f651df4f168a9cb701e6eba63a deleted and replaced by tablet f493fbea94cc4f069f1b3072fec51606
I20250115 10:11:54.017421 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f4e43f651df4f168a9cb701e6eba63a with delete_type TABLET_DATA_DELETED (replaced by tablet f493fbea94cc4f069f1b3072fec51606) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.017935 3907 ts_tablet_manager.cc:1918] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:54.018074 3907 log.cc:1198] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d667834206fe4410a22b4944b3494462
I20250115 10:11:54.018290 3907 ts_tablet_manager.cc:1939] T d667834206fe4410a22b4944b3494462 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.018482 3907 tablet_replica.cc:331] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.018548 3907 raft_consensus.cc:2238] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.018548 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d667834206fe4410a22b4944b3494462 (table default.Table_2aac3f8e33724b08aef2d33299a13414 [id=ab569ac74bbb44f1913506709002a4c4]) successfully deleted
I20250115 10:11:54.018586 3907 raft_consensus.cc:2267] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.018761 3907 ts_tablet_manager.cc:1905] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.019980 3907 ts_tablet_manager.cc:1918] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.020066 3907 log.cc:1198] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2d4c2f9d44764e8d88fffd93fe947f78
I20250115 10:11:54.020242 3907 ts_tablet_manager.cc:1939] T 2d4c2f9d44764e8d88fffd93fe947f78 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.020500 3907 tablet_replica.cc:331] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.020589 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2d4c2f9d44764e8d88fffd93fe947f78 (table default.Table_a4f892bed9004ba09ced98ce716023d4 [id=99fd0a07ef8942858c09fbf1907d0f73]) successfully deleted
I20250115 10:11:54.020615 3907 raft_consensus.cc:2238] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.020649 3907 raft_consensus.cc:2267] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.020805 3907 ts_tablet_manager.cc:1905] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.021836 3907 ts_tablet_manager.cc:1918] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.021920 3907 log.cc:1198] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/7900577b476b46cda59f4010f8e5ddaf
I20250115 10:11:54.022099 3907 ts_tablet_manager.cc:1939] T 7900577b476b46cda59f4010f8e5ddaf P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.022281 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 53126db6f3d74300a68c2d507bdc7be9 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.022259 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_87cb0da97ca94671b8574ff819247489"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:54.022379 3907 tablet_replica.cc:331] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
W20250115 10:11:54.022388 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87cb0da97ca94671b8574ff819247489 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.022419 3907 raft_consensus.cc:2238] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.022449 3907 raft_consensus.cc:2267] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.022328 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 7900577b476b46cda59f4010f8e5ddaf (table default.Table_d9ba8ec3c47340f4a6a1d9425258380e [id=75afc9a4cb0945638d6608c44ce822fb]) successfully deleted
I20250115 10:11:54.022289 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f7714def3d8e444b918369bab0fa7fd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.022537 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7714def3d8e444b918369bab0fa7fd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.022634 3907 ts_tablet_manager.cc:1905] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.023491 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 53126db6f3d74300a68c2d507bdc7be9
I20250115 10:11:54.023553 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 53126db6f3d74300a68c2d507bdc7be9 deleted and replaced by tablet 42b786c03fcb49eaafde89b98465230e
I20250115 10:11:54.023787 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 53126db6f3d74300a68c2d507bdc7be9 with delete_type TABLET_DATA_DELETED (replaced by tablet 42b786c03fcb49eaafde89b98465230e) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.023957 3907 ts_tablet_manager.cc:1918] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.023938 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1c0467e6e03448a49b56a73c0a4b8459"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:54.024027 3907 log.cc:1198] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2de54990820943df99bfc6c61cce292c
W20250115 10:11:54.024049 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c0467e6e03448a49b56a73c0a4b8459 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.024369 3907 ts_tablet_manager.cc:1939] T 2de54990820943df99bfc6c61cce292c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.024607 3907 tablet_replica.cc:331] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.024605 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2de54990820943df99bfc6c61cce292c (table default.Table_6e74cc6d45294bcb8341decf3208c794 [id=a0f32cfd7db54958806da33c5f429db8]) successfully deleted
I20250115 10:11:54.024703 3907 raft_consensus.cc:2238] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.024744 3907 raft_consensus.cc:2267] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.024869 3907 ts_tablet_manager.cc:1905] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.026145 3907 ts_tablet_manager.cc:1918] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.026227 3907 log.cc:1198] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6f4e43f651df4f168a9cb701e6eba63a
I20250115 10:11:54.026397 3907 ts_tablet_manager.cc:1939] T 6f4e43f651df4f168a9cb701e6eba63a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.026615 3907 tablet_replica.cc:331] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.026671 3907 raft_consensus.cc:2238] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.026702 3907 raft_consensus.cc:2267] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.026711 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6f4e43f651df4f168a9cb701e6eba63a (table default.Table_ce872501e66349fc84f96026916c4f38 [id=ecfb15b88bae4a6b9bb7aed2410b6af8]) successfully deleted
I20250115 10:11:54.026909 3907 ts_tablet_manager.cc:1905] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.027968 3907 ts_tablet_manager.cc:1918] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.028018 3907 log.cc:1198] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/53126db6f3d74300a68c2d507bdc7be9
I20250115 10:11:54.028199 3907 ts_tablet_manager.cc:1939] T 53126db6f3d74300a68c2d507bdc7be9 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.028614 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 53126db6f3d74300a68c2d507bdc7be9 (table default.Table_cc3e18bf8fbf480c9b35e7d05c3dd3e7 [id=16679f57872941e0b18e771e0fa4fa8d]) successfully deleted
I20250115 10:11:54.029716 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_825eb71d554c438a838c20ea963ee429"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.029809 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_825eb71d554c438a838c20ea963ee429 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.030143 4164 raft_consensus.cc:491] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.030213 4164 raft_consensus.cc:513] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.030216 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_29ac932b19c64e5081b169ca90650e15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.030295 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29ac932b19c64e5081b169ca90650e15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.030328 4164 leader_election.cc:290] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.030735 3350 leader_election.cc:343] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 810a9e36713041b091f3db1f25e11eb3
W20250115 10:11:54.030831 3350 leader_election.cc:343] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 810a9e36713041b091f3db1f25e11eb3
I20250115 10:11:54.030865 3350 leader_election.cc:304] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.030923 4164 raft_consensus.cc:2743] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.031606 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 9ed1f31252c648d8bd444d6558483cac from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.032569 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 9ed1f31252c648d8bd444d6558483cac
I20250115 10:11:54.032646 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 9ed1f31252c648d8bd444d6558483cac deleted and replaced by tablet 451d1d6210e34d57bee6a92b40378c38
I20250115 10:11:54.032822 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed1f31252c648d8bd444d6558483cac with delete_type TABLET_DATA_DELETED (replaced by tablet 451d1d6210e34d57bee6a92b40378c38) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.032895 3907 tablet_replica.cc:331] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.032945 3907 raft_consensus.cc:2238] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.033011 3907 raft_consensus.cc:2267] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.033124 3907 ts_tablet_manager.cc:1905] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.034389 3907 ts_tablet_manager.cc:1918] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.034487 3907 log.cc:1198] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/9ed1f31252c648d8bd444d6558483cac
I20250115 10:11:54.034685 3907 ts_tablet_manager.cc:1939] T 9ed1f31252c648d8bd444d6558483cac P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.035280 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 9ed1f31252c648d8bd444d6558483cac (table default.Table_5dd8117d6ff545539da3827d0230d301 [id=3b158ca8be84467289e8efbfdd4e20f9]) successfully deleted
I20250115 10:11:54.040118 4164 raft_consensus.cc:491] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.040167 4164 raft_consensus.cc:513] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.040268 4164 leader_election.cc:290] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.040560 3350 leader_election.cc:343] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: cfcaece8146a4b22af4b47d06feacf9a
W20250115 10:11:54.040638 3350 leader_election.cc:343] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: cfcaece8146a4b22af4b47d06feacf9a
I20250115 10:11:54.040668 3350 leader_election.cc:304] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.040727 4164 raft_consensus.cc:2743] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.053859 4164 raft_consensus.cc:491] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.053930 4164 raft_consensus.cc:513] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.054045 4164 leader_election.cc:290] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.054322 3350 leader_election.cc:343] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: aa02b378d64e47dba427c1b3fb343786
W20250115 10:11:54.054445 3350 leader_election.cc:343] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: aa02b378d64e47dba427c1b3fb343786
I20250115 10:11:54.054481 3350 leader_election.cc:304] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.054555 4164 raft_consensus.cc:2743] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.096339 4164 raft_consensus.cc:491] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.096453 4164 raft_consensus.cc:513] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.096611 4164 leader_election.cc:290] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.096997 3350 leader_election.cc:343] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d87cc0f336ac40678dbc136072425740
W20250115 10:11:54.097075 3350 leader_election.cc:343] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d87cc0f336ac40678dbc136072425740
I20250115 10:11:54.097103 3350 leader_election.cc:304] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.097174 4164 raft_consensus.cc:2743] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:54.149792 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 1013ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:54.153259 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:54.167810 4164 raft_consensus.cc:491] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.167891 4164 raft_consensus.cc:513] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.168006 4164 leader_election.cc:290] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.168344 3350 leader_election.cc:343] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8133c8cadd73432d8c9cd8affb930359
W20250115 10:11:54.168443 3350 leader_election.cc:343] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 8133c8cadd73432d8c9cd8affb930359
I20250115 10:11:54.168478 3350 leader_election.cc:304] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.168551 4164 raft_consensus.cc:2743] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.170670 4164 raft_consensus.cc:491] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.170719 4164 raft_consensus.cc:513] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:54.170825 4164 leader_election.cc:290] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.171142 3350 leader_election.cc:343] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 76db7eec08534e86b14b11b13205e43a
W20250115 10:11:54.171217 3350 leader_election.cc:343] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 76db7eec08534e86b14b11b13205e43a
I20250115 10:11:54.171250 3350 leader_election.cc:304] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.171335 4164 raft_consensus.cc:2743] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.176296 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1ef9f1255ae84466a380092317d68f22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.176455 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ef9f1255ae84466a380092317d68f22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.176892 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1dda39295310490986ccffe5a2a9bed9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.177011 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dda39295310490986ccffe5a2a9bed9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.177376 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c2a9db01931f49639eceb93ae586db30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.177500 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2a9db01931f49639eceb93ae586db30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.183074 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d13ad1c30ac54e8ea0625a6065af980c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.183193 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d13ad1c30ac54e8ea0625a6065af980c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.186772 4164 raft_consensus.cc:491] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.186859 4164 raft_consensus.cc:513] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.187021 4164 leader_election.cc:290] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.187319 3350 leader_election.cc:343] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6137a5bb4b2c4df29253ecd340653159
W20250115 10:11:54.187394 3350 leader_election.cc:343] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 6137a5bb4b2c4df29253ecd340653159
I20250115 10:11:54.187422 3350 leader_election.cc:304] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.187477 4164 raft_consensus.cc:2743] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:54.188181 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 1013ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:54.192668 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae7149f318244b6d8a530cc1324d4c57" } new_table_name: "default.Table_e9af26dd72da4494af187d8d6378ae0a" modify_external_catalogs: true
I20250115 10:11:54.194715 3923 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:54.194800 3921 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:54.195029 3919 tablet.cc:1721] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:11:54.197764 3099 catalog_manager.cc:6071] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: default.Table_e9af26dd72da4494af187d8d6378ae0a [id=64196da99b1440f191bef7bd69aaaff0] alter complete (version 2)
I20250115 10:11:54.198756 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e9af26dd72da4494af187d8d6378ae0a" } modify_external_catalogs: true
I20250115 10:11:54.198812 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e9af26dd72da4494af187d8d6378ae0a" } modify_external_catalogs: true
I20250115 10:11:54.199724 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:54.199977 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 2377c27855a64ac7bec95a6d6c5289af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.200081 3907 tablet_replica.cc:331] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.200158 3907 raft_consensus.cc:2238] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:54.200228 3907 raft_consensus.cc:2267] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.200415 3907 ts_tablet_manager.cc:1905] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.201789 3907 ts_tablet_manager.cc:1918] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:11:54.201843 3907 log.cc:1198] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:54.202045 3907 ts_tablet_manager.cc:1939] T 2377c27855a64ac7bec95a6d6c5289af P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.202354 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_e9af26dd72da4494af187d8d6378ae0a [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
I20250115 10:11:54.202908 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7f7098540b954667b0d1cb7d61e10b23" } new_table_name: "default.Table_cdc6d55df5d34817a6f25151777a63fd" modify_external_catalogs: true
I20250115 10:11:54.203562 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1ef9f1255ae84466a380092317d68f22" } new_table_name: "default.Table_bfb0432771ca426080dd8d585d9b0413" modify_external_catalogs: true
W20250115 10:11:54.203940 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b6158fa974ec408bb323f1216b0ff223 consensus state has no leader
W20250115 10:11:54.204843 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
I20250115 10:11:54.206504 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc8f47a21c744ecc997b03e11e66c014" } modify_external_catalogs: true
I20250115 10:11:54.206560 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc8f47a21c744ecc997b03e11e66c014" } modify_external_catalogs: true
I20250115 10:11:54.207438 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet e3d09b8bb1cc4a1083848d28e7e09fea
I20250115 10:11:54.207664 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet e3d09b8bb1cc4a1083848d28e7e09fea with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.207818 3907 tablet_replica.cc:331] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.207891 3907 raft_consensus.cc:2238] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.207937 3907 raft_consensus.cc:2267] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.207922 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2cc5b811bbf747c4826887cbeda26663" } modify_external_catalogs: true
I20250115 10:11:54.207996 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2cc5b811bbf747c4826887cbeda26663" } modify_external_catalogs: true
I20250115 10:11:54.208109 3907 ts_tablet_manager.cc:1905] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.208827 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet ad9e93adb127417abfa699aa1af03b49
I20250115 10:11:54.209034 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet ad9e93adb127417abfa699aa1af03b49 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.209462 3907 ts_tablet_manager.cc:1918] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.209517 3907 log.cc:1198] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/e3d09b8bb1cc4a1083848d28e7e09fea
I20250115 10:11:54.209683 3907 ts_tablet_manager.cc:1939] T e3d09b8bb1cc4a1083848d28e7e09fea P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.209980 3907 tablet_replica.cc:331] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.210039 3907 raft_consensus.cc:2238] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.210132 3907 raft_consensus.cc:2267] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.210112 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet e3d09b8bb1cc4a1083848d28e7e09fea (table default.Table_dc8f47a21c744ecc997b03e11e66c014 [id=a6f1ba8d7d0f478ab5280106e7e5a215]) successfully deleted
I20250115 10:11:54.210310 3907 ts_tablet_manager.cc:1905] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.211301 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f14d6f9b79af4d54a2392bd9c010335a" } new_table_name: "default.Table_4754e67eb67e4cf58580ddcd31bb68f6" modify_external_catalogs: true
I20250115 10:11:54.211418 3907 ts_tablet_manager.cc:1918] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.211472 3907 log.cc:1198] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/ad9e93adb127417abfa699aa1af03b49
I20250115 10:11:54.211745 3907 ts_tablet_manager.cc:1939] T ad9e93adb127417abfa699aa1af03b49 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.212101 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet ad9e93adb127417abfa699aa1af03b49 (table default.Table_2cc5b811bbf747c4826887cbeda26663 [id=3cd3caf22252453581aa9f7dfce9d06b]) successfully deleted
W20250115 10:11:54.212142 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f45edb2d9cb4cb5bba2110991d1f164 consensus state has no leader
I20250115 10:11:54.212725 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd5e675da7244cc5abfbb44a3e302520" } new_table_name: "default.Table_872267a210a543ebaa8dc83c22acf71a" modify_external_catalogs: true
W20250115 10:11:54.213491 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4544187adde94a72a2ceafc0bfea9a3e consensus state has no leader
I20250115 10:11:54.216012 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d9ba8ec3c47340f4a6a1d9425258380e" } modify_external_catalogs: true
I20250115 10:11:54.216081 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d9ba8ec3c47340f4a6a1d9425258380e" } modify_external_catalogs: true
I20250115 10:11:54.216110 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6780cb70cb8843a683c91aa3763f5739" } modify_external_catalogs: true
I20250115 10:11:54.216182 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6780cb70cb8843a683c91aa3763f5739" } modify_external_catalogs: true
I20250115 10:11:54.216969 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 7b008f956a8e46b583b951b2e605c630 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.217166 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 199eeec5997f4223b2208eb2634b0cce
I20250115 10:11:54.217340 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6b9c72c44d6d4a94bb3b2698687637c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.217443 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b9c72c44d6d4a94bb3b2698687637c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.217571 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 199eeec5997f4223b2208eb2634b0cce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.217711 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 321386e0657c425491b8ffa449e7acb9
I20250115 10:11:54.217765 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet b6158fa974ec408bb323f1216b0ff223 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.218237 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 7b008f956a8e46b583b951b2e605c630
I20250115 10:11:54.218318 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 7b008f956a8e46b583b951b2e605c630 deleted and replaced by tablet 8600883e5a5449c59a747a6ef2121c61
I20250115 10:11:54.217909 3907 tablet_replica.cc:331] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.218482 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b008f956a8e46b583b951b2e605c630 with delete_type TABLET_DATA_DELETED (replaced by tablet 8600883e5a5449c59a747a6ef2121c61) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.218668 3907 raft_consensus.cc:2238] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.218735 3907 raft_consensus.cc:2267] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.219070 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet b6158fa974ec408bb323f1216b0ff223
I20250115 10:11:54.219136 3092 catalog_manager.cc:6596] ReplaceTablet: tablet b6158fa974ec408bb323f1216b0ff223 deleted and replaced by tablet 1c0ebbde47434c23a8bf0beca4d51c41
I20250115 10:11:54.219245 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet b6158fa974ec408bb323f1216b0ff223 with delete_type TABLET_DATA_DELETED (replaced by tablet 1c0ebbde47434c23a8bf0beca4d51c41) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.219360 3907 ts_tablet_manager.cc:1905] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.219470 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet a65b655fb9a84e8d9214cb2b6872cceb from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.220613 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet a65b655fb9a84e8d9214cb2b6872cceb
I20250115 10:11:54.220690 3092 catalog_manager.cc:6596] ReplaceTablet: tablet a65b655fb9a84e8d9214cb2b6872cceb deleted and replaced by tablet 1b664d4eebc0447ea8621f50ffda16d8
I20250115 10:11:54.220836 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet a65b655fb9a84e8d9214cb2b6872cceb with delete_type TABLET_DATA_DELETED (replaced by tablet 1b664d4eebc0447ea8621f50ffda16d8) from {username='slave'} at 127.0.0.1:33874
W20250115 10:11:54.220942 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:54.221495 3907 ts_tablet_manager.cc:1918] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.221541 3907 log.cc:1198] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/199eeec5997f4223b2208eb2634b0cce
I20250115 10:11:54.221702 3907 ts_tablet_manager.cc:1939] T 199eeec5997f4223b2208eb2634b0cce P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.222060 3907 tablet_replica.cc:331] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.222118 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 199eeec5997f4223b2208eb2634b0cce (table default.Table_6780cb70cb8843a683c91aa3763f5739 [id=336af606a29d472799f85c1a69021bc6]) successfully deleted
I20250115 10:11:54.222157 3907 raft_consensus.cc:2238] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.222199 3907 raft_consensus.cc:2267] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.222347 3907 ts_tablet_manager.cc:1905] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.223292 3907 ts_tablet_manager.cc:1918] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.223407 3907 log.cc:1198] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/7b008f956a8e46b583b951b2e605c630
I20250115 10:11:54.223601 3907 ts_tablet_manager.cc:1939] T 7b008f956a8e46b583b951b2e605c630 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.223852 3907 tablet_replica.cc:331] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.223974 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 7b008f956a8e46b583b951b2e605c630 (table default.Table_c93e104be3004c1ebcfb3a75b1de30a8 [id=a4e2127fb8624f16afed55f89d949842]) successfully deleted
I20250115 10:11:54.223927 3907 raft_consensus.cc:2238] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.224083 3907 raft_consensus.cc:2267] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.224190 3907 ts_tablet_manager.cc:1905] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.224213 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9eb7d6f0b40e4e0da0d4a70ae1ef7e51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.224326 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eb7d6f0b40e4e0da0d4a70ae1ef7e51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.224942 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dc2bfee41b1b4f279f6de7495e23b0e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.225037 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc2bfee41b1b4f279f6de7495e23b0e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.225364 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet aa02b378d64e47dba427c1b3fb343786 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.225401 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7f1621bf44ce4fff8d3c4fc737ebaa50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.225497 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f1621bf44ce4fff8d3c4fc737ebaa50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.225651 3907 ts_tablet_manager.cc:1918] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.225726 3907 log.cc:1198] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/b6158fa974ec408bb323f1216b0ff223
I20250115 10:11:54.225921 3907 ts_tablet_manager.cc:1939] T b6158fa974ec408bb323f1216b0ff223 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.226197 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet b6158fa974ec408bb323f1216b0ff223 (table default.Table_cdc6d55df5d34817a6f25151777a63fd [id=7e0bb36cce704fca84c3fc852b07a3a7]) successfully deleted
I20250115 10:11:54.226320 3907 tablet_replica.cc:331] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.226414 3907 raft_consensus.cc:2238] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.226480 3907 raft_consensus.cc:2267] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.226627 3907 ts_tablet_manager.cc:1905] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.226945 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet aa02b378d64e47dba427c1b3fb343786
I20250115 10:11:54.227034 3098 catalog_manager.cc:6596] ReplaceTablet: tablet aa02b378d64e47dba427c1b3fb343786 deleted and replaced by tablet 6074dac081d14ab0a9548956a6ae63b0
I20250115 10:11:54.227262 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet aa02b378d64e47dba427c1b3fb343786 with delete_type TABLET_DATA_DELETED (replaced by tablet 6074dac081d14ab0a9548956a6ae63b0) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.228216 3907 ts_tablet_manager.cc:1918] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.228286 3907 log.cc:1198] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/a65b655fb9a84e8d9214cb2b6872cceb
I20250115 10:11:54.228446 3907 ts_tablet_manager.cc:1939] T a65b655fb9a84e8d9214cb2b6872cceb P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.228729 3907 tablet_replica.cc:331] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.228781 3907 raft_consensus.cc:2238] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.228806 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet a65b655fb9a84e8d9214cb2b6872cceb (table default.Table_5c8aa519960344fba99ce14770b775e8 [id=d296d7e3f74b475eaa30ec9ab411976e]) successfully deleted
I20250115 10:11:54.228853 3907 raft_consensus.cc:2267] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.229007 3907 ts_tablet_manager.cc:1905] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.229983 3907 ts_tablet_manager.cc:1918] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.230034 3907 log.cc:1198] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/aa02b378d64e47dba427c1b3fb343786
I20250115 10:11:54.230181 3907 ts_tablet_manager.cc:1939] T aa02b378d64e47dba427c1b3fb343786 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.230448 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet aa02b378d64e47dba427c1b3fb343786 (table default.Table_05b83e6e2d324d81aa573dbed2412e1d [id=ae8268a5c16147e398da7a47f25ce930]) successfully deleted
I20250115 10:11:54.231413 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_274f2c90e963429b86dccdee57f9d24c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.231513 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_274f2c90e963429b86dccdee57f9d24c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.232196 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_82f134f9f06a4efc9f7e5a179fc6bda2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.232292 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82f134f9f06a4efc9f7e5a179fc6bda2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.233772 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 461bf67c7b1c43ecb5e503f40fdb882a from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.234649 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 461bf67c7b1c43ecb5e503f40fdb882a
I20250115 10:11:54.234725 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 461bf67c7b1c43ecb5e503f40fdb882a deleted and replaced by tablet e2dadcc3ab104ba9858086b00b4d32d9
I20250115 10:11:54.234917 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 461bf67c7b1c43ecb5e503f40fdb882a with delete_type TABLET_DATA_DELETED (replaced by tablet e2dadcc3ab104ba9858086b00b4d32d9) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.235000 3907 tablet_replica.cc:331] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.235069 3907 raft_consensus.cc:2238] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.235111 3907 raft_consensus.cc:2267] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.235266 3907 ts_tablet_manager.cc:1905] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.236318 3907 ts_tablet_manager.cc:1918] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.236394 3907 log.cc:1198] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/461bf67c7b1c43ecb5e503f40fdb882a
I20250115 10:11:54.236586 3907 ts_tablet_manager.cc:1939] T 461bf67c7b1c43ecb5e503f40fdb882a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.236842 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 461bf67c7b1c43ecb5e503f40fdb882a (table default.Table_b5f15867176642cca77684583cdacba2 [id=8c1e3e6aaf844789b91efddc0ef93873]) successfully deleted
W20250115 10:11:54.255102 3797 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.217.188:38283 timed out after 0.664s (SENT)
I20250115 10:11:54.297165 3095 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]). Expected version 1 got 0
I20250115 10:11:54.328716 4164 raft_consensus.cc:491] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.328827 4164 raft_consensus.cc:513] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.328992 4164 leader_election.cc:290] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.329285 3350 leader_election.cc:343] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 4e6a33be02774b7e888193b60ba21923
W20250115 10:11:54.329371 3350 leader_election.cc:343] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4e6a33be02774b7e888193b60ba21923
I20250115 10:11:54.329394 3350 leader_election.cc:304] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.329527 4164 raft_consensus.cc:2743] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.332887 4164 raft_consensus.cc:491] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.332952 4164 raft_consensus.cc:513] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.333065 4164 leader_election.cc:290] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.333348 3350 leader_election.cc:343] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: f5ee2fd58ed741218b4ee6461b6f6c51
W20250115 10:11:54.333448 3350 leader_election.cc:343] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f5ee2fd58ed741218b4ee6461b6f6c51
I20250115 10:11:54.333482 3350 leader_election.cc:304] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.333549 4164 raft_consensus.cc:2743] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:11:54.345968 4164 raft_consensus.cc:491] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:54.346052 4164 raft_consensus.cc:513] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:54.346215 4164 leader_election.cc:290] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:54.346477 3350 leader_election.cc:343] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 4544187adde94a72a2ceafc0bfea9a3e
W20250115 10:11:54.346549 3350 leader_election.cc:343] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4544187adde94a72a2ceafc0bfea9a3e
I20250115 10:11:54.346581 3350 leader_election.cc:304] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:54.346652 4164 raft_consensus.cc:2743] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:11:54.373760 3095 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:54.378453 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6a1944963f7f4ae0b1135a63ad36a277"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.378631 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a1944963f7f4ae0b1135a63ad36a277 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.378897 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6058bb52b5124f9ca1463f40676b58e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.379019 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6058bb52b5124f9ca1463f40676b58e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.379395 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2b8ff1c6f52f4e969e94bafef1635fd6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.379482 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b8ff1c6f52f4e969e94bafef1635fd6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.384687 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fb6a0586768546cc8a5b73295550b086"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.384804 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb6a0586768546cc8a5b73295550b086 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.394085 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9eb7d6f0b40e4e0da0d4a70ae1ef7e51" } new_table_name: "default.Table_cb95b3d9f4e44e7c82ed1cba4341edde" modify_external_catalogs: true
W20250115 10:11:54.395287 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
I20250115 10:11:54.400259 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_29ac932b19c64e5081b169ca90650e15" } modify_external_catalogs: true
I20250115 10:11:54.400331 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_29ac932b19c64e5081b169ca90650e15" } modify_external_catalogs: true
I20250115 10:11:54.401253 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet bdb91cc73c3247008cf9709dc7d94803
I20250115 10:11:54.404457 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_886e69d3af1042e0aab10f38f17e742f" } new_table_name: "default.Table_4abd14d53e874acdacbc40ce26faaa85" modify_external_catalogs: true
I20250115 10:11:54.405299 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6e74cc6d45294bcb8341decf3208c794" } new_table_name: "default.Table_0e6602e434e44d1d98a212d7f5469c2f" modify_external_catalogs: true
W20250115 10:11:54.405892 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c7e5d185b9e43b5b2265cc88de97999 consensus state has no leader
W20250115 10:11:54.406462 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b24b053f813446fb87d334dae591d393 has no consensus state
I20250115 10:11:54.408018 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb6a0586768546cc8a5b73295550b086" } modify_external_catalogs: true
I20250115 10:11:54.408105 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb6a0586768546cc8a5b73295550b086" } modify_external_catalogs: true
I20250115 10:11:54.409081 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet aeff099462a84a4b858f49244c5aad7b
I20250115 10:11:54.409363 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_82f134f9f06a4efc9f7e5a179fc6bda2" } modify_external_catalogs: true
I20250115 10:11:54.409425 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_82f134f9f06a4efc9f7e5a179fc6bda2" } modify_external_catalogs: true
I20250115 10:11:54.410574 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 75bf4c62c0e944cd93cdea0ea6b7521f
I20250115 10:11:54.412561 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cef254ab258d429a941224cdf63c00a4" } new_table_name: "default.Table_6f7c58e7d0434d6d8d354e484fcc305a" modify_external_catalogs: true
W20250115 10:11:54.413358 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b37d2f57618e4f808e8799fd246b97d1 consensus state has no leader
I20250115 10:11:54.413899 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7cf871899adb467e9f4c1d88202574e6" } new_table_name: "default.Table_5409b8f4469d4f13ac7ae25112aa791d" modify_external_catalogs: true
W20250115 10:11:54.414857 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8f4977e6b174332ad6f5540c0211fd6 consensus state has no leader
I20250115 10:11:54.417730 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5550426b49241a48cac19af16d12519" } modify_external_catalogs: true
I20250115 10:11:54.417799 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5550426b49241a48cac19af16d12519" } modify_external_catalogs: true
I20250115 10:11:54.418617 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_70caeb4fbfda4cfa8cc306d6aac1f734" } modify_external_catalogs: true
I20250115 10:11:54.418679 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_70caeb4fbfda4cfa8cc306d6aac1f734" } modify_external_catalogs: true
I20250115 10:11:54.418690 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f889cc1201404c8691bf01256750e244
I20250115 10:11:54.419278 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet f889cc1201404c8691bf01256750e244 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.419854 3907 tablet_replica.cc:331] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.419941 3907 raft_consensus.cc:2238] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.419986 3907 raft_consensus.cc:2267] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.420187 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 4f45edb2d9cb4cb5bba2110991d1f164 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.420425 3907 ts_tablet_manager.cc:1905] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.420585 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_67c94882e80c48eebe278167d361f396"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.420686 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67c94882e80c48eebe278167d361f396 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.423317 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 5779ec7816cd499ebe46962e29092a70
I20250115 10:11:54.423635 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 5779ec7816cd499ebe46962e29092a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.423815 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet d8f4977e6b174332ad6f5540c0211fd6 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.424149 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 9f9aed809eb74964a1965a5b73807725 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.424494 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4f45edb2d9cb4cb5bba2110991d1f164
I20250115 10:11:54.424575 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 4f45edb2d9cb4cb5bba2110991d1f164 deleted and replaced by tablet 6433d51732d94906b431b1b77c148e50
I20250115 10:11:54.424906 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f45edb2d9cb4cb5bba2110991d1f164 with delete_type TABLET_DATA_DELETED (replaced by tablet 6433d51732d94906b431b1b77c148e50) from {username='slave'} at 127.0.0.1:33874
W20250115 10:11:54.425036 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 1285ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:54.425258 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d8f4977e6b174332ad6f5540c0211fd6
I20250115 10:11:54.425318 3099 catalog_manager.cc:6596] ReplaceTablet: tablet d8f4977e6b174332ad6f5540c0211fd6 deleted and replaced by tablet 7bcd1257c1814f16984d3e0fa1c082fd
I20250115 10:11:54.425554 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet d8f4977e6b174332ad6f5540c0211fd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 7bcd1257c1814f16984d3e0fa1c082fd) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.425663 3907 ts_tablet_manager.cc:1918] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:54.425741 3907 log.cc:1198] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f889cc1201404c8691bf01256750e244
I20250115 10:11:54.426110 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 9f9aed809eb74964a1965a5b73807725
I20250115 10:11:54.426213 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 9f9aed809eb74964a1965a5b73807725 deleted and replaced by tablet 60b1ba7c80c4404b8fed7df709f0aba2
I20250115 10:11:54.426386 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f9aed809eb74964a1965a5b73807725 with delete_type TABLET_DATA_DELETED (replaced by tablet 60b1ba7c80c4404b8fed7df709f0aba2) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.426393 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae4d1993de084e1e90bf03ea10660815"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.426476 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae4d1993de084e1e90bf03ea10660815 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.426759 3907 ts_tablet_manager.cc:1939] T f889cc1201404c8691bf01256750e244 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.426946 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_be6f200b0d3f4f46a97001d4956b8e8f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.427035 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be6f200b0d3f4f46a97001d4956b8e8f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.427382 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2f9f06ce2e924399afa680e26693de0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.427460 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f9f06ce2e924399afa680e26693de0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.427937 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f889cc1201404c8691bf01256750e244 (table default.Table_e5550426b49241a48cac19af16d12519 [id=1ac3f51295024b83b64f69df31a970d2]) successfully deleted
I20250115 10:11:54.428001 3907 tablet_replica.cc:331] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.428061 3907 raft_consensus.cc:2238] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.428102 3907 raft_consensus.cc:2267] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.428207 3907 ts_tablet_manager.cc:1905] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.428588 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 8133c8cadd73432d8c9cd8affb930359 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.429836 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 8133c8cadd73432d8c9cd8affb930359
I20250115 10:11:54.429905 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 8133c8cadd73432d8c9cd8affb930359 deleted and replaced by tablet 8e863f3ea25c49f393de0c971986da91
I20250115 10:11:54.430063 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 8133c8cadd73432d8c9cd8affb930359 with delete_type TABLET_DATA_DELETED (replaced by tablet 8e863f3ea25c49f393de0c971986da91) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.430137 3907 ts_tablet_manager.cc:1918] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:54.430207 3907 log.cc:1198] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5779ec7816cd499ebe46962e29092a70
I20250115 10:11:54.430444 3907 ts_tablet_manager.cc:1939] T 5779ec7816cd499ebe46962e29092a70 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.430665 3907 tablet_replica.cc:331] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.430720 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5779ec7816cd499ebe46962e29092a70 (table default.Table_70caeb4fbfda4cfa8cc306d6aac1f734 [id=1d766421e2be4d92b84d436c65506229]) successfully deleted
I20250115 10:11:54.430747 3907 raft_consensus.cc:2238] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.430780 3907 raft_consensus.cc:2267] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.430878 3907 ts_tablet_manager.cc:1905] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.432138 3907 ts_tablet_manager.cc:1918] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.432196 3907 log.cc:1198] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4f45edb2d9cb4cb5bba2110991d1f164
I20250115 10:11:54.432361 3907 ts_tablet_manager.cc:1939] T 4f45edb2d9cb4cb5bba2110991d1f164 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.432653 3907 tablet_replica.cc:331] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.432751 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4f45edb2d9cb4cb5bba2110991d1f164 (table default.Table_4754e67eb67e4cf58580ddcd31bb68f6 [id=f82c6aec629f4a298f4382ab7359b1ec]) successfully deleted
I20250115 10:11:54.432758 3907 raft_consensus.cc:2238] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.432801 3907 raft_consensus.cc:2267] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.432771 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d2972c96710249d5b0eca03668930ab5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.432859 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2972c96710249d5b0eca03668930ab5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.432916 3907 ts_tablet_manager.cc:1905] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.433743 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fbed7009a1334a329055734d536afc3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.433835 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fbed7009a1334a329055734d536afc3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.434511 3907 ts_tablet_manager.cc:1918] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.434614 3907 log.cc:1198] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d8f4977e6b174332ad6f5540c0211fd6
I20250115 10:11:54.434849 3907 ts_tablet_manager.cc:1939] T d8f4977e6b174332ad6f5540c0211fd6 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.435393 3907 tablet_replica.cc:331] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.435410 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d8f4977e6b174332ad6f5540c0211fd6 (table default.Table_5409b8f4469d4f13ac7ae25112aa791d [id=a00f41e8e2fd4a5796e6846bb0213874]) successfully deleted
I20250115 10:11:54.435554 3907 raft_consensus.cc:2238] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.435599 3907 raft_consensus.cc:2267] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.435868 3907 ts_tablet_manager.cc:1905] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.435870 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet d87cc0f336ac40678dbc136072425740 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.436707 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d87cc0f336ac40678dbc136072425740
I20250115 10:11:54.436775 3098 catalog_manager.cc:6596] ReplaceTablet: tablet d87cc0f336ac40678dbc136072425740 deleted and replaced by tablet 642cd64ad8c44acb8566aeddd47fef9a
I20250115 10:11:54.436937 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet d87cc0f336ac40678dbc136072425740 with delete_type TABLET_DATA_DELETED (replaced by tablet 642cd64ad8c44acb8566aeddd47fef9a) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.437795 3907 ts_tablet_manager.cc:1918] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.437896 3907 log.cc:1198] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/9f9aed809eb74964a1965a5b73807725
I20250115 10:11:54.438086 3907 ts_tablet_manager.cc:1939] T 9f9aed809eb74964a1965a5b73807725 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.438467 3907 tablet_replica.cc:331] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.438474 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 9f9aed809eb74964a1965a5b73807725 (table default.Table_0a77ba1a857147ecb9912f9a795ff2ca [id=7f690847821b44668c41b17a25d4ce37]) successfully deleted
I20250115 10:11:54.438572 3907 raft_consensus.cc:2238] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.438649 3907 raft_consensus.cc:2267] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.438827 3907 ts_tablet_manager.cc:1905] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.440147 3907 ts_tablet_manager.cc:1918] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.440248 3907 log.cc:1198] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/8133c8cadd73432d8c9cd8affb930359
I20250115 10:11:54.440469 3907 ts_tablet_manager.cc:1939] T 8133c8cadd73432d8c9cd8affb930359 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.440785 3907 tablet_replica.cc:331] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.440797 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 8133c8cadd73432d8c9cd8affb930359 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96]) successfully deleted
I20250115 10:11:54.440889 3907 raft_consensus.cc:2238] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.440969 3907 raft_consensus.cc:2267] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.441128 3907 ts_tablet_manager.cc:1905] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.442590 3907 ts_tablet_manager.cc:1918] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.442745 3907 log.cc:1198] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d87cc0f336ac40678dbc136072425740
I20250115 10:11:54.443105 3907 ts_tablet_manager.cc:1939] T d87cc0f336ac40678dbc136072425740 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.443692 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d87cc0f336ac40678dbc136072425740 (table default.Table_82afd111262349548f34d91b87848649 [id=7e51cdd4dc3c4055a6d1cabf8dd065e1]) successfully deleted
W20250115 10:11:54.459628 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 1285ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:54.494123 3484 consensus_peers.cc:487] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f889cc1201404c8691bf01256750e244. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:54.533648 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:54.544323 3484 consensus_peers.cc:487] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:54.580830 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1f8e0f310ee640599a19221d83cd10ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.581035 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f8e0f310ee640599a19221d83cd10ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.581210 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6b67e1c0e8db4fb2ad39579a6aa646de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.581344 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b67e1c0e8db4fb2ad39579a6aa646de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.581238 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3189896cc7e5429db0ae1034257eb26a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.581547 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3189896cc7e5429db0ae1034257eb26a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.586248 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_93db04309bf549be92327cab1075180d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.586362 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93db04309bf549be92327cab1075180d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.595894 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2b8ff1c6f52f4e969e94bafef1635fd6" } new_table_name: "default.Table_ff969d2b370c4783b7588dbcf2575b36" modify_external_catalogs: true
W20250115 10:11:54.596415 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:11:54.596462 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:54.597211 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 882a4a732b964a088de67336d741da59 has no consensus state
I20250115 10:11:54.601670 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_173467cb54b3482dadd85057928fd763" } modify_external_catalogs: true
I20250115 10:11:54.601735 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_173467cb54b3482dadd85057928fd763" } modify_external_catalogs: true
I20250115 10:11:54.602706 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 5c19bb75be624574afd9d3e7149bb228
I20250115 10:11:54.602967 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c19bb75be624574afd9d3e7149bb228 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.603070 3907 tablet_replica.cc:331] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.603158 3907 raft_consensus.cc:2238] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.603204 3907 raft_consensus.cc:2267] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.603312 3907 ts_tablet_manager.cc:1905] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.604919 3907 ts_tablet_manager.cc:1918] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.604976 3907 log.cc:1198] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5c19bb75be624574afd9d3e7149bb228
I20250115 10:11:54.605140 3907 ts_tablet_manager.cc:1939] T 5c19bb75be624574afd9d3e7149bb228 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.605446 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5c19bb75be624574afd9d3e7149bb228 (table default.Table_173467cb54b3482dadd85057928fd763 [id=c6fe8de8cec64b40be547310332fbb5b]) successfully deleted
I20250115 10:11:54.606359 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bfb0432771ca426080dd8d585d9b0413" } new_table_name: "default.Table_ba72dc1b666649d385a4e775ffa69817" modify_external_catalogs: true
I20250115 10:11:54.606927 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ce872501e66349fc84f96026916c4f38" } new_table_name: "default.Table_966e93e096e4426b9640147d3e4f4ebc" modify_external_catalogs: true
W20250115 10:11:54.607581 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
W20250115 10:11:54.608004 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f493fbea94cc4f069f1b3072fec51606 has no consensus state
I20250115 10:11:54.609465 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cdc6d55df5d34817a6f25151777a63fd" } modify_external_catalogs: true
I20250115 10:11:54.609524 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cdc6d55df5d34817a6f25151777a63fd" } modify_external_catalogs: true
I20250115 10:11:54.610298 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1c0ebbde47434c23a8bf0beca4d51c41
I20250115 10:11:54.610952 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6058bb52b5124f9ca1463f40676b58e9" } modify_external_catalogs: true
I20250115 10:11:54.611012 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6058bb52b5124f9ca1463f40676b58e9" } modify_external_catalogs: true
I20250115 10:11:54.611740 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet cc60b33f4761408e9257bc459d022a08
I20250115 10:11:54.613761 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cb95b3d9f4e44e7c82ed1cba4341edde" } new_table_name: "default.Table_75d120304444407fbdf0d47be806d5a2" modify_external_catalogs: true
W20250115 10:11:54.614806 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
I20250115 10:11:54.615304 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5dd8117d6ff545539da3827d0230d301" } new_table_name: "default.Table_262f5d7fe5c740f48251c66b7109e832" modify_external_catalogs: true
W20250115 10:11:54.616182 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 451d1d6210e34d57bee6a92b40378c38 has no consensus state
I20250115 10:11:54.619166 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6b9c72c44d6d4a94bb3b2698687637c8" } modify_external_catalogs: true
I20250115 10:11:54.619218 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6b9c72c44d6d4a94bb3b2698687637c8" } modify_external_catalogs: true
I20250115 10:11:54.620011 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 4be8b43bac944da388d73728deff9c82
I20250115 10:11:54.623807 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_67c94882e80c48eebe278167d361f396" } modify_external_catalogs: true
I20250115 10:11:54.623883 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_67c94882e80c48eebe278167d361f396" } modify_external_catalogs: true
I20250115 10:11:54.624660 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 13ab43256b92453fb96f066a08b99df8
I20250115 10:11:54.625350 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bd9de57ae1bc4762a78e6ff2cfb7e107"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.625459 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd9de57ae1bc4762a78e6ff2cfb7e107 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.625864 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 4e6a33be02774b7e888193b60ba21923 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.626897 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 42ffbcd1216041e5a1e7e0794dc79727 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.626920 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4e6a33be02774b7e888193b60ba21923
I20250115 10:11:54.626991 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 4e6a33be02774b7e888193b60ba21923 deleted and replaced by tablet 1e1b6769bd2f455a9778ad0910a9236d
I20250115 10:11:54.627175 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 4e6a33be02774b7e888193b60ba21923 with delete_type TABLET_DATA_DELETED (replaced by tablet 1e1b6769bd2f455a9778ad0910a9236d) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.627269 3907 tablet_replica.cc:331] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.627341 3907 raft_consensus.cc:2238] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.627380 3907 raft_consensus.cc:2267] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.627481 3907 ts_tablet_manager.cc:1905] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.627765 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 6369536ece374beb836277c7fadeafff from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.627832 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_44498f20bad64b63afb8f233226072a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:54.627902 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 42ffbcd1216041e5a1e7e0794dc79727
I20250115 10:11:54.627986 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 42ffbcd1216041e5a1e7e0794dc79727 deleted and replaced by tablet ef06834fca804e34aa06e98185ad1194
W20250115 10:11:54.627907 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44498f20bad64b63afb8f233226072a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.628405 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 42ffbcd1216041e5a1e7e0794dc79727 with delete_type TABLET_DATA_DELETED (replaced by tablet ef06834fca804e34aa06e98185ad1194) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.628919 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a8330e16cd364cb7b71f213ba72a3055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.629014 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8330e16cd364cb7b71f213ba72a3055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.629244 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6369536ece374beb836277c7fadeafff
I20250115 10:11:54.629303 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 6369536ece374beb836277c7fadeafff deleted and replaced by tablet 74ab86571c3a469da7a51cf6033c5b10
I20250115 10:11:54.629456 3907 ts_tablet_manager.cc:1918] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.629508 3907 log.cc:1198] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4e6a33be02774b7e888193b60ba21923
I20250115 10:11:54.629627 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 6369536ece374beb836277c7fadeafff with delete_type TABLET_DATA_DELETED (replaced by tablet 74ab86571c3a469da7a51cf6033c5b10) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.629680 3907 ts_tablet_manager.cc:1939] T 4e6a33be02774b7e888193b60ba21923 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.629887 3907 tablet_replica.cc:331] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.629948 3907 raft_consensus.cc:2238] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.629957 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4e6a33be02774b7e888193b60ba21923 (table default.Table_af73bb16736c4ae794942a4464f7ad3d [id=eab8a311779041dcbfae08dc483a9b6b]) successfully deleted
I20250115 10:11:54.629981 3907 raft_consensus.cc:2267] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.630070 3907 ts_tablet_manager.cc:1905] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.630802 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 76db7eec08534e86b14b11b13205e43a from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.631445 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b20fc5398a9749d7b7d4eaf138f98d33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.631557 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b20fc5398a9749d7b7d4eaf138f98d33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.631639 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 76db7eec08534e86b14b11b13205e43a
I20250115 10:11:54.631731 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 76db7eec08534e86b14b11b13205e43a deleted and replaced by tablet 6de00635c3b341c3a23b2296e3993325
I20250115 10:11:54.631853 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 76db7eec08534e86b14b11b13205e43a with delete_type TABLET_DATA_DELETED (replaced by tablet 6de00635c3b341c3a23b2296e3993325) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.632081 3907 ts_tablet_manager.cc:1918] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.632187 3907 log.cc:1198] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/42ffbcd1216041e5a1e7e0794dc79727
I20250115 10:11:54.632366 3907 ts_tablet_manager.cc:1939] T 42ffbcd1216041e5a1e7e0794dc79727 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.632738 3907 tablet_replica.cc:331] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.632742 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 42ffbcd1216041e5a1e7e0794dc79727 (table default.Table_7e9385b3fcc74c79970da38116ffbe7a [id=58ed6869f82045868c11e668099a04b9]) successfully deleted
I20250115 10:11:54.632825 3907 raft_consensus.cc:2238] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.632895 3907 raft_consensus.cc:2267] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.632994 3907 ts_tablet_manager.cc:1905] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.634029 3907 ts_tablet_manager.cc:1918] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.634083 3907 log.cc:1198] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6369536ece374beb836277c7fadeafff
I20250115 10:11:54.634244 3907 ts_tablet_manager.cc:1939] T 6369536ece374beb836277c7fadeafff P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.634331 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a5d8b41b93964d2b9fad544c7e28d0e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.634433 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5d8b41b93964d2b9fad544c7e28d0e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.634635 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6369536ece374beb836277c7fadeafff (table default.Table_4c8b7687d6614ea18a5377539659492c [id=03b48d4b08244c53bba7b29e9939212a]) successfully deleted
I20250115 10:11:54.634534 3907 tablet_replica.cc:331] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.634765 3907 raft_consensus.cc:2238] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.634809 3907 raft_consensus.cc:2267] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.634925 3907 ts_tablet_manager.cc:1905] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.635447 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_99ac5e2499df4cfcb4df671bfb26dae3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.635547 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99ac5e2499df4cfcb4df671bfb26dae3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.636173 3907 ts_tablet_manager.cc:1918] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.636242 3907 log.cc:1198] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/76db7eec08534e86b14b11b13205e43a
I20250115 10:11:54.636390 3907 ts_tablet_manager.cc:1939] T 76db7eec08534e86b14b11b13205e43a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.636848 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 76db7eec08534e86b14b11b13205e43a (table default.Table_dc259fc343564cada5bc183e3a1781b0 [id=d483fefe2d154fefb3fce62fb5e56538]) successfully deleted
I20250115 10:11:54.637792 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet 6034c750d47744ff8eb4d62c7c135ed7 from {username='slave'} at 127.0.0.1:46172
W20250115 10:11:54.638608 3085 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 79acd5d799ab4b6f973f6c3d6b27df62 (table default.Table_ba72dc1b666649d385a4e775ffa69817 [id=5f7622e908a04e3cbbec80fa98dbd66c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
I20250115 10:11:54.638670 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:11:54.638746 3099 catalog_manager.cc:6596] ReplaceTablet: tablet 6034c750d47744ff8eb4d62c7c135ed7 deleted and replaced by tablet 3552b8e936ad4aeba0eadc95577f5414
I20250115 10:11:54.639014 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 6034c750d47744ff8eb4d62c7c135ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet 3552b8e936ad4aeba0eadc95577f5414) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.639197 3907 tablet_replica.cc:331] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.639256 3907 raft_consensus.cc:2238] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.639307 3907 raft_consensus.cc:2267] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.639405 3907 ts_tablet_manager.cc:1905] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.640563 3907 ts_tablet_manager.cc:1918] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:54.640606 3907 log.cc:1198] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:11:54.640766 3907 ts_tablet_manager.cc:1939] T 6034c750d47744ff8eb4d62c7c135ed7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.641012 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6034c750d47744ff8eb4d62c7c135ed7 (table default.Table_71fadfa7b3fc4592bf0079c6081de706 [id=f03783b8301b4115af49aa260e2ff35b]) successfully deleted
W20250115 10:11:54.685509 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:54.694222 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 1557ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:54.710592 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:54.723160 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 1557ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:54.756482 3484 consensus_peers.cc:487] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:54.777638 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:54.782986 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f9fcbeb2c7e34f4385cfebba458a7fc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.783128 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9fcbeb2c7e34f4385cfebba458a7fc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.783530 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f6c7ac0aee174bc0ac112e908f51fb1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:54.783638 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4d54974496634d12ad4340b56c3d372b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.783640 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6c7ac0aee174bc0ac112e908f51fb1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:54.783731 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d54974496634d12ad4340b56c3d372b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.787528 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_169fbca95f7b47bf85ce6d990f545da2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.787607 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_169fbca95f7b47bf85ce6d990f545da2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.797770 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_71fadfa7b3fc4592bf0079c6081de706" } new_table_name: "default.Table_baba9f0634bd454bab116625f5bbbda6" modify_external_catalogs: true
W20250115 10:11:54.798640 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:54.799017 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3552b8e936ad4aeba0eadc95577f5414 has no consensus state
I20250115 10:11:54.803267 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd9de57ae1bc4762a78e6ff2cfb7e107" } modify_external_catalogs: true
I20250115 10:11:54.803333 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd9de57ae1bc4762a78e6ff2cfb7e107" } modify_external_catalogs: true
I20250115 10:11:54.804224 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 28f34b3142a2485f82250b9b1f99b6ab
I20250115 10:11:54.808039 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bef3ed34ff6c40de921f8b991814dd65" } new_table_name: "default.Table_23e7e88673a94ca785689fe101f9af13" modify_external_catalogs: true
I20250115 10:11:54.808491 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f6c7ac0aee174bc0ac112e908f51fb1b" } new_table_name: "default.Table_78356a60ecd94e809ce6bf2941bdbdb5" modify_external_catalogs: true
W20250115 10:11:54.809077 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb653c1d93014055bf2ef51e14d6e227 consensus state has no leader
W20250115 10:11:54.809535 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d841537abc2437c826e069cc0725ad1 has no consensus state
I20250115 10:11:54.810685 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4d54974496634d12ad4340b56c3d372b" } modify_external_catalogs: true
I20250115 10:11:54.810765 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4d54974496634d12ad4340b56c3d372b" } modify_external_catalogs: true
I20250115 10:11:54.811554 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1596a65669114ca2ac11925e590543b8
I20250115 10:11:54.812125 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d13ad1c30ac54e8ea0625a6065af980c" } modify_external_catalogs: true
I20250115 10:11:54.812179 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d13ad1c30ac54e8ea0625a6065af980c" } modify_external_catalogs: true
I20250115 10:11:54.813012 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet fbde8a45c2f04dfc8686516cbcb1843e
I20250115 10:11:54.815212 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_af73bb16736c4ae794942a4464f7ad3d" } new_table_name: "default.Table_a28027b28709434bb21379078b64d25f" modify_external_catalogs: true
W20250115 10:11:54.816202 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1e1b6769bd2f455a9778ad0910a9236d has no consensus state
I20250115 10:11:54.816569 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d2972c96710249d5b0eca03668930ab5" } new_table_name: "default.Table_bace75e77470498a937648cb959be30d" modify_external_catalogs: true
W20250115 10:11:54.817471 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d34f0713bda44fd9e50aab211e28256 has no consensus state
I20250115 10:11:54.820413 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ff969d2b370c4783b7588dbcf2575b36" } modify_external_catalogs: true
I20250115 10:11:54.820487 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ff969d2b370c4783b7588dbcf2575b36" } modify_external_catalogs: true
I20250115 10:11:54.821308 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 882a4a732b964a088de67336d741da59
I20250115 10:11:54.825052 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_262f5d7fe5c740f48251c66b7109e832" } modify_external_catalogs: true
I20250115 10:11:54.825109 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_262f5d7fe5c740f48251c66b7109e832" } modify_external_catalogs: true
I20250115 10:11:54.825975 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 451d1d6210e34d57bee6a92b40378c38
I20250115 10:11:54.826722 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8d0d0da8b2a243c3b8219419abaa92c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.826831 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d0d0da8b2a243c3b8219419abaa92c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.828353 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 4db40559d7894bb8b80cf27b546c8f56 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.829161 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4db40559d7894bb8b80cf27b546c8f56
I20250115 10:11:54.829237 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 4db40559d7894bb8b80cf27b546c8f56 deleted and replaced by tablet 1fa5b108bd214a56840cea7583755db2
I20250115 10:11:54.829282 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 91c84b4ba08d4f1ba47147e496a97320 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.829559 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db40559d7894bb8b80cf27b546c8f56 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa5b108bd214a56840cea7583755db2) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.829653 3907 tablet_replica.cc:331] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.829715 3907 raft_consensus.cc:2238] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.829753 3907 raft_consensus.cc:2267] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.829764 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_370a405787b34d6d9626a34eb462aa7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.829865 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_370a405787b34d6d9626a34eb462aa7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.829876 3907 ts_tablet_manager.cc:1905] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.830365 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 91c84b4ba08d4f1ba47147e496a97320
I20250115 10:11:54.830446 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 91c84b4ba08d4f1ba47147e496a97320 deleted and replaced by tablet 91f2c04014a14b2084eb988e59040038
I20250115 10:11:54.830595 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 6137a5bb4b2c4df29253ecd340653159 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.831568 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d3583ad3abc947f0a3962b8b378118bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.831655 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3583ad3abc947f0a3962b8b378118bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.831779 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6137a5bb4b2c4df29253ecd340653159
I20250115 10:11:54.831881 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 6137a5bb4b2c4df29253ecd340653159 deleted and replaced by tablet 65f21a7bcfaa4d7595b7167e90b47798
I20250115 10:11:54.832171 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 91c84b4ba08d4f1ba47147e496a97320 with delete_type TABLET_DATA_DELETED (replaced by tablet 91f2c04014a14b2084eb988e59040038) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.832214 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 6137a5bb4b2c4df29253ecd340653159 with delete_type TABLET_DATA_DELETED (replaced by tablet 65f21a7bcfaa4d7595b7167e90b47798) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.832427 3907 ts_tablet_manager.cc:1918] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:54.832482 3907 log.cc:1198] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4db40559d7894bb8b80cf27b546c8f56
I20250115 10:11:54.832696 3907 ts_tablet_manager.cc:1939] T 4db40559d7894bb8b80cf27b546c8f56 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.832772 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet bd1c5a31c2ef4d629e0439fbe79d06a4 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.832957 3907 tablet_replica.cc:331] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.833009 3907 raft_consensus.cc:2238] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.833025 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]) successfully deleted
I20250115 10:11:54.833046 3907 raft_consensus.cc:2267] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.833165 3907 ts_tablet_manager.cc:1905] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.833369 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c16e568822154d5ea79d791d2e59a131"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.833452 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c16e568822154d5ea79d791d2e59a131 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.833808 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet bd1c5a31c2ef4d629e0439fbe79d06a4
I20250115 10:11:54.833884 3092 catalog_manager.cc:6596] ReplaceTablet: tablet bd1c5a31c2ef4d629e0439fbe79d06a4 deleted and replaced by tablet 87f86a046c7147e79e8c7941294fb904
I20250115 10:11:54.834014 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet bd1c5a31c2ef4d629e0439fbe79d06a4 with delete_type TABLET_DATA_DELETED (replaced by tablet 87f86a046c7147e79e8c7941294fb904) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.834626 3907 ts_tablet_manager.cc:1918] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.834686 3907 log.cc:1198] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/91c84b4ba08d4f1ba47147e496a97320
I20250115 10:11:54.834861 3907 ts_tablet_manager.cc:1939] T 91c84b4ba08d4f1ba47147e496a97320 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.835049 3907 tablet_replica.cc:331] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.835090 3907 raft_consensus.cc:2238] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.835137 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 91c84b4ba08d4f1ba47147e496a97320 (table default.Table_dca7d059ac2e49289b71f48bb9af91fa [id=454166c8d95d4a44a1326fd1c0bb7e3a]) successfully deleted
I20250115 10:11:54.835166 3907 raft_consensus.cc:2267] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.835256 3907 ts_tablet_manager.cc:1905] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.836270 3907 ts_tablet_manager.cc:1918] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.836320 3907 log.cc:1198] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6137a5bb4b2c4df29253ecd340653159
I20250115 10:11:54.836453 3907 ts_tablet_manager.cc:1939] T 6137a5bb4b2c4df29253ecd340653159 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.836762 3907 tablet_replica.cc:331] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.836843 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6137a5bb4b2c4df29253ecd340653159 (table default.Table_9cdf22ad1fd140bb9a95640f58137d75 [id=bc38bb8a517d4c83b535fb7031ef8295]) successfully deleted
I20250115 10:11:54.836921 3907 raft_consensus.cc:2238] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.836963 3907 raft_consensus.cc:2267] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.836956 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_df0a036eb35c4153ab185a6abcba2a31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.837041 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df0a036eb35c4153ab185a6abcba2a31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.837059 3907 ts_tablet_manager.cc:1905] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.837337 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_447b33de744e459292f30c7e4dfef9e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.837420 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_447b33de744e459292f30c7e4dfef9e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.838626 3907 ts_tablet_manager.cc:1918] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:54.838680 3907 log.cc:1198] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/bd1c5a31c2ef4d629e0439fbe79d06a4
I20250115 10:11:54.838836 3907 ts_tablet_manager.cc:1939] T bd1c5a31c2ef4d629e0439fbe79d06a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.839241 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet bd1c5a31c2ef4d629e0439fbe79d06a4 (table default.Table_689903396b5f4091a2df2cb00a826e64 [id=b18be4868f6043868407914800d910a3]) successfully deleted
I20250115 10:11:54.839737 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 6e56c83017b54e65a066e8e377293b13 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:54.840551 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:11:54.840626 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 6e56c83017b54e65a066e8e377293b13 deleted and replaced by tablet 6aa81e05a22e46bf94b378605a889eee
I20250115 10:11:54.840798 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e56c83017b54e65a066e8e377293b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa81e05a22e46bf94b378605a889eee) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:54.840952 3907 tablet_replica.cc:331] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:54.841008 3907 raft_consensus.cc:2238] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:54.841045 3907 raft_consensus.cc:2267] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:54.841147 3907 ts_tablet_manager.cc:1905] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:54.842060 3907 ts_tablet_manager.cc:1918] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:54.842116 3907 log.cc:1198] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6e56c83017b54e65a066e8e377293b13
I20250115 10:11:54.842310 3907 ts_tablet_manager.cc:1939] T 6e56c83017b54e65a066e8e377293b13 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:54.842577 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6e56c83017b54e65a066e8e377293b13 (table default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a [id=97e1085cf3bc494c8a0a05662b4c2701]) successfully deleted
W20250115 10:11:54.920272 3797 leader_election.cc:336] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283): Timed out: RequestConsensusVote RPC to 127.2.217.188:38283 timed out after 0.664s (SENT)
I20250115 10:11:54.920354 3797 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:11:54.920567 4207 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:11:54.923568 2918 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskjHaIeY/build/release/bin/kudu with pid 3778
W20250115 10:11:54.931020 3485 connection.cc:537] client connection to 127.2.217.189:36717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250115 10:11:54.962925 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 1820ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:54.985113 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_702ea3bed8cb4aeda8ba9e96d453e4dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.985299 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_702ea3bed8cb4aeda8ba9e96d453e4dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.985486 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_efa7b12b5d2e4166886cf0a5e91a19af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.985625 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efa7b12b5d2e4166886cf0a5e91a19af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:54.985486 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_10653da144dc43448fbebcd5b9b2f01b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.986068 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10653da144dc43448fbebcd5b9b2f01b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:54.987670 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:54.988919 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_61e0493cda81477b901a05f9134a6e8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:54.989032 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61e0493cda81477b901a05f9134a6e8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:54.998982 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 1820ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:54.999586 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_447b33de744e459292f30c7e4dfef9e7" } new_table_name: "default.Table_982fc2e9815d429f892c2e9e2b4097f1" modify_external_catalogs: true
W20250115 10:11:55.000720 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9325498aa4b4c129c8e78ad403eba85 has no consensus state
I20250115 10:11:55.004868 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_87cb0da97ca94671b8574ff819247489" } modify_external_catalogs: true
I20250115 10:11:55.004933 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_87cb0da97ca94671b8574ff819247489" } modify_external_catalogs: true
I20250115 10:11:55.005949 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 17ccfefe972541c697d71a33a48dba54
I20250115 10:11:55.009485 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6b67e1c0e8db4fb2ad39579a6aa646de" } new_table_name: "default.Table_5727acff9e444a01ac5b2928b0a7e8b5" modify_external_catalogs: true
I20250115 10:11:55.009980 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_93db04309bf549be92327cab1075180d" } new_table_name: "default.Table_ae01eda31eb145068476bf27e03186b8" modify_external_catalogs: true
W20250115 10:11:55.010414 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c53f12f3a2c6457bb13b13cef42c89ad has no consensus state
W20250115 10:11:55.011111 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1427f64219234fa089bee5ed251f6122 has no consensus state
I20250115 10:11:55.011945 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae4d1993de084e1e90bf03ea10660815" } modify_external_catalogs: true
I20250115 10:11:55.012008 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae4d1993de084e1e90bf03ea10660815" } modify_external_catalogs: true
I20250115 10:11:55.012789 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b010024c562e4793888983aa0385052d
I20250115 10:11:55.013437 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7e9385b3fcc74c79970da38116ffbe7a" } modify_external_catalogs: true
I20250115 10:11:55.013486 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7e9385b3fcc74c79970da38116ffbe7a" } modify_external_catalogs: true
I20250115 10:11:55.014240 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ef06834fca804e34aa06e98185ad1194
I20250115 10:11:55.016577 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4754e67eb67e4cf58580ddcd31bb68f6" } new_table_name: "default.Table_23eba6daaad24569b9a412f1b789c6f2" modify_external_catalogs: true
W20250115 10:11:55.017452 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6433d51732d94906b431b1b77c148e50 has no consensus state
I20250115 10:11:55.017863 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1dda39295310490986ccffe5a2a9bed9" } new_table_name: "default.Table_83d77cc8caf74364af556dd677bd3f5c" modify_external_catalogs: true
W20250115 10:11:55.018735 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 has no consensus state
I20250115 10:11:55.021709 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4abd14d53e874acdacbc40ce26faaa85" } modify_external_catalogs: true
I20250115 10:11:55.021785 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4abd14d53e874acdacbc40ce26faaa85" } modify_external_catalogs: true
I20250115 10:11:55.022634 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6c7e5d185b9e43b5b2265cc88de97999
I20250115 10:11:55.022899 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c7e5d185b9e43b5b2265cc88de97999 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:55 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.023029 3907 tablet_replica.cc:331] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.023101 3907 raft_consensus.cc:2238] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.023155 3907 raft_consensus.cc:2267] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.023288 3907 ts_tablet_manager.cc:1905] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.025008 3907 ts_tablet_manager.cc:1918] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.025061 3907 log.cc:1198] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6c7e5d185b9e43b5b2265cc88de97999
I20250115 10:11:55.025223 3907 ts_tablet_manager.cc:1939] T 6c7e5d185b9e43b5b2265cc88de97999 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.025506 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6c7e5d185b9e43b5b2265cc88de97999 (table default.Table_4abd14d53e874acdacbc40ce26faaa85 [id=a69f65c9f9904a839351ae067c897251]) successfully deleted
I20250115 10:11:55.026506 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_05b83e6e2d324d81aa573dbed2412e1d" } modify_external_catalogs: true
I20250115 10:11:55.026575 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_05b83e6e2d324d81aa573dbed2412e1d" } modify_external_catalogs: true
I20250115 10:11:55.027426 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6074dac081d14ab0a9548956a6ae63b0
I20250115 10:11:55.028195 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e72dbe33258c4d55b5ad5275454bd000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.028312 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e72dbe33258c4d55b5ad5275454bd000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.031613 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_62fe2d010c9d4125a4d5c1db04d61fc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.031752 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62fe2d010c9d4125a4d5c1db04d61fc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.032397 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:55.033210 3092 master_service.cc:946] ReplaceTablet: received request to replace tablet 1730b88414f04cad8b2991a2ef95f39d from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.033247 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet cfcaece8146a4b22af4b47d06feacf9a from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.033401 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet fb653c1d93014055bf2ef51e14d6e227 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.033645 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7934a48400e540d0ba53a1b658524d29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.033737 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7934a48400e540d0ba53a1b658524d29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.034399 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet cfcaece8146a4b22af4b47d06feacf9a
I20250115 10:11:55.034497 3099 catalog_manager.cc:6596] ReplaceTablet: tablet cfcaece8146a4b22af4b47d06feacf9a deleted and replaced by tablet 42233960ee47426ba6643c4bc92485d3
I20250115 10:11:55.034677 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet cfcaece8146a4b22af4b47d06feacf9a with delete_type TABLET_DATA_DELETED (replaced by tablet 42233960ee47426ba6643c4bc92485d3) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.034804 3907 tablet_replica.cc:331] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.034878 3907 raft_consensus.cc:2238] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.034916 3907 raft_consensus.cc:2267] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.034919 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b9ad25d16685403d8de69c3dfdb86748"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.035006 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9ad25d16685403d8de69c3dfdb86748 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.035032 3907 ts_tablet_manager.cc:1905] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.035384 3092 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 1730b88414f04cad8b2991a2ef95f39d
I20250115 10:11:55.035459 3092 catalog_manager.cc:6596] ReplaceTablet: tablet 1730b88414f04cad8b2991a2ef95f39d deleted and replaced by tablet 65de0a99d55d4382bb2454b059ae0284
I20250115 10:11:55.035501 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet f5ee2fd58ed741218b4ee6461b6f6c51 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.035785 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet fb653c1d93014055bf2ef51e14d6e227
I20250115 10:11:55.035867 3095 catalog_manager.cc:6596] ReplaceTablet: tablet fb653c1d93014055bf2ef51e14d6e227 deleted and replaced by tablet 4cbd61aec79d479d9eea8d807cd5fb0e
I20250115 10:11:55.036135 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 1730b88414f04cad8b2991a2ef95f39d with delete_type TABLET_DATA_DELETED (replaced by tablet 65de0a99d55d4382bb2454b059ae0284) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.036166 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet fb653c1d93014055bf2ef51e14d6e227 with delete_type TABLET_DATA_DELETED (replaced by tablet 4cbd61aec79d479d9eea8d807cd5fb0e) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.037073 3907 ts_tablet_manager.cc:1918] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.037134 3907 log.cc:1198] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/cfcaece8146a4b22af4b47d06feacf9a
I20250115 10:11:55.037209 3093 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet f5ee2fd58ed741218b4ee6461b6f6c51
I20250115 10:11:55.037299 3093 catalog_manager.cc:6596] ReplaceTablet: tablet f5ee2fd58ed741218b4ee6461b6f6c51 deleted and replaced by tablet 5461620a4b644906ad7d9694dfc80177
I20250115 10:11:55.037333 3907 ts_tablet_manager.cc:1939] T cfcaece8146a4b22af4b47d06feacf9a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.037437 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet f5ee2fd58ed741218b4ee6461b6f6c51 with delete_type TABLET_DATA_DELETED (replaced by tablet 5461620a4b644906ad7d9694dfc80177) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.037554 3907 tablet_replica.cc:331] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.037619 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet cfcaece8146a4b22af4b47d06feacf9a (table default.Table_bee935a490e8405b98608f6e8d58ef71 [id=7312ffa296ac4354ab60d31e72f1671e]) successfully deleted
I20250115 10:11:55.037631 3907 raft_consensus.cc:2238] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.037668 3907 raft_consensus.cc:2267] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.037760 3907 ts_tablet_manager.cc:1905] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.038259 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_311dcc333209435c8c22dc455898f8ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.038368 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_311dcc333209435c8c22dc455898f8ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.038697 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_29b0a2290843417ab51c63171de9b4e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.038775 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29b0a2290843417ab51c63171de9b4e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.038856 3907 ts_tablet_manager.cc:1918] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.038901 3907 log.cc:1198] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/1730b88414f04cad8b2991a2ef95f39d
I20250115 10:11:55.039049 3907 ts_tablet_manager.cc:1939] T 1730b88414f04cad8b2991a2ef95f39d P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.039423 3907 tablet_replica.cc:331] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.039484 3907 raft_consensus.cc:2238] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.039480 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 1730b88414f04cad8b2991a2ef95f39d (table default.Table_92c3df7773a0409fa3515d97fc032468 [id=6e4655f4f7484191843186993a29831b]) successfully deleted
I20250115 10:11:55.039520 3907 raft_consensus.cc:2267] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.039635 3907 ts_tablet_manager.cc:1905] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.040731 3907 ts_tablet_manager.cc:1918] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.040778 3907 log.cc:1198] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/fb653c1d93014055bf2ef51e14d6e227
I20250115 10:11:55.040913 3907 ts_tablet_manager.cc:1939] T fb653c1d93014055bf2ef51e14d6e227 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.041183 3907 tablet_replica.cc:331] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.041211 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet fb653c1d93014055bf2ef51e14d6e227 (table default.Table_23e7e88673a94ca785689fe101f9af13 [id=4d3a10d579954f9099286160f2a3006d]) successfully deleted
I20250115 10:11:55.041266 3907 raft_consensus.cc:2238] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.041389 3907 raft_consensus.cc:2267] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.041488 3907 ts_tablet_manager.cc:1905] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.041486 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet b37d2f57618e4f808e8799fd246b97d1 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.042299 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet b37d2f57618e4f808e8799fd246b97d1
I20250115 10:11:55.042385 3099 catalog_manager.cc:6596] ReplaceTablet: tablet b37d2f57618e4f808e8799fd246b97d1 deleted and replaced by tablet fc4ed27a7c1a49eea8f85763d8c86343
I20250115 10:11:55.042511 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet b37d2f57618e4f808e8799fd246b97d1 with delete_type TABLET_DATA_DELETED (replaced by tablet fc4ed27a7c1a49eea8f85763d8c86343) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.042611 3907 ts_tablet_manager.cc:1918] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.042661 3907 log.cc:1198] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f5ee2fd58ed741218b4ee6461b6f6c51
I20250115 10:11:55.042853 3907 ts_tablet_manager.cc:1939] T f5ee2fd58ed741218b4ee6461b6f6c51 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.043079 3907 tablet_replica.cc:331] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.043140 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f5ee2fd58ed741218b4ee6461b6f6c51 (table default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]) successfully deleted
I20250115 10:11:55.043161 3907 raft_consensus.cc:2238] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.043195 3907 raft_consensus.cc:2267] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.043368 3907 ts_tablet_manager.cc:1905] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.044428 3907 ts_tablet_manager.cc:1918] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.044499 3907 log.cc:1198] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/b37d2f57618e4f808e8799fd246b97d1
I20250115 10:11:55.044646 3907 ts_tablet_manager.cc:1939] T b37d2f57618e4f808e8799fd246b97d1 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.044981 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet b37d2f57618e4f808e8799fd246b97d1 (table default.Table_6f7c58e7d0434d6d8d354e484fcc305a [id=a4785133cc31487791b54f5858d33e57]) successfully deleted
W20250115 10:11:55.047492 3214 consensus_peers.cc:487] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e56c83017b54e65a066e8e377293b13. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:55.048707 3671 raft_consensus.cc:491] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:55.048772 3671 raft_consensus.cc:513] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:55.048907 3671 leader_election.cc:290] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.049049 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:55.049141 3550 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:11:55.049144 3214 leader_election.cc:343] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 13abbfea00154474b1082cf8ccd14899
I20250115 10:11:55.049264 3215 leader_election.cc:304] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.049363 3671 raft_consensus.cc:2798] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.049393 3671 raft_consensus.cc:491] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:55.049418 3671 raft_consensus.cc:3054] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:55.049881 3671 raft_consensus.cc:513] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:55.049988 3671 leader_election.cc:290] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.050097 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13abbfea00154474b1082cf8ccd14899" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:55.050175 3550 raft_consensus.cc:3054] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Advancing to term 2
W20250115 10:11:55.050202 3214 leader_election.cc:343] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 13abbfea00154474b1082cf8ccd14899
I20250115 10:11:55.050781 3550 raft_consensus.cc:2463] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 2.
I20250115 10:11:55.050951 3215 leader_election.cc:304] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.051029 3671 raft_consensus.cc:2798] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election won for term 2
I20250115 10:11:55.051090 3671 raft_consensus.cc:695] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:55.051136 3671 consensus_queue.cc:237] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:11:55.092446 4203 raft_consensus.cc:491] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.092554 4203 raft_consensus.cc:513] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.092748 4203 leader_election.cc:290] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.092948 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:55.093063 3278 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:11:55.093101 3484 leader_election.cc:343] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:55.093252 3485 leader_election.cc:304] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.093358 4203 raft_consensus.cc:2798] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.093398 4203 raft_consensus.cc:491] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.093420 4203 raft_consensus.cc:3054] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:55.094092 4203 raft_consensus.cc:513] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.094210 4203 leader_election.cc:290] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.094414 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec9406dc72bb4e489d76011a69ee2838" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:55.094540 3278 raft_consensus.cc:3054] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Advancing to term 2
W20250115 10:11:55.094579 3484 leader_election.cc:343] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:55.095295 3278 raft_consensus.cc:2463] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 2.
I20250115 10:11:55.095492 3485 leader_election.cc:304] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.095587 4203 raft_consensus.cc:2798] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election won for term 2
I20250115 10:11:55.095669 4203 raft_consensus.cc:695] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [term 2 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:55.095738 4203 consensus_queue.cc:237] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:11:55.096505 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:11:55.120697 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:55.187400 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4e10318102c942b19dec451845d599a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.187556 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e10318102c942b19dec451845d599a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.188387 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9dce4a3f55aa4f80a76c4d3e5b077511"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.188514 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9dce4a3f55aa4f80a76c4d3e5b077511 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.188757 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_573f2705b53148d88d787b2b78ccec20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.188855 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_573f2705b53148d88d787b2b78ccec20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.190268 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bb52c10df9e84061b57c9c01fc734ae2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.190374 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb52c10df9e84061b57c9c01fc734ae2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.198081 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:55.201187 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_982fc2e9815d429f892c2e9e2b4097f1" } new_table_name: "default.Table_bc8c5ca692f44840af807cc5c4fa1171" modify_external_catalogs: true
W20250115 10:11:55.202286 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9325498aa4b4c129c8e78ad403eba85 has no consensus state
I20250115 10:11:55.206333 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_966e93e096e4426b9640147d3e4f4ebc" } modify_external_catalogs: true
I20250115 10:11:55.206403 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_966e93e096e4426b9640147d3e4f4ebc" } modify_external_catalogs: true
I20250115 10:11:55.207512 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet f493fbea94cc4f069f1b3072fec51606
I20250115 10:11:55.210932 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cc3e18bf8fbf480c9b35e7d05c3dd3e7" } new_table_name: "default.Table_7fe87b7c12db49ae8a3f15cf721fcc0a" modify_external_catalogs: true
I20250115 10:11:55.211531 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7714def3d8e444b918369bab0fa7fd2" } new_table_name: "default.Table_663a776c3dab4bffaacba7de61ad20b0" modify_external_catalogs: true
W20250115 10:11:55.212071 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42b786c03fcb49eaafde89b98465230e has no consensus state
W20250115 10:11:55.212586 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f55439e91f284175a59d35160668fa6c has no consensus state
I20250115 10:11:55.213289 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_60d7145e17bd4e908bd70c3302f2ae5e" } modify_external_catalogs: true
I20250115 10:11:55.213348 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_60d7145e17bd4e908bd70c3302f2ae5e" } modify_external_catalogs: true
I20250115 10:11:55.214207 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8e863f3ea25c49f393de0c971986da91
I20250115 10:11:55.214689 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0e6602e434e44d1d98a212d7f5469c2f" } modify_external_catalogs: true
I20250115 10:11:55.214747 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0e6602e434e44d1d98a212d7f5469c2f" } modify_external_catalogs: true
I20250115 10:11:55.215662 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b24b053f813446fb87d334dae591d393
I20250115 10:11:55.217922 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7f1621bf44ce4fff8d3c4fc737ebaa50" } new_table_name: "default.Table_2ffae4a75d354cafb3a707f8931c47e3" modify_external_catalogs: true
W20250115 10:11:55.218873 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35bea3ba1af44df5a114ec883b71d147 has no consensus state
I20250115 10:11:55.219180 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_370a405787b34d6d9626a34eb462aa7d" } new_table_name: "default.Table_ad87d204318d444aa5cb3db8c84895e8" modify_external_catalogs: true
W20250115 10:11:55.220134 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 63980fabd5634bf39c41215740cd4d72 has no consensus state
I20250115 10:11:55.223277 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62d774f73d504686a1fa6c4a416fd557" } modify_external_catalogs: true
I20250115 10:11:55.223337 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62d774f73d504686a1fa6c4a416fd557" } modify_external_catalogs: true
I20250115 10:11:55.224313 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 1a0ff3ac5e2046b6800958a5f1d930d7
I20250115 10:11:55.224639 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a0ff3ac5e2046b6800958a5f1d930d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:55 UTC) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.224778 3907 tablet_replica.cc:331] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.224869 3907 raft_consensus.cc:2238] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.224918 3907 raft_consensus.cc:2267] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.225061 3907 ts_tablet_manager.cc:1905] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.226904 3907 ts_tablet_manager.cc:1918] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.227021 3907 log.cc:1198] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/1a0ff3ac5e2046b6800958a5f1d930d7
I20250115 10:11:55.227247 3907 ts_tablet_manager.cc:1939] T 1a0ff3ac5e2046b6800958a5f1d930d7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.227576 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 1a0ff3ac5e2046b6800958a5f1d930d7 (table default.Table_62d774f73d504686a1fa6c4a416fd557 [id=b3b64b3890f24b7ca49641044b04b40b]) successfully deleted
I20250115 10:11:55.227941 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5c8aa519960344fba99ce14770b775e8" } modify_external_catalogs: true
I20250115 10:11:55.227999 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5c8aa519960344fba99ce14770b775e8" } modify_external_catalogs: true
I20250115 10:11:55.228931 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1b664d4eebc0447ea8621f50ffda16d8
I20250115 10:11:55.229684 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0bfecbf8f6db434c853e2fc9024e5c2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.229799 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bfecbf8f6db434c853e2fc9024e5c2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.233686 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f363410cf26a4ddbbba821d5ea06c2e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.233826 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f363410cf26a4ddbbba821d5ea06c2e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.234840 3484 consensus_peers.cc:487] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4db40559d7894bb8b80cf27b546c8f56. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:55.235540 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 4544187adde94a72a2ceafc0bfea9a3e from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.236294 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ec26dd4258924c8782ffd4e56f7287ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.236409 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec26dd4258924c8782ffd4e56f7287ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.237326 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:55.237412 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 810a9e36713041b091f3db1f25e11eb3 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.237715 3099 master_service.cc:946] ReplaceTablet: received request to replace tablet d92890d082e242ccae8ad4e40d056c74 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.238197 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d081f0604980459e9f22074a2ff890d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:55.238245 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 4544187adde94a72a2ceafc0bfea9a3e
W20250115 10:11:55.238312 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d081f0604980459e9f22074a2ff890d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.238358 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 4544187adde94a72a2ceafc0bfea9a3e deleted and replaced by tablet c8669414df864d9b928718094e9eabe2
I20250115 10:11:55.238700 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 4544187adde94a72a2ceafc0bfea9a3e with delete_type TABLET_DATA_DELETED (replaced by tablet c8669414df864d9b928718094e9eabe2) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.238755 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet e3a4b1b801c84cbcae634a965be09734 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.238827 3907 tablet_replica.cc:331] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.238930 3907 raft_consensus.cc:2238] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.238994 3907 raft_consensus.cc:2267] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.239163 3907 ts_tablet_manager.cc:1905] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.239571 3098 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 810a9e36713041b091f3db1f25e11eb3
I20250115 10:11:55.239627 3098 catalog_manager.cc:6596] ReplaceTablet: tablet 810a9e36713041b091f3db1f25e11eb3 deleted and replaced by tablet ca8a8ff0a3714522b354522b0b96074d
I20250115 10:11:55.239818 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 810a9e36713041b091f3db1f25e11eb3 with delete_type TABLET_DATA_DELETED (replaced by tablet ca8a8ff0a3714522b354522b0b96074d) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.240195 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a22148793b424154ab220c631c66317d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.240283 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a22148793b424154ab220c631c66317d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.240626 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_55d46aebab454525a18158ba35b1b75d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.240710 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55d46aebab454525a18158ba35b1b75d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.240816 3099 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:11:55.240902 3099 catalog_manager.cc:6596] ReplaceTablet: tablet d92890d082e242ccae8ad4e40d056c74 deleted and replaced by tablet f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:11:55.241250 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet d92890d082e242ccae8ad4e40d056c74 with delete_type TABLET_DATA_DELETED (replaced by tablet f0ae1ff74cce48ada0a373f9e65508a2) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.241283 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:11:55.241348 3095 catalog_manager.cc:6596] ReplaceTablet: tablet e3a4b1b801c84cbcae634a965be09734 deleted and replaced by tablet 85c5bcb8f4cf44fcb160e2200b1abb7d
I20250115 10:11:55.241611 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet e3a4b1b801c84cbcae634a965be09734 with delete_type TABLET_DATA_DELETED (replaced by tablet 85c5bcb8f4cf44fcb160e2200b1abb7d) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.242787 3907 ts_tablet_manager.cc:1918] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.243009 3907 log.cc:1198] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4544187adde94a72a2ceafc0bfea9a3e
I20250115 10:11:55.243161 3093 master_service.cc:946] ReplaceTablet: received request to replace tablet e3a4b1b801c84cbcae634a965be09734 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.243410 3907 ts_tablet_manager.cc:1939] T 4544187adde94a72a2ceafc0bfea9a3e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
W20250115 10:11:55.243736 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 2096ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:55.243785 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4544187adde94a72a2ceafc0bfea9a3e (table default.Table_872267a210a543ebaa8dc83c22acf71a [id=37b88cda84214471b3d4f26ebdfb475e]) successfully deleted
I20250115 10:11:55.243731 3907 tablet_replica.cc:331] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.243885 3907 raft_consensus.cc:2238] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.243935 3907 raft_consensus.cc:2267] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.244027 3907 ts_tablet_manager.cc:1905] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.245397 3907 ts_tablet_manager.cc:1918] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.245452 3907 log.cc:1198] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/810a9e36713041b091f3db1f25e11eb3
I20250115 10:11:55.245617 3907 ts_tablet_manager.cc:1939] T 810a9e36713041b091f3db1f25e11eb3 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.245813 3907 tablet_replica.cc:331] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.245927 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 810a9e36713041b091f3db1f25e11eb3 (table default.Table_4be05c9961a84c11a43d04ac34471aaa [id=2e150748a33c4179afe9c8697cbb09c7]) successfully deleted
I20250115 10:11:55.246003 3907 raft_consensus.cc:2238] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.246047 3907 raft_consensus.cc:2267] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.246148 3907 ts_tablet_manager.cc:1905] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.247406 3907 ts_tablet_manager.cc:1918] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:11:55.247455 3907 log.cc:1198] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d92890d082e242ccae8ad4e40d056c74
I20250115 10:11:55.247645 3907 ts_tablet_manager.cc:1939] T d92890d082e242ccae8ad4e40d056c74 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.247874 3907 tablet_replica.cc:331] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.247920 3907 raft_consensus.cc:2238] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:11:55.247970 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d92890d082e242ccae8ad4e40d056c74 (table default.Table_eb212e1f015b43c3a7023e57a09fbfd2 [id=3db3bcbaa94a47539118a734db0455c6]) successfully deleted
I20250115 10:11:55.248015 3907 raft_consensus.cc:2267] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.248128 3907 ts_tablet_manager.cc:1905] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.249343 3907 ts_tablet_manager.cc:1918] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:11:55.249397 3907 log.cc:1198] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/e3a4b1b801c84cbcae634a965be09734
I20250115 10:11:55.249567 3907 ts_tablet_manager.cc:1939] T e3a4b1b801c84cbcae634a965be09734 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.249859 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet e3a4b1b801c84cbcae634a965be09734 (table default.Table_abc8b1a96d6a41f2815b44361e6282e3 [id=dc0b1482ff3849cebb7afb525dc04264]) successfully deleted
W20250115 10:11:55.278533 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 2096ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:55.289072 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:55.297430 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:55.303081 3671 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.303174 3671 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.303328 3671 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:55.303473 4204 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.303539 4204 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.303560 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:55.303632 3550 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:11:55.303653 3214 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:55.303681 4204 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.303851 3215 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.303923 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:55.303978 3278 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:55.304025 3671 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.304051 3671 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.304067 3671 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Advancing to term 2
W20250115 10:11:55.304100 3484 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:55.304152 3485 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:55.304247 4204 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.304281 4204 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.304299 4204 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:55.304737 3671 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.304836 3671 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:55.305096 3214 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:55.305148 4204 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.305277 4204 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.305383 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:55.305430 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:55.305464 3550 raft_consensus.cc:2388] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 2: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:11:55.305498 3278 raft_consensus.cc:2388] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 2: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
W20250115 10:11:55.305528 3484 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:55.305635 3215 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:55.305681 3485 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:11:55.305722 3671 raft_consensus.cc:2743] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250115 10:11:55.305761 4204 raft_consensus.cc:2743] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250115 10:11:55.389804 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_89c87df4c138469a8cd6fbb8fa6d4f9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.389981 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89c87df4c138469a8cd6fbb8fa6d4f9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.390287 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3a7d7e9d0cf041d099c8fa560ab0ec9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.390395 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a7d7e9d0cf041d099c8fa560ab0ec9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.390844 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f9fd1fe583ce4f6c80f6870c30058799"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.390945 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9fd1fe583ce4f6c80f6870c30058799 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.391633 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f469479d54a445cc94bea2d511828e08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.391865 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f469479d54a445cc94bea2d511828e08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.402949 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a22148793b424154ab220c631c66317d" } new_table_name: "default.Table_32fe7976c2104e32a60202ef8575296d" modify_external_catalogs: true
W20250115 10:11:55.404259 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 019b97a0fa694f15b8ca224fb86803d9 has no consensus state
I20250115 10:11:55.407986 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b9ad25d16685403d8de69c3dfdb86748" } modify_external_catalogs: true
I20250115 10:11:55.408075 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b9ad25d16685403d8de69c3dfdb86748" } modify_external_catalogs: true
I20250115 10:11:55.409301 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 75047d0351f044b6aad5232c5929851b
I20250115 10:11:55.412580 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bace75e77470498a937648cb959be30d" } new_table_name: "default.Table_ac48e7724b7944a4ba6f27c7fc05c06c" modify_external_catalogs: true
I20250115 10:11:55.413075 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_61e0493cda81477b901a05f9134a6e8c" } new_table_name: "default.Table_f449a8f3524e481f902f1c39e1853009" modify_external_catalogs: true
W20250115 10:11:55.413833 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d34f0713bda44fd9e50aab211e28256 has no consensus state
W20250115 10:11:55.414353 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce0ae8f06c6d41ddb3ba728df5f39e9b has no consensus state
I20250115 10:11:55.414666 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9dce4a3f55aa4f80a76c4d3e5b077511" } modify_external_catalogs: true
I20250115 10:11:55.414736 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9dce4a3f55aa4f80a76c4d3e5b077511" } modify_external_catalogs: true
I20250115 10:11:55.415699 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 23b23bcc62924816a1f6c50d0842624a
I20250115 10:11:55.416126 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55d46aebab454525a18158ba35b1b75d" } modify_external_catalogs: true
I20250115 10:11:55.416190 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55d46aebab454525a18158ba35b1b75d" } modify_external_catalogs: true
I20250115 10:11:55.416962 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 567d6491d6f04ba2820b1f045e54a4cd
I20250115 10:11:55.419327 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_eb212e1f015b43c3a7023e57a09fbfd2" } new_table_name: "default.Table_77de5a94d3fe42478dd6b0e8f1d03d26" modify_external_catalogs: true
W20250115 10:11:55.420207 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f0ae1ff74cce48ada0a373f9e65508a2 has no consensus state
I20250115 10:11:55.420521 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23e7e88673a94ca785689fe101f9af13" } new_table_name: "default.Table_d30b1decf7d240e78ab7e5df8a3f0bde" modify_external_catalogs: true
W20250115 10:11:55.421366 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cbd61aec79d479d9eea8d807cd5fb0e has no consensus state
I20250115 10:11:55.424849 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae01eda31eb145068476bf27e03186b8" } modify_external_catalogs: true
I20250115 10:11:55.424908 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae01eda31eb145068476bf27e03186b8" } modify_external_catalogs: true
I20250115 10:11:55.425887 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1427f64219234fa089bee5ed251f6122
I20250115 10:11:55.429420 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_689903396b5f4091a2df2cb00a826e64" } modify_external_catalogs: true
I20250115 10:11:55.429482 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_689903396b5f4091a2df2cb00a826e64" } modify_external_catalogs: true
I20250115 10:11:55.430294 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 87f86a046c7147e79e8c7941294fb904
I20250115 10:11:55.431205 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dbae35a417cc4aa2a56ef9d5dff969b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.431311 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbae35a417cc4aa2a56ef9d5dff969b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.435283 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_108893943cce4a42b22b197a7c89ba2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.435387 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_108893943cce4a42b22b197a7c89ba2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.441193 3095 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b1e5233cbfb4d438d1afc76ff530e67 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.441228 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_80ad9c67084544ecb851d7989a799632"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:55.441246 3098 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b1e5233cbfb4d438d1afc76ff530e67 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.441272 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8e37c720a42c436aa7fd389051d9c338"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.441339 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_80ad9c67084544ecb851d7989a799632 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.441356 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e37c720a42c436aa7fd389051d9c338 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.441994 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_974ae7442c2f4acf96b5d0cd0fa4c8c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.442122 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_974ae7442c2f4acf96b5d0cd0fa4c8c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.442518 3094 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b1e5233cbfb4d438d1afc76ff530e67 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.442535 3097 master_service.cc:946] ReplaceTablet: received request to replace tablet 6b1e5233cbfb4d438d1afc76ff530e67 from {username='slave'} at 127.0.0.1:46172
I20250115 10:11:55.442718 3095 catalog_manager.cc:5813] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Sending DeleteTablet for 3 replicas of tablet 6b1e5233cbfb4d438d1afc76ff530e67
I20250115 10:11:55.442801 3095 catalog_manager.cc:6596] ReplaceTablet: tablet 6b1e5233cbfb4d438d1afc76ff530e67 deleted and replaced by tablet 2e5b467e6de548e2ab948432ea71d1b0
I20250115 10:11:55.442721 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4793bac69ad14dfa954ebc28370ce88a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.442874 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4793bac69ad14dfa954ebc28370ce88a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.443059 3383 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b1e5233cbfb4d438d1afc76ff530e67 with delete_type TABLET_DATA_DELETED (replaced by tablet 2e5b467e6de548e2ab948432ea71d1b0) from {username='slave'} at 127.0.0.1:33874
I20250115 10:11:55.443161 3907 tablet_replica.cc:331] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:11:55.443221 3907 raft_consensus.cc:2238] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:11:55.443275 3907 raft_consensus.cc:2267] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:11:55.443383 3907 ts_tablet_manager.cc:1905] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:11:55.445155 3907 ts_tablet_manager.cc:1918] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:11:55.445220 3907 log.cc:1198] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6b1e5233cbfb4d438d1afc76ff530e67
I20250115 10:11:55.445428 3907 ts_tablet_manager.cc:1939] T 6b1e5233cbfb4d438d1afc76ff530e67 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:11:55.445722 3086 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6b1e5233cbfb4d438d1afc76ff530e67 (table default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0 [id=a701448b84194d148b91c6b19d549ccd]) successfully deleted
W20250115 10:11:55.455627 3214 consensus_peers.cc:487] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13abbfea00154474b1082cf8ccd14899. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:55.491771 3278 raft_consensus.cc:1270] T ec9406dc72bb4e489d76011a69ee2838 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250115 10:11:55.492188 3913 consensus_queue.cc:1035] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250115 10:11:55.493640 3484 consensus_peers.cc:487] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec9406dc72bb4e489d76011a69ee2838. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:55.493691 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:55.502691 3550 raft_consensus.cc:1270] T 13abbfea00154474b1082cf8ccd14899 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250115 10:11:55.502935 3671 consensus_queue.cc:1035] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:11:55.504069 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
W20250115 10:11:55.504972 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
W20250115 10:11:55.513860 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 2376ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:55.547035 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 2376ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:55.592011 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3a70c132bf104c3ea7d248cee177b033"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:55.592173 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_32ae9c8978b2495c93454b757401f5ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.592276 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a70c132bf104c3ea7d248cee177b033 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.592319 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ae9c8978b2495c93454b757401f5ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.592842 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_96122f453d0b4d97bb07478f596b0042"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.592963 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96122f453d0b4d97bb07478f596b0042 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.593336 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_44eb748a3296469183eeb590b8a4919b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.593451 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44eb748a3296469183eeb590b8a4919b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.603474 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:55.604807 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3189896cc7e5429db0ae1034257eb26a" } new_table_name: "default.Table_19fbbc203da54d48bb0b47a9a2218ae2" modify_external_catalogs: true
W20250115 10:11:55.605962 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3067eaaa090b4ffb95b2e741453113ed has no consensus state
I20250115 10:11:55.609870 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dbae35a417cc4aa2a56ef9d5dff969b1" } modify_external_catalogs: true
I20250115 10:11:55.609952 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dbae35a417cc4aa2a56ef9d5dff969b1" } modify_external_catalogs: true
I20250115 10:11:55.610862 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d110a42627fc4289b08cddc6dc06d64c
I20250115 10:11:55.614284 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bee935a490e8405b98608f6e8d58ef71" } new_table_name: "default.Table_f6e7a3df0f1c4c4d81d0bc3bb85da085" modify_external_catalogs: true
I20250115 10:11:55.614872 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ac48e7724b7944a4ba6f27c7fc05c06c" } new_table_name: "default.Table_db89a087dc0b4459a3eef1f701bf1871" modify_external_catalogs: true
W20250115 10:11:55.615299 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42233960ee47426ba6643c4bc92485d3 has no consensus state
I20250115 10:11:55.616148 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bb52c10df9e84061b57c9c01fc734ae2" } modify_external_catalogs: true
I20250115 10:11:55.616214 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bb52c10df9e84061b57c9c01fc734ae2" } modify_external_catalogs: true
W20250115 10:11:55.616307 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d34f0713bda44fd9e50aab211e28256 has no consensus state
I20250115 10:11:55.617035 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet cc670fbec60743b6ad45c1d4dcf5b62a
I20250115 10:11:55.617349 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_abc8b1a96d6a41f2815b44361e6282e3" } modify_external_catalogs: true
I20250115 10:11:55.617410 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_abc8b1a96d6a41f2815b44361e6282e3" } modify_external_catalogs: true
I20250115 10:11:55.618242 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 85c5bcb8f4cf44fcb160e2200b1abb7d
I20250115 10:11:55.620715 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_10653da144dc43448fbebcd5b9b2f01b" } new_table_name: "default.Table_b4d6ceddf1dc4d62939e7b4fa6c6569c" modify_external_catalogs: true
W20250115 10:11:55.621623 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77f7c04c379847e598266b2c129de56e has no consensus state
I20250115 10:11:55.621843 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ba72dc1b666649d385a4e775ffa69817" } new_table_name: "default.Table_5f7ceb9b336f4b03abef1270df320ad7" modify_external_catalogs: true
W20250115 10:11:55.622817 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
I20250115 10:11:55.626364 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5409b8f4469d4f13ac7ae25112aa791d" } modify_external_catalogs: true
I20250115 10:11:55.626420 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5409b8f4469d4f13ac7ae25112aa791d" } modify_external_catalogs: true
I20250115 10:11:55.627388 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7bcd1257c1814f16984d3e0fa1c082fd
I20250115 10:11:55.630872 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a28027b28709434bb21379078b64d25f" } modify_external_catalogs: true
I20250115 10:11:55.630937 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a28027b28709434bb21379078b64d25f" } modify_external_catalogs: true
W20250115 10:11:55.631376 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:55.631961 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1e1b6769bd2f455a9778ad0910a9236d
I20250115 10:11:55.632547 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fe31529eb55e4597805728d7b7396d91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.632665 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe31529eb55e4597805728d7b7396d91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.636759 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1d0d942e3e2f49a49939ccc65b747c1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.636862 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d0d942e3e2f49a49939ccc65b747c1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.646210 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c66e9ac2d8324d6283feb3be273cf4cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:55.646203 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_16f98b9c0db64e58aafb86f0ebad1812"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.646394 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c66e9ac2d8324d6283feb3be273cf4cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.646416 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16f98b9c0db64e58aafb86f0ebad1812 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.646788 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8f6f68b7ceac410e8481f50a0a777d91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.646895 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f6f68b7ceac410e8481f50a0a777d91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.647217 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d279109ca32b4ec797ef5aece00a1f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.647305 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d279109ca32b4ec797ef5aece00a1f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.648753 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:55.656558 3085 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 55fe5ef291454df2a788197943225250 (table default.Table_60d7145e17bd4e908bd70c3302f2ae5e [id=1958431b6dfa48b8b911a6bb9aaf2c96], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 55fe5ef291454df2a788197943225250 consensus state has no leader
W20250115 10:11:55.688050 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:55.695317 3952 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.695436 3952 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.695449 3913 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.695528 3913 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.695588 3952 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:55.695674 3913 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.695904 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:55.695994 3278 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:11:55.696046 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:11:55.696097 3214 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:55.696126 3550 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:11:55.696223 3485 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:11:55.696269 3215 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:11:55.696302 3484 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:55.696357 3952 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.696393 3952 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.696414 3952 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:55.696512 3913 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:55.696550 3913 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:55.696573 3913 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:55.697132 3952 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.697139 3913 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:55.697235 3913 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:55.697244 3952 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:55.697422 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:55.697422 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:55.697502 3278 raft_consensus.cc:2388] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 2: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:11:55.697492 3550 raft_consensus.cc:2388] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 2: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
W20250115 10:11:55.697527 3214 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
W20250115 10:11:55.697602 3484 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:55.697649 3215 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:11:55.697676 3485 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:11:55.697727 3952 raft_consensus.cc:2743] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250115 10:11:55.697738 3913 raft_consensus.cc:2743] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20250115 10:11:55.723529 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:55.763134 3214 consensus_peers.cc:487] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d92890d082e242ccae8ad4e40d056c74. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:55.783018 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 2644ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:55.794579 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b03f1f7a38ee41dd8506a05ff61ca597"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.794776 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b03f1f7a38ee41dd8506a05ff61ca597 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.795089 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_79ef70b78772441ebb9b7d7a95cee039"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.795228 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79ef70b78772441ebb9b7d7a95cee039 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.795397 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2791f2be6d364e369143f4218d0b35ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.795481 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2791f2be6d364e369143f4218d0b35ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.795804 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7bd531cb07274a8982b5b10b415a60b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.795897 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bd531cb07274a8982b5b10b415a60b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.806413 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5f7ceb9b336f4b03abef1270df320ad7" } new_table_name: "default.Table_4953064fe0844357b7ac8afa74afe19c" modify_external_catalogs: true
W20250115 10:11:55.807454 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
I20250115 10:11:55.807619 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--webserver_interface=127.2.217.189
--webserver_port=38131
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250115 10:11:55.811350 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a" } modify_external_catalogs: true
I20250115 10:11:55.811439 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a" } modify_external_catalogs: true
I20250115 10:11:55.812552 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6aa81e05a22e46bf94b378605a889eee
I20250115 10:11:55.815848 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4c8b7687d6614ea18a5377539659492c" } new_table_name: "default.Table_b557d077a5384524b12ab5de762c3aea" modify_external_catalogs: true
I20250115 10:11:55.816677 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_573f2705b53148d88d787b2b78ccec20" } new_table_name: "default.Table_3eba608bc2eb4f5383a5b60252200056" modify_external_catalogs: true
W20250115 10:11:55.817298 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74ab86571c3a469da7a51cf6033c5b10 has no consensus state
W20250115 10:11:55.817934 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1004bde821054bb7bf1dea64081c0df1 has no consensus state
W20250115 10:11:55.818066 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 2644ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:55.818214 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f6e7a3df0f1c4c4d81d0bc3bb85da085" } modify_external_catalogs: true
I20250115 10:11:55.818269 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f6e7a3df0f1c4c4d81d0bc3bb85da085" } modify_external_catalogs: true
I20250115 10:11:55.818715 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7934a48400e540d0ba53a1b658524d29" } modify_external_catalogs: true
I20250115 10:11:55.818775 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7934a48400e540d0ba53a1b658524d29" } modify_external_catalogs: true
I20250115 10:11:55.819314 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 42233960ee47426ba6643c4bc92485d3
I20250115 10:11:55.819998 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet be951f6f1433483fac65d642357b7640
I20250115 10:11:55.822422 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b20fc5398a9749d7b7d4eaf138f98d33" } new_table_name: "default.Table_d8a443adc4734eeba18246236e9852f1" modify_external_catalogs: true
W20250115 10:11:55.822487 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:55.823357 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_169fbca95f7b47bf85ce6d990f545da2" } new_table_name: "default.Table_9c6387abf6594f90a0d300f9e8decf73" modify_external_catalogs: true
W20250115 10:11:55.823397 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6c7eb34e4f784320a987ad8ae32023e2 has no consensus state
W20250115 10:11:55.824335 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98993cb75de34c0babb894a5d17d6d12 has no consensus state
I20250115 10:11:55.827894 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_974ae7442c2f4acf96b5d0cd0fa4c8c2" } modify_external_catalogs: true
I20250115 10:11:55.827950 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_974ae7442c2f4acf96b5d0cd0fa4c8c2" } modify_external_catalogs: true
I20250115 10:11:55.828760 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3f181b744c4545f6a42c76fda07890e5
I20250115 10:11:55.832358 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc259fc343564cada5bc183e3a1781b0" } modify_external_catalogs: true
I20250115 10:11:55.832414 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc259fc343564cada5bc183e3a1781b0" } modify_external_catalogs: true
I20250115 10:11:55.833184 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6de00635c3b341c3a23b2296e3993325
I20250115 10:11:55.834096 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c7761c701ee244598dd7a3c9b8452163"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.834199 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7761c701ee244598dd7a3c9b8452163 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.838269 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f0a38195df2c4d73b3c6013fe636c14f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.838379 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0a38195df2c4d73b3c6013fe636c14f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.847958 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c97db29d95d248cebdd023d1400d4dab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.848078 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c97db29d95d248cebdd023d1400d4dab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.849017 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f01ac3f0973a4af1be9dbb48e5f7af90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.849123 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.852326 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_81b828ac71704ee6b6027b6b97e42a28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.852434 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81b828ac71704ee6b6027b6b97e42a28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.852372 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d90dfaad7fe042bc9ee4158afab6b64e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.852505 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90dfaad7fe042bc9ee4158afab6b64e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:55.902024 4222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:55.902261 4222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:55.902287 4222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:55.904222 4222 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:55.904276 4222 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:55.904294 4222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:55.904312 4222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:55.904340 4222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:55.904353 4222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:55.906505 4222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.217.189
--webserver_port=38131
--never_fsync=true
--heap_profile_path=/tmp/kudu.4222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:55.906725 4222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:55.906971 4222 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:55.911492 4227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:55.912313 4230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:55.913165 4228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:55.913937 4222 server_base.cc:1034] running on GCE node
I20250115 10:11:55.914160 4222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:55.914397 4222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:55.915541 4222 hybrid_clock.cc:648] HybridClock initialized: now 1736935915915522 us; error 39 us; skew 500 ppm
W20250115 10:11:55.918283 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:55.921082 4222 webserver.cc:458] Webserver started at http://127.2.217.189:38131/ using document root <none> and password file <none>
I20250115 10:11:55.921303 4222 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:55.921361 4222 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:55.922641 4222 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20250115 10:11:55.923331 4236 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:55.923530 4222 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20250115 10:11:55.923609 4222 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:55.923979 4222 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:55.951937 4222 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:55.952248 4222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:55.952351 4222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:55.956588 4222 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.189:36717
I20250115 10:11:55.956729 4288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.189:36717 every 8 connection(s)
I20250115 10:11:55.956990 4222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
I20250115 10:11:55.958839 4289 sys_catalog.cc:263] Verifying existing consensus state
I20250115 10:11:55.959746 4289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap starting.
I20250115 10:11:55.962607 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 4222
I20250115 10:11:55.964373 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
W20250115 10:11:55.964740 2944 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01285bc3401243e9bcbba5062c80dbfa consensus state has no leader
I20250115 10:11:55.964744 4289 log.cc:826] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:55.976722 4289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=119 ignored=0} mutations{seen=271 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250115 10:11:55.977049 4289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap complete.
I20250115 10:11:55.978456 4289 raft_consensus.cc:357] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:55.978641 4289 raft_consensus.cc:738] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4346420bb4a5abb9cf66799e35565, State: Initialized, Role: FOLLOWER
I20250115 10:11:55.978742 4289 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 2.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:55.979024 4289 sys_catalog.cc:564] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:11:55.979000 4295 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:55.979091 4295 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:55.981242 4306 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:55.981287 4306 catalog_manager.cc:1553] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: success
I20250115 10:11:55.982497 4306 catalog_manager.cc:1575] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: acquiring CA information for follower catalog manager: success
I20250115 10:11:55.982837 4306 catalog_manager.cc:1603] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:11:55.997004 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cbd83e1c807149529f12c7b6ea4eec85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.997184 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cbd83e1c807149529f12c7b6ea4eec85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.997781 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_854274990cc14e9ab02633f53d2bb6ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.997900 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_854274990cc14e9ab02633f53d2bb6ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.998293 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_91f4ffdc0efd4587b025644c701f6b47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.998394 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91f4ffdc0efd4587b025644c701f6b47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:55.998654 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_55b0243539814cb48095741bb5d86056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:55.998739 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55b0243539814cb48095741bb5d86056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.005896 4253 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" instance_seqno: 1736935911647047) as {username='slave'} at 127.2.217.131:33731; Asking this server to re-register.
I20250115 10:11:56.006217 3598 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:56.006677 4253 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:56.009747 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9cdf22ad1fd140bb9a95640f58137d75" } new_table_name: "default.Table_dcaf2cae44ef4777b367f971eccdf5eb" modify_external_catalogs: true
W20250115 10:11:56.010849 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 65f21a7bcfaa4d7595b7167e90b47798 has no consensus state
I20250115 10:11:56.012972 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1d0d942e3e2f49a49939ccc65b747c1d" } modify_external_catalogs: true
I20250115 10:11:56.013043 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1d0d942e3e2f49a49939ccc65b747c1d" } modify_external_catalogs: true
I20250115 10:11:56.013851 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 62fe9014874e4b74a8d6dbbdb5d8e986
I20250115 10:11:56.018163 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4953064fe0844357b7ac8afa74afe19c" } new_table_name: "default.Table_d00b04a7da1540caa3b2074459474ca2" modify_external_catalogs: true
I20250115 10:11:56.018371 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_83d77cc8caf74364af556dd677bd3f5c" } new_table_name: "default.Table_baeafb45d03c45fd93c0ea0aaf236706" modify_external_catalogs: true
I20250115 10:11:56.019752 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc2bfee41b1b4f279f6de7495e23b0e3" } modify_external_catalogs: true
I20250115 10:11:56.019809 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dc2bfee41b1b4f279f6de7495e23b0e3" } modify_external_catalogs: true
I20250115 10:11:56.020390 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0" } modify_external_catalogs: true
I20250115 10:11:56.020445 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_efc80cfb620e4c23a3f6051ecfc1e5d0" } modify_external_catalogs: true
I20250115 10:11:56.024042 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0a77ba1a857147ecb9912f9a795ff2ca" } new_table_name: "default.Table_01e9df5e66074b8bb9e23a059fa1b834" modify_external_catalogs: true
W20250115 10:11:56.024236 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 79acd5d799ab4b6f973f6c3d6b27df62 has no consensus state
I20250115 10:11:56.024838 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f9fcbeb2c7e34f4385cfebba458a7fc1" } new_table_name: "default.Table_1d45a7ee69474266972a1eb0633f12e7" modify_external_catalogs: true
W20250115 10:11:56.025104 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 has no consensus state
I20250115 10:11:56.025141 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9ddfe61dc3954ec9b758c01c7981669c
I20250115 10:11:56.025139 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 2e5b467e6de548e2ab948432ea71d1b0
W20250115 10:11:56.026080 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b1ba7c80c4404b8fed7df709f0aba2 has no consensus state
W20250115 10:11:56.026800 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e68046a1dd1342a6952bc73066144789 has no consensus state
I20250115 10:11:56.029192 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b03f1f7a38ee41dd8506a05ff61ca597" } modify_external_catalogs: true
I20250115 10:11:56.029256 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b03f1f7a38ee41dd8506a05ff61ca597" } modify_external_catalogs: true
I20250115 10:11:56.030107 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b8de7a5d265242518255e230785f23cb
I20250115 10:11:56.033663 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23eba6daaad24569b9a412f1b789c6f2" } modify_external_catalogs: true
I20250115 10:11:56.033720 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23eba6daaad24569b9a412f1b789c6f2" } modify_external_catalogs: true
I20250115 10:11:56.034781 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6433d51732d94906b431b1b77c148e50
I20250115 10:11:56.035533 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_56c4b6bb1aed4dfebd4846c86da6fecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.035645 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56c4b6bb1aed4dfebd4846c86da6fecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.039930 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ce1d0c2c57e64929b1c5bb4d6fbcc4d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.040037 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce1d0c2c57e64929b1c5bb4d6fbcc4d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.049602 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bd4ba0bc27d94635b73ae80ea5572cec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.049749 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd4ba0bc27d94635b73ae80ea5572cec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.050626 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_37e85cc42de44c9ea1e9d33a94d70be8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.050733 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37e85cc42de44c9ea1e9d33a94d70be8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.052031 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 2915ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:56.053622 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_499253a68cca4fe6aa6a7781913b360d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.053726 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_499253a68cca4fe6aa6a7781913b360d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.054399 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0fbc9444d77d4b9d9958f5705235c722"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.054504 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fbc9444d77d4b9d9958f5705235c722 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.082584 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 2915ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:56.099066 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:56.124012 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:56.133702 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:56.134243 4253 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" instance_seqno: 1736935911435877) as {username='slave'} at 127.2.217.129:41355; Asking this server to re-register.
I20250115 10:11:56.134474 3328 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:56.134809 4253 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:11:56.167171 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:56.171126 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:56.199992 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4997ef139ec249aa9dc295bb230fde29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.200167 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4997ef139ec249aa9dc295bb230fde29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.200997 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f1faf951819049d9aac897e67c029beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:56.200997 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3baa707f8303433bb3b5a22f948807a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.201125 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1faf951819049d9aac897e67c029beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.201175 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3baa707f8303433bb3b5a22f948807a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.201282 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_43430be7674b4d00b216d254e6ba8adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.201349 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43430be7674b4d00b216d254e6ba8adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.203028 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:56.203311 4253 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" instance_seqno: 1736935911544757) as {username='slave'} at 127.2.217.130:55263; Asking this server to re-register.
I20250115 10:11:56.203495 3463 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:56.203784 4253 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:56.211380 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6f7c58e7d0434d6d8d354e484fcc305a" } new_table_name: "default.Table_cfcc820f912946a597a93d391a57bdca" modify_external_catalogs: true
W20250115 10:11:56.212559 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc4ed27a7c1a49eea8f85763d8c86343 has no consensus state
I20250115 10:11:56.214241 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_99ac5e2499df4cfcb4df671bfb26dae3" } modify_external_catalogs: true
I20250115 10:11:56.214301 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_99ac5e2499df4cfcb4df671bfb26dae3" } modify_external_catalogs: true
I20250115 10:11:56.215165 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3b2ea3412bfc45649d5c64c5eddfa7b8
I20250115 10:11:56.224829 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_91f4ffdc0efd4587b025644c701f6b47" } new_table_name: "default.Table_4dd032a6e5bd4cfea08bb2dd20592783" modify_external_catalogs: true
I20250115 10:11:56.225636 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_75d120304444407fbdf0d47be806d5a2" } new_table_name: "default.Table_90cb23f01fbf4659a78c39bfcf398688" modify_external_catalogs: true
I20250115 10:11:56.225641 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a8330e16cd364cb7b71f213ba72a3055" } modify_external_catalogs: true
I20250115 10:11:56.225780 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a8330e16cd364cb7b71f213ba72a3055" } modify_external_catalogs: true
W20250115 10:11:56.225934 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a612decf0634bd588f45c8953c6b201 has no consensus state
I20250115 10:11:56.225662 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_825eb71d554c438a838c20ea963ee429" } modify_external_catalogs: true
I20250115 10:11:56.226002 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_825eb71d554c438a838c20ea963ee429" } modify_external_catalogs: true
I20250115 10:11:56.226529 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ec26dd4258924c8782ffd4e56f7287ac" } new_table_name: "default.Table_ba48c200fcf543a7bb4412fef7ee0393" modify_external_catalogs: true
I20250115 10:11:56.227097 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ec5c91a6b65a4da19752290a1c0fb1dd
I20250115 10:11:56.227114 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 45f1f387e964451690818d7c7dd61afc
I20250115 10:11:56.227406 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_56c4b6bb1aed4dfebd4846c86da6fecd" } new_table_name: "default.Table_5a71cd3e794b49b0b210dcdd074c1758" modify_external_catalogs: true
W20250115 10:11:56.227700 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
W20250115 10:11:56.227769 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bdc4e4d12dbc4e5aa240d9daab4afb1b has no consensus state
W20250115 10:11:56.228628 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ca9e092b72348c8b903668b9402d8ea has no consensus state
I20250115 10:11:56.230532 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f9fd1fe583ce4f6c80f6870c30058799" } modify_external_catalogs: true
I20250115 10:11:56.230593 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f9fd1fe583ce4f6c80f6870c30058799" } modify_external_catalogs: true
I20250115 10:11:56.231377 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b12578afd61a44d0997c920b522ab2dd
I20250115 10:11:56.235250 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2ffae4a75d354cafb3a707f8931c47e3" } modify_external_catalogs: true
I20250115 10:11:56.235316 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2ffae4a75d354cafb3a707f8931c47e3" } modify_external_catalogs: true
I20250115 10:11:56.236160 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 35bea3ba1af44df5a114ec883b71d147
I20250115 10:11:56.237126 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae7b3f2b0d504f1287ca3242c5eac7b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.237234 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae7b3f2b0d504f1287ca3242c5eac7b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.241608 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_27ce6fc9ef424ed19dc7d1c2a8eb4ac8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.241698 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27ce6fc9ef424ed19dc7d1c2a8eb4ac8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.246165 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:56.251657 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_335f33157e694a15a82c2f61adb5c44f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.251811 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_335f33157e694a15a82c2f61adb5c44f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.252305 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7fec90af67294d50a5c39c5e793002e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.252420 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fec90af67294d50a5c39c5e793002e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.255610 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6bf1b753120b4945929a94625d231802"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.255736 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bf1b753120b4945929a94625d231802 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.256199 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c1e5c64b4d8a48a3b35b3f634fc215a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.256291 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1e5c64b4d8a48a3b35b3f634fc215a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.297168 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:56.316186 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 3180ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:56.346493 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 3180ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:56.353716 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:56.369446 4295 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:56.369580 4295 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:56.369935 4295 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:56.370157 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:56.370229 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:11:56.370564 4237 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:11:56.370692 4295 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:11:56.402756 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_743c538223aa4516a8e82bb75a2084f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.402952 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_743c538223aa4516a8e82bb75a2084f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.403142 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.403259 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.403365 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae0fa7c0e1b541e9b56ba0544b4d8248"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.403473 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae0fa7c0e1b541e9b56ba0544b4d8248 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.403155 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c8398fe16628401fb6518b9a151068ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.403729 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8398fe16628401fb6518b9a151068ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.412981 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1f8e0f310ee640599a19221d83cd10ce" } new_table_name: "default.Table_f88201a74ad64dc199ea16b7fe8191c5" modify_external_catalogs: true
W20250115 10:11:56.413990 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 760d8c8b77b84a54ae2f127cd451dc8b has no consensus state
I20250115 10:11:56.415634 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d00b04a7da1540caa3b2074459474ca2" } modify_external_catalogs: true
I20250115 10:11:56.415704 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d00b04a7da1540caa3b2074459474ca2" } modify_external_catalogs: true
I20250115 10:11:56.416810 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 79acd5d799ab4b6f973f6c3d6b27df62
I20250115 10:11:56.426438 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8e37c720a42c436aa7fd389051d9c338" } new_table_name: "default.Table_e768f4ab509d4299ae41b1a01abc72c6" modify_external_catalogs: true
W20250115 10:11:56.427632 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f642fec8d6c475f8c373bdc18d5db57 has no consensus state
I20250115 10:11:56.427683 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f449a8f3524e481f902f1c39e1853009" } modify_external_catalogs: true
I20250115 10:11:56.427753 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f88201a74ad64dc199ea16b7fe8191c5" } modify_external_catalogs: true
I20250115 10:11:56.427798 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f449a8f3524e481f902f1c39e1853009" } modify_external_catalogs: true
I20250115 10:11:56.427832 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f88201a74ad64dc199ea16b7fe8191c5" } modify_external_catalogs: true
I20250115 10:11:56.428254 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_efa7b12b5d2e4166886cf0a5e91a19af" } new_table_name: "default.Table_4934e0f208094cda89f3b37b7776022c" modify_external_catalogs: true
I20250115 10:11:56.428325 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_27ce6fc9ef424ed19dc7d1c2a8eb4ac8" } new_table_name: "default.Table_0556f36b9bc7462fadcbdbd50479b0db" modify_external_catalogs: true
I20250115 10:11:56.429102 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ce0ae8f06c6d41ddb3ba728df5f39e9b
I20250115 10:11:56.429337 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d30b1decf7d240e78ab7e5df8a3f0bde" } new_table_name: "default.Table_8f636b61c041459f8b1d47dd360e2047" modify_external_catalogs: true
I20250115 10:11:56.429648 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 760d8c8b77b84a54ae2f127cd451dc8b
W20250115 10:11:56.429688 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b251ef905b74375bd9b387cc8b057c0 has no consensus state
W20250115 10:11:56.430244 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21d5a121a87648ecbb842f52bc361602 has no consensus state
W20250115 10:11:56.430675 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cbd61aec79d479d9eea8d807cd5fb0e has no consensus state
I20250115 10:11:56.431809 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dcaf2cae44ef4777b367f971eccdf5eb" } modify_external_catalogs: true
I20250115 10:11:56.431875 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dcaf2cae44ef4777b367f971eccdf5eb" } modify_external_catalogs: true
I20250115 10:11:56.432663 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 65f21a7bcfaa4d7595b7167e90b47798
I20250115 10:11:56.436558 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_274f2c90e963429b86dccdee57f9d24c" } modify_external_catalogs: true
I20250115 10:11:56.436618 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_274f2c90e963429b86dccdee57f9d24c" } modify_external_catalogs: true
I20250115 10:11:56.438459 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ca7bc6e893be4465b1582ee64173500c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.438577 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca7bc6e893be4465b1582ee64173500c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.439759 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet f667a2bc66ca4ed5a186e657425ba599
I20250115 10:11:56.443032 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_722e957d50ab4d00ad9006fe1d6aedc3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.443182 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_722e957d50ab4d00ad9006fe1d6aedc3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.453459 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3bab9ede8058473fab1a422783ac27e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.453588 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3bab9ede8058473fab1a422783ac27e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.454010 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_feb191c576de4057bebe14fb5195169a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.454102 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_feb191c576de4057bebe14fb5195169a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.457113 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1abb68b92d9b4710b27957fd59761c10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.457209 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1abb68b92d9b4710b27957fd59761c10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.457747 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7349ef3c502f4bb8b7ad28613c71062c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.457854 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7349ef3c502f4bb8b7ad28613c71062c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.524433 4203 raft_consensus.cc:491] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:56.524536 4203 raft_consensus.cc:513] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:56.524717 4203 leader_election.cc:290] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:11:56.524924 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:11:56.525038 3484 leader_election.cc:343] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734
I20250115 10:11:56.525195 3485 leader_election.cc:304] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:11:56.525295 4203 raft_consensus.cc:2743] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250115 10:11:56.575188 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:56.580614 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 3444ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:56.601975 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:56.604867 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9850141450e74fef9cc091c2a653f27c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.605044 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9850141450e74fef9cc091c2a653f27c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.605667 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e8462eb21c7d488ea177321eec4aa13e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:56.605695 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_917623c2758441459e6b366741de339e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.605790 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8462eb21c7d488ea177321eec4aa13e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.605953 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e337908b6f1f4c98a2d71f4c29fdd6db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.606014 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e337908b6f1f4c98a2d71f4c29fdd6db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.605810 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_917623c2758441459e6b366741de339e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.614450 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9850141450e74fef9cc091c2a653f27c" } new_table_name: "default.Table_4f01791bcbd34a10bc736ecbd706f53d" modify_external_catalogs: true
W20250115 10:11:56.616086 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b573af4521064addb5bf2da9c70a79f0 has no consensus state
W20250115 10:11:56.617045 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 3444ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:56.617272 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e10318102c942b19dec451845d599a0" } modify_external_catalogs: true
I20250115 10:11:56.617331 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e10318102c942b19dec451845d599a0" } modify_external_catalogs: true
I20250115 10:11:56.618283 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9ab538d4f85a4c479d2b53fb138fef69
I20250115 10:11:56.628458 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae0fa7c0e1b541e9b56ba0544b4d8248" } new_table_name: "default.Table_7a1fc386365c4c0ea845267b8d7b9f1e" modify_external_catalogs: true
W20250115 10:11:56.629528 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f22384ad80814232aa76e3a2e5ab7357 has no consensus state
I20250115 10:11:56.629494 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c7761c701ee244598dd7a3c9b8452163" } modify_external_catalogs: true
I20250115 10:11:56.629581 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c7761c701ee244598dd7a3c9b8452163" } modify_external_catalogs: true
I20250115 10:11:56.630120 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_89c87df4c138469a8cd6fbb8fa6d4f9b" } new_table_name: "default.Table_4b999e9c3d3a46ba9caac1d215026666" modify_external_catalogs: true
I20250115 10:11:56.630230 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1c0467e6e03448a49b56a73c0a4b8459" } modify_external_catalogs: true
I20250115 10:11:56.630271 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1c0467e6e03448a49b56a73c0a4b8459" } modify_external_catalogs: true
I20250115 10:11:56.630497 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e5e5a9abb97146fe9729a31b3539334a
I20250115 10:11:56.630724 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_feb191c576de4057bebe14fb5195169a" } new_table_name: "default.Table_91cb2ed42f4043e6a89cc61f53f5d6c8" modify_external_catalogs: true
W20250115 10:11:56.631042 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3e3f1c43edf14ae69ca489d5566c8fda has no consensus state
I20250115 10:11:56.631124 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c8398fe16628401fb6518b9a151068ac" } new_table_name: "default.Table_3b64b710933d4f06ab796e107db177c0" modify_external_catalogs: true
I20250115 10:11:56.631561 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet a996b5dfef0d49009f2a92a5981f58cb
W20250115 10:11:56.632031 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ee7ca135ce3439e990c94c7c93fe0e0 has no consensus state
W20250115 10:11:56.632061 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af48bf64e2ca4a3197805c75fb0a12a6 has no consensus state
I20250115 10:11:56.633138 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c1e5c64b4d8a48a3b35b3f634fc215a0" } modify_external_catalogs: true
I20250115 10:11:56.633199 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c1e5c64b4d8a48a3b35b3f634fc215a0" } modify_external_catalogs: true
I20250115 10:11:56.634023 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet fb314f3efcda4336a2116087a399c5e4
I20250115 10:11:56.640312 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7a1fc386365c4c0ea845267b8d7b9f1e" } modify_external_catalogs: true
I20250115 10:11:56.640372 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7a1fc386365c4c0ea845267b8d7b9f1e" } modify_external_catalogs: true
I20250115 10:11:56.641085 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a883df24d37b447baa84acc5f6c62d45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.641211 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a883df24d37b447baa84acc5f6c62d45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.641367 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet f22384ad80814232aa76e3a2e5ab7357
I20250115 10:11:56.644549 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b854510e625043a7b89fa31b5d30acfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.644683 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b854510e625043a7b89fa31b5d30acfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.655078 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ad5d7519568b4d63ac065be986a631d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.655206 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad5d7519568b4d63ac065be986a631d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.655496 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_54476b841c2e4f53a2cdd390edb40b1c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.655615 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54476b841c2e4f53a2cdd390edb40b1c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.657120 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 6ee7ca135ce3439e990c94c7c93fe0e0 (table default.Table_91cb2ed42f4043e6a89cc61f53f5d6c8 [id=a530bf411665485b99d0921d0ab208af], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6ee7ca135ce3439e990c94c7c93fe0e0 has no consensus state
I20250115 10:11:56.658586 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4c4f267ca02940d58bc4543ec80f03ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.658665 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c4f267ca02940d58bc4543ec80f03ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.659572 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f6a790f7709f440d98f1567067ed68a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.659663 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6a790f7709f440d98f1567067ed68a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.671882 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:56.672472 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:56.672518 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:56.672534 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:56.672550 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:56.672565 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:11:56.672600 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:11:56.672647 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:56.672670 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:56.691286 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:56.699466 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:56.712960 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:56.728165 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:56.734625 3770 raft_consensus.cc:491] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:56.734768 3770 raft_consensus.cc:513] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:56.734939 3770 leader_election.cc:290] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:56.735117 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:56.735219 3550 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:11:56.735245 3214 leader_election.cc:343] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734
I20250115 10:11:56.735404 3215 leader_election.cc:304] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:56.735507 3770 raft_consensus.cc:2798] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250115 10:11:56.735548 3770 raft_consensus.cc:491] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25d7e460cb6d4ddabf387dc672cc26b3)
I20250115 10:11:56.735570 3770 raft_consensus.cc:3054] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Advancing to term 2
I20250115 10:11:56.736285 3770 raft_consensus.cc:513] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:11:56.736393 3770 leader_election.cc:290] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:56.736521 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3a4b1b801c84cbcae634a965be09734" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:56.736608 3550 raft_consensus.cc:3054] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Advancing to term 2
W20250115 10:11:56.736632 3214 leader_election.cc:343] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734
I20250115 10:11:56.737321 3550 raft_consensus.cc:2463] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 2.
I20250115 10:11:56.737498 3215 leader_election.cc:304] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:56.737596 3770 raft_consensus.cc:2798] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader election won for term 2
I20250115 10:11:56.737643 3770 raft_consensus.cc:695] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:56.737681 3770 consensus_queue.cc:237] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:11:56.764956 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:11:56.807082 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ded364210b934ba3a4824b517b6db826"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.807224 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ded364210b934ba3a4824b517b6db826 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.808197 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9557727fc0e5449ba95961d750b88bc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:56.808211 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e61dea524fce42cf9bc44855a823c5ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.808333 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9557727fc0e5449ba95961d750b88bc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.808355 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e61dea524fce42cf9bc44855a823c5ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.808863 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9f272c4f7f1644148c0f3c36075a3dde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.808954 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f272c4f7f1644148c0f3c36075a3dde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.816552 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4934e0f208094cda89f3b37b7776022c" } new_table_name: "default.Table_9205aa0658d14400a8be6a6ea6b304a4" modify_external_catalogs: true
W20250115 10:11:56.817437 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b251ef905b74375bd9b387cc8b057c0 has no consensus state
I20250115 10:11:56.818708 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9f272c4f7f1644148c0f3c36075a3dde" } modify_external_catalogs: true
I20250115 10:11:56.818763 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9f272c4f7f1644148c0f3c36075a3dde" } modify_external_catalogs: true
I20250115 10:11:56.819671 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 618be5ad4a704a25a5f2009571cbce5a
I20250115 10:11:56.830232 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2791f2be6d364e369143f4218d0b35ac" } new_table_name: "default.Table_f7a186c0c3b940c4bfc3c36f117ee45b" modify_external_catalogs: true
I20250115 10:11:56.830912 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c66e9ac2d8324d6283feb3be273cf4cb" } modify_external_catalogs: true
I20250115 10:11:56.830981 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c66e9ac2d8324d6283feb3be273cf4cb" } modify_external_catalogs: true
W20250115 10:11:56.831223 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b0430b0c5a64e2dae132cd724e62d3c has no consensus state
I20250115 10:11:56.831506 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_baeafb45d03c45fd93c0ea0aaf236706" } new_table_name: "default.Table_b44858d62c7c446d8bf598ff1aa20ca6" modify_external_catalogs: true
I20250115 10:11:56.831979 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a5d8b41b93964d2b9fad544c7e28d0e6" } modify_external_catalogs: true
I20250115 10:11:56.832033 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a5d8b41b93964d2b9fad544c7e28d0e6" } modify_external_catalogs: true
I20250115 10:11:56.832393 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7bd531cb07274a8982b5b10b415a60b5" } new_table_name: "default.Table_c10c8969492641c3a4d4690310a93c6a" modify_external_catalogs: true
I20250115 10:11:56.832548 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_32fe7976c2104e32a60202ef8575296d" } new_table_name: "default.Table_f64ce56d7cb34a788274a8c962ac01d7" modify_external_catalogs: true
I20250115 10:11:56.832630 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 36cd72847086406487c3745eadd953a1
I20250115 10:11:56.833297 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8235b2bc61764525a0e66f24ad4cefbd
W20250115 10:11:56.833305 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 has no consensus state
W20250115 10:11:56.834034 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 019b97a0fa694f15b8ca224fb86803d9 has no consensus state
W20250115 10:11:56.834102 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 311d7b6598854a36ac098a1b23fcf353 has no consensus state
I20250115 10:11:56.834431 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d279109ca32b4ec797ef5aece00a1f80" } modify_external_catalogs: true
I20250115 10:11:56.834496 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d279109ca32b4ec797ef5aece00a1f80" } modify_external_catalogs: true
I20250115 10:11:56.835351 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet a993db9d297d4c42b2ce679fc3e450c3
I20250115 10:11:56.841811 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4b999e9c3d3a46ba9caac1d215026666" } modify_external_catalogs: true
I20250115 10:11:56.841881 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4b999e9c3d3a46ba9caac1d215026666" } modify_external_catalogs: true
I20250115 10:11:56.842777 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3e3f1c43edf14ae69ca489d5566c8fda
I20250115 10:11:56.842832 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c5392bdd434949c4bda797e323e1adb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.842976 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5392bdd434949c4bda797e323e1adb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.846102 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_36db13a0f787497c8037e30b3fba0449"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.846210 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36db13a0f787497c8037e30b3fba0449 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.855135 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 3714ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:56.856822 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b3c3c652bb6f453ea157533b626e5dba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.856986 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3c3c652bb6f453ea157533b626e5dba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.857460 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ceceeee49c5a4110b1c6d60c9279972e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.857563 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ceceeee49c5a4110b1c6d60c9279972e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.859797 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c1e5d14e18464355acd7ccbebc8040b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.859880 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1e5d14e18464355acd7ccbebc8040b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:56.861268 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c73488a369ec4bc196196444fa9c3632"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:56.861356 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c73488a369ec4bc196196444fa9c3632 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:56.890093 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 3714ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:57.009196 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8ecc7d4769ff44acae848eddaa22adea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.009356 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ecc7d4769ff44acae848eddaa22adea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.010125 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e88eafb79c1540139a63bf49b04271eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:57.010138 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_19a1534e02374361911915480570557f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.010259 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e88eafb79c1540139a63bf49b04271eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.010289 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a1534e02374361911915480570557f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.010615 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1fd06d806c6546c3878f612338e36886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.010722 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fd06d806c6546c3878f612338e36886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.017932 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1fd06d806c6546c3878f612338e36886" } new_table_name: "default.Table_12b3dd12cf7b4430845719cf71bdbb89" modify_external_catalogs: true
W20250115 10:11:57.018976 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3326a9a37a64e9a9485e5abadc2e493 has no consensus state
I20250115 10:11:57.020241 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_96122f453d0b4d97bb07478f596b0042" } modify_external_catalogs: true
I20250115 10:11:57.020316 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_96122f453d0b4d97bb07478f596b0042" } modify_external_catalogs: true
I20250115 10:11:57.021255 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5764ec058e1a497f90b4df832045a47d
I20250115 10:11:57.031944 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6a1944963f7f4ae0b1135a63ad36a277" } new_table_name: "default.Table_8516b6f074b14403bb634c08ea136591" modify_external_catalogs: true
W20250115 10:11:57.033118 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df8876bed3cf4b11a5e31fc5e7d2d5f3 has no consensus state
I20250115 10:11:57.033367 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7a186c0c3b940c4bfc3c36f117ee45b" } modify_external_catalogs: true
I20250115 10:11:57.033439 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7a186c0c3b940c4bfc3c36f117ee45b" } modify_external_catalogs: true
I20250115 10:11:57.033803 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3baa707f8303433bb3b5a22f948807a7" } modify_external_catalogs: true
I20250115 10:11:57.033870 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3baa707f8303433bb3b5a22f948807a7" } modify_external_catalogs: true
I20250115 10:11:57.033970 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2985a8cb58684bf0b3340ce326ebc1fa" } new_table_name: "default.Table_35c3ea76e5264a00b4decd7516405fda" modify_external_catalogs: true
I20250115 10:11:57.034533 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1b0430b0c5a64e2dae132cd724e62d3c
I20250115 10:11:57.034737 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d081f0604980459e9f22074a2ff890d5" } new_table_name: "default.Table_932d4668fbd84d81a86a019f6c18436f" modify_external_catalogs: true
I20250115 10:11:57.034768 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_44eb748a3296469183eeb590b8a4919b" } new_table_name: "default.Table_f7d65a58a0e548898ea42847f27b52b6" modify_external_catalogs: true
W20250115 10:11:57.035156 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8aaf94e0283d4c7ea3d40b0d7d5848ab has no consensus state
I20250115 10:11:57.035166 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9e4bf5a1c5bf44eeaa9879f8c7fcdc1a
I20250115 10:11:57.035785 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ceceeee49c5a4110b1c6d60c9279972e" } modify_external_catalogs: true
W20250115 10:11:57.035804 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d368093a74ba4918b0efcc3a909c3a07 has no consensus state
I20250115 10:11:57.035874 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ceceeee49c5a4110b1c6d60c9279972e" } modify_external_catalogs: true
W20250115 10:11:57.036325 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2bbb62e941ac41e0a398455c224ea0be has no consensus state
I20250115 10:11:57.036816 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5005b6a62feb4932b7468dc6066f3515
I20250115 10:11:57.043548 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8d0d0da8b2a243c3b8219419abaa92c1" } modify_external_catalogs: true
I20250115 10:11:57.043614 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8d0d0da8b2a243c3b8219419abaa92c1" } modify_external_catalogs: true
I20250115 10:11:57.044638 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ebf799fe88164ebfa89db8fe6ea46a1b
I20250115 10:11:57.044725 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5b1fd5cfd1424151839bc16fb5c88670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.044849 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b1fd5cfd1424151839bc16fb5c88670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.047451 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_721f67c0db1442cdab1eb231d9a5bf31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.047554 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_721f67c0db1442cdab1eb231d9a5bf31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.058455 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8a35819f77bf4c78a5eaa52af124ec22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.058588 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a35819f77bf4c78a5eaa52af124ec22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.059018 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_810fd19f35d44985bf0cbf3b1d14b77f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.059130 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_810fd19f35d44985bf0cbf3b1d14b77f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.061766 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:57.063362 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a0216b717e5a4a1baf7405dba7971710"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.063449 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0216b717e5a4a1baf7405dba7971710 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.064158 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_04de2aa894ec4cfba2b186792f2d3c52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.064256 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04de2aa894ec4cfba2b186792f2d3c52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.065878 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:57.090914 4313 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:57.090993 4313 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:57.091143 4313 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:57.091373 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:11:57.091360 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:57.091622 4237 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:11:57.091704 4313 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250115 10:11:57.098306 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:57.108461 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:57.123566 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 3987ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:57.154601 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 3987ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:57.157341 3550 raft_consensus.cc:1270] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250115 10:11:57.157547 3952 consensus_queue.cc:1035] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250115 10:11:57.159247 3214 consensus_peers.cc:487] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:57.190023 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:57.211231 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cc03dd32d9d440339095b8814765158f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.211411 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc03dd32d9d440339095b8814765158f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.212424 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_081afe08bc1e470d9427fd00d2c87560"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.212563 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_081afe08bc1e470d9427fd00d2c87560 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.212430 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c40c2bc4943f4bbcb67a09a8a54a867d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.212641 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c40c2bc4943f4bbcb67a09a8a54a867d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.212977 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a3113775cc69465ba72e56cef24d639f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.213059 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3113775cc69465ba72e56cef24d639f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.219455 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_db89a087dc0b4459a3eef1f701bf1871" } new_table_name: "default.Table_13d5f1dc819c4437a73fcf37001b3b73" modify_external_catalogs: true
W20250115 10:11:57.220456 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d34f0713bda44fd9e50aab211e28256 has no consensus state
I20250115 10:11:57.221664 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c1e5d14e18464355acd7ccbebc8040b6" } modify_external_catalogs: true
I20250115 10:11:57.221714 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c1e5d14e18464355acd7ccbebc8040b6" } modify_external_catalogs: true
I20250115 10:11:57.222471 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet c9e291c780da42da8dc7663ebe050f12
I20250115 10:11:57.233672 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a7d7e9d0cf041d099c8fa560ab0ec9c" } new_table_name: "default.Table_a5fa7462efff4decbe49036d93bee66e" modify_external_catalogs: true
W20250115 10:11:57.234804 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7a56c28f8c845f8a9bb20760dfab3f0 has no consensus state
I20250115 10:11:57.235064 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9bef498958184c8595bc50e15f924293" } modify_external_catalogs: true
I20250115 10:11:57.235141 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9bef498958184c8595bc50e15f924293" } modify_external_catalogs: true
I20250115 10:11:57.235743 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_13d5f1dc819c4437a73fcf37001b3b73" } modify_external_catalogs: true
I20250115 10:11:57.235831 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_13d5f1dc819c4437a73fcf37001b3b73" } modify_external_catalogs: true
I20250115 10:11:57.236018 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e88eafb79c1540139a63bf49b04271eb" } new_table_name: "default.Table_19e62af30b1a48399b4d9487eb46fe07" modify_external_catalogs: true
I20250115 10:11:57.236178 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1fa5b108bd214a56840cea7583755db2
I20250115 10:11:57.236289 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8f636b61c041459f8b1d47dd360e2047" } new_table_name: "default.Table_b91694124a9c4d13bba0239c6c992767" modify_external_catalogs: true
I20250115 10:11:57.236868 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3a70c132bf104c3ea7d248cee177b033" } new_table_name: "default.Table_96a7c9ee93f04da192e8a162fc08a294" modify_external_catalogs: true
I20250115 10:11:57.237246 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_36db13a0f787497c8037e30b3fba0449" } modify_external_catalogs: true
I20250115 10:11:57.237305 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_36db13a0f787497c8037e30b3fba0449" } modify_external_catalogs: true
I20250115 10:11:57.237329 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 4d34f0713bda44fd9e50aab211e28256
W20250115 10:11:57.237308 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9a0a21cc13fa40eda5b75607869b032c has no consensus state
W20250115 10:11:57.237743 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4cbd61aec79d479d9eea8d807cd5fb0e has no consensus state
I20250115 10:11:57.238233 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 645f7fcc68704bbe9a4d246e100cacb5
W20250115 10:11:57.238274 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6f611ee9e87048ca8bddaa6525bbd054 has no consensus state
I20250115 10:11:57.245330 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3eba608bc2eb4f5383a5b60252200056" } modify_external_catalogs: true
I20250115 10:11:57.245383 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3eba608bc2eb4f5383a5b60252200056" } modify_external_catalogs: true
I20250115 10:11:57.246218 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_353a3563b6e74be6bc76ac745d14722b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:57.246331 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1004bde821054bb7bf1dea64081c0df1
W20250115 10:11:57.246331 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_353a3563b6e74be6bc76ac745d14722b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.248782 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_79f48757c279457faeca60d711a7d129"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.248903 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79f48757c279457faeca60d711a7d129 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.260076 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b418111124af4e9187418d50448b2d32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.260188 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b418111124af4e9187418d50448b2d32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.260538 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fb85a074d574465b97ceed23f101d3b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.260634 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb85a074d574465b97ceed23f101d3b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.262485 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:57.264931 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fa2f46d367594fc2b0076ad6db01dee7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.265033 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa2f46d367594fc2b0076ad6db01dee7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.266119 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5696acca9fa140d9bb502485743760be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.266216 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5696acca9fa140d9bb502485743760be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.282625 3913 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:57.282732 3913 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:57.282879 3913 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:57.283039 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:11:57.283126 3278 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 2.
W20250115 10:11:57.283178 3484 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:57.283275 3485 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:57.283361 3913 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250115 10:11:57.283404 3913 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:57.283427 3913 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:11:57.284245 3913 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:57.284371 3913 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:11:57.284562 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d667834206fe4410a22b4944b3494462" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:11:57.284651 3278 raft_consensus.cc:3054] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Advancing to term 3
W20250115 10:11:57.284709 3484 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:11:57.285426 3278 raft_consensus.cc:2463] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 3.
I20250115 10:11:57.285615 3485 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:57.285707 3913 raft_consensus.cc:2798] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Leader election won for term 3
I20250115 10:11:57.285755 3913 raft_consensus.cc:695] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 3 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:11:57.285812 3913 consensus_queue.cc:237] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:11:57.290246 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:57.303987 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:57.385988 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 4252ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:57.396957 3671 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:57.397035 3671 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:57.397177 3671 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:57.397429 3214 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:57.397431 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:11:57.397508 3550 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 2.
I20250115 10:11:57.397621 3215 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:57.397691 3952 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250115 10:11:57.397727 3952 raft_consensus.cc:491] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:11:57.397750 3952 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:11:57.398501 3952 raft_consensus.cc:513] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:57.398617 3952 leader_election.cc:290] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:11:57.398814 3214 leader_election.cc:343] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:11:57.398931 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2377c27855a64ac7bec95a6d6c5289af" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:11:57.398990 3550 raft_consensus.cc:3054] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:11:57.399497 3550 raft_consensus.cc:2463] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 3.
I20250115 10:11:57.399667 3215 leader_election.cc:304] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:11:57.399808 3952 raft_consensus.cc:2798] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Leader election won for term 3
I20250115 10:11:57.399859 3952 raft_consensus.cc:695] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:11:57.399916 3952 consensus_queue.cc:237] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:11:57.413717 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dd38a16ca30b4b3a826b29a58d509fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.413898 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd38a16ca30b4b3a826b29a58d509fc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.414340 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e5b2c9b92dc946bf9ee81f8cd2f9f5e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:57.414834 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f4f6dbbd49dd4162882aa1747224848e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.414971 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f6dbbd49dd4162882aa1747224848e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.414835 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5b2c9b92dc946bf9ee81f8cd2f9f5e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.415680 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0b5b6585f3ef455598c0a019f0917789"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.415831 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b5b6585f3ef455598c0a019f0917789 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.418962 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 4252ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:57.420946 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_80ad9c67084544ecb851d7989a799632" } new_table_name: "default.Table_b0281684e16f4097b48c61ade6390176" modify_external_catalogs: true
W20250115 10:11:57.421941 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29fc55729c3e46e0b4c66c1822feed19 has no consensus state
I20250115 10:11:57.423022 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_702ea3bed8cb4aeda8ba9e96d453e4dd" } modify_external_catalogs: true
I20250115 10:11:57.423081 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_702ea3bed8cb4aeda8ba9e96d453e4dd" } modify_external_catalogs: true
I20250115 10:11:57.424014 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5d689b8c74bb47b4916bb3ca414638ec
I20250115 10:11:57.435421 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2f9f06ce2e924399afa680e26693de0b" } new_table_name: "default.Table_148b169b9af64be99dd3d68e4331da62" modify_external_catalogs: true
W20250115 10:11:57.436528 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca2e043501b04096b648d179a13e8653 has no consensus state
I20250115 10:11:57.436581 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df0a036eb35c4153ab185a6abcba2a31" } modify_external_catalogs: true
I20250115 10:11:57.436638 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df0a036eb35c4153ab185a6abcba2a31" } modify_external_catalogs: true
I20250115 10:11:57.437481 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 55eab2807e0145c280b5895f8a26b76e
I20250115 10:11:57.437674 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7fec90af67294d50a5c39c5e793002e6" } modify_external_catalogs: true
I20250115 10:11:57.437731 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7fec90af67294d50a5c39c5e793002e6" } modify_external_catalogs: true
I20250115 10:11:57.438045 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b44858d62c7c446d8bf598ff1aa20ca6" } new_table_name: "default.Table_5ae39ce8f73041e286b44226d541e7e6" modify_external_catalogs: true
I20250115 10:11:57.438328 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b4d6ceddf1dc4d62939e7b4fa6c6569c" } new_table_name: "default.Table_d11950a20e0c4811a5b322e91e958167" modify_external_catalogs: true
I20250115 10:11:57.438714 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b0281684e16f4097b48c61ade6390176" } modify_external_catalogs: true
I20250115 10:11:57.438733 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_90cb23f01fbf4659a78c39bfcf398688" } new_table_name: "default.Table_5b2d94414ce649b2b707680c82faaa14" modify_external_catalogs: true
I20250115 10:11:57.438782 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b0281684e16f4097b48c61ade6390176" } modify_external_catalogs: true
I20250115 10:11:57.442502 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e14c637c89fd4e9da1bb6dddcdd3271d
W20250115 10:11:57.442538 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 has no consensus state
W20250115 10:11:57.442608 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
W20250115 10:11:57.442718 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77f7c04c379847e598266b2c129de56e has no consensus state
I20250115 10:11:57.442822 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 29fc55729c3e46e0b4c66c1822feed19
I20250115 10:11:57.446962 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fe31529eb55e4597805728d7b7396d91" } modify_external_catalogs: true
I20250115 10:11:57.447032 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fe31529eb55e4597805728d7b7396d91" } modify_external_catalogs: true
I20250115 10:11:57.447573 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9241327df130447786232b5186c1e229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.447721 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9241327df130447786232b5186c1e229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.448102 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 0d1fe9fe947e444080599f59080d330f
I20250115 10:11:57.450062 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_557be6a814774dbc99e24c178cfd85d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.450170 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_557be6a814774dbc99e24c178cfd85d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.461715 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_19ad193516e442b28002f64e3301d7c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.461845 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19ad193516e442b28002f64e3301d7c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.461984 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c44d243878514ff19a0f78c47f415f6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.462085 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c44d243878514ff19a0f78c47f415f6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.466430 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9e4e628c2c3f426d96228bca70fedc34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.466526 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9e4e628c2c3f426d96228bca70fedc34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.467504 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b2e7f5627bba4eaa98d38250cfdd249b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.467623 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2e7f5627bba4eaa98d38250cfdd249b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.473259 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:57.552795 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:57.596156 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:57.607103 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:57.617077 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_94e0be574bb84048bda97839efe3d8ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:57.617110 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a9b235a2126446b8832f6954ff63f78f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.617233 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94e0be574bb84048bda97839efe3d8ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.617269 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9b235a2126446b8832f6954ff63f78f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.617776 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cca10c5c49044a0cbcfcc4c159f06e41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.617879 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cca10c5c49044a0cbcfcc4c159f06e41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.618180 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5480f47dde5a46e38cb6e1ba31296171"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.618273 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5480f47dde5a46e38cb6e1ba31296171 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.622426 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e72dbe33258c4d55b5ad5275454bd000" } new_table_name: "default.Table_d53d0c9fb98143aa859dd0a6174aeda2" modify_external_catalogs: true
W20250115 10:11:57.623631 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b8f7f4da78844199204c83ec0e6a0af has no consensus state
I20250115 10:11:57.624466 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e8462eb21c7d488ea177321eec4aa13e" } modify_external_catalogs: true
I20250115 10:11:57.624536 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e8462eb21c7d488ea177321eec4aa13e" } modify_external_catalogs: true
I20250115 10:11:57.625663 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 83b7b1a0c6ce40989d2f5a625ce20403
I20250115 10:11:57.637113 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_79ef70b78772441ebb9b7d7a95cee039" } new_table_name: "default.Table_8bdb974f22214350a7b433bad2892662" modify_external_catalogs: true
I20250115 10:11:57.637948 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1d45a7ee69474266972a1eb0633f12e7" } modify_external_catalogs: true
I20250115 10:11:57.638013 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1d45a7ee69474266972a1eb0633f12e7" } modify_external_catalogs: true
W20250115 10:11:57.638466 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:57.638677 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4283a096b18b4be69e1f57e60c3efd3e has no consensus state
I20250115 10:11:57.639762 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e68046a1dd1342a6952bc73066144789
I20250115 10:11:57.643157 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9241327df130447786232b5186c1e229" } modify_external_catalogs: true
I20250115 10:11:57.643193 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_01e9df5e66074b8bb9e23a059fa1b834" } new_table_name: "default.Table_ec83f99def60413b9caf0aecdff9d43a" modify_external_catalogs: true
I20250115 10:11:57.643251 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ce1d0c2c57e64929b1c5bb4d6fbcc4d7" } new_table_name: "default.Table_5bebe80015df4ceeba5483945cad58ed" modify_external_catalogs: true
I20250115 10:11:57.643332 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5696acca9fa140d9bb502485743760be" } new_table_name: "default.Table_5f2ccdf1f85748159368db4e12758084" modify_external_catalogs: true
I20250115 10:11:57.643229 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9241327df130447786232b5186c1e229" } modify_external_catalogs: true
I20250115 10:11:57.643535 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e337908b6f1f4c98a2d71f4c29fdd6db" } modify_external_catalogs: true
I20250115 10:11:57.643592 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e337908b6f1f4c98a2d71f4c29fdd6db" } modify_external_catalogs: true
W20250115 10:11:57.644795 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b1ba7c80c4404b8fed7df709f0aba2 has no consensus state
W20250115 10:11:57.644819 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e91450b4369844ea9ab09383b3dbc8ee has no consensus state
I20250115 10:11:57.644822 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet cd70fb8770ad4c35b483f997a804eca9
W20250115 10:11:57.645612 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77bc207c9da34c8db395c0611a92f590 has no consensus state
I20250115 10:11:57.645701 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3a2253a2bb8f401ab18d3a41bf72e0e0
I20250115 10:11:57.648582 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3bab9ede8058473fab1a422783ac27e7" } modify_external_catalogs: true
I20250115 10:11:57.648638 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3bab9ede8058473fab1a422783ac27e7" } modify_external_catalogs: true
I20250115 10:11:57.649127 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae86ee92f2c747a5b551f6fe8911ac07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.649278 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae86ee92f2c747a5b551f6fe8911ac07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.650398 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7dfc5d9827f04b288120db0499891287
I20250115 10:11:57.651603 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c5f387d5f39f44caadb8c0ddfa6bf57c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.651777 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5f387d5f39f44caadb8c0ddfa6bf57c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.654201 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 4516ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:57.663466 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2c47d1065f3942148d15ac44e72497ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.663606 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c47d1065f3942148d15ac44e72497ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.663692 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6d4bf4e0ba1e4324a37b38d2582d5d33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.663817 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d4bf4e0ba1e4324a37b38d2582d5d33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.667886 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_63a19f72d7be4c89ada9e78fe5395cad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.668004 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63a19f72d7be4c89ada9e78fe5395cad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.668843 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_48dd88cee4bc4d32aad97f2afab08485"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.668936 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48dd88cee4bc4d32aad97f2afab08485 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.673012 3484 consensus_peers.cc:487] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d667834206fe4410a22b4944b3494462. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:11:57.679895 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 60b1ba7c80c4404b8fed7df709f0aba2 (table default.Table_ec83f99def60413b9caf0aecdff9d43a [id=7f690847821b44668c41b17a25d4ce37], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 60b1ba7c80c4404b8fed7df709f0aba2 has no consensus state
W20250115 10:11:57.688858 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 4516ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:57.699312 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:11:57.799321 3214 consensus_peers.cc:487] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:11:57.819128 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d2c4a3b2009e4f548be4457d598fff95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.819355 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2c4a3b2009e4f548be4457d598fff95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.819536 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6c163f8cdde04145839e0eef2e7cb08e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.819626 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c163f8cdde04145839e0eef2e7cb08e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.819993 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3e97b770b64b4413b3b808004eabb08e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.820080 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e97b770b64b4413b3b808004eabb08e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.823593 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7460e59294f44b649751a33d55fbfcd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.823678 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7460e59294f44b649751a33d55fbfcd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.824149 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dca7d059ac2e49289b71f48bb9af91fa" } new_table_name: "default.Table_b454320ac5c64584aa0d05e66e379bf8" modify_external_catalogs: true
W20250115 10:11:57.825212 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91f2c04014a14b2084eb988e59040038 has no consensus state
I20250115 10:11:57.826201 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0b5b6585f3ef455598c0a019f0917789" } modify_external_catalogs: true
I20250115 10:11:57.826254 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0b5b6585f3ef455598c0a019f0917789" } modify_external_catalogs: true
I20250115 10:11:57.827056 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d71cf38aac0c443a9b898cb06ee02d6d
I20250115 10:11:57.839128 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_04de2aa894ec4cfba2b186792f2d3c52" } new_table_name: "default.Table_a3a38ccf73394d398f7be3b3c244cdc3" modify_external_catalogs: true
I20250115 10:11:57.840291 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6d4bf4e0ba1e4324a37b38d2582d5d33" } modify_external_catalogs: true
W20250115 10:11:57.840385 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8114f64577245c2b3ce70e4399de0c8 has no consensus state
I20250115 10:11:57.840375 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6d4bf4e0ba1e4324a37b38d2582d5d33" } modify_external_catalogs: true
I20250115 10:11:57.841300 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8322b847ec6a43c3bbeb2871012ec31b
I20250115 10:11:57.845281 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_148b169b9af64be99dd3d68e4331da62" } new_table_name: "default.Table_c0ff744e09494f649e7f58be7ef6c2c1" modify_external_catalogs: true
I20250115 10:11:57.845379 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_557be6a814774dbc99e24c178cfd85d8" } new_table_name: "default.Table_e1748ad3656d4180bfcd25bf76e98589" modify_external_catalogs: true
I20250115 10:11:57.845405 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_19e62af30b1a48399b4d9487eb46fe07" } modify_external_catalogs: true
I20250115 10:11:57.845492 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_19e62af30b1a48399b4d9487eb46fe07" } modify_external_catalogs: true
I20250115 10:11:57.846145 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b2e7f5627bba4eaa98d38250cfdd249b" } new_table_name: "default.Table_199fc4a523eb4de7bf208708625c05bf" modify_external_catalogs: true
I20250115 10:11:57.846312 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_872267a210a543ebaa8dc83c22acf71a" } modify_external_catalogs: true
I20250115 10:11:57.846365 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_872267a210a543ebaa8dc83c22acf71a" } modify_external_catalogs: true
W20250115 10:11:57.846372 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca2e043501b04096b648d179a13e8653 has no consensus state
W20250115 10:11:57.846992 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet def9cfbc6f764499b1c6ac9b6845f5ed has no consensus state
I20250115 10:11:57.847041 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9a0a21cc13fa40eda5b75607869b032c
I20250115 10:11:57.847568 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet c8669414df864d9b928718094e9eabe2
W20250115 10:11:57.847647 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3402dc674ab0402f8e0bdd7b8db4b88d has no consensus state
I20250115 10:11:57.850697 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_93ee920c32874d4888ddf9c25fbdff06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.850816 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93ee920c32874d4888ddf9c25fbdff06 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.850819 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c16e568822154d5ea79d791d2e59a131" } modify_external_catalogs: true
I20250115 10:11:57.850915 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c16e568822154d5ea79d791d2e59a131" } modify_external_catalogs: true
I20250115 10:11:57.852126 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 43e6906551af4197850ec891c83afd22
I20250115 10:11:57.852353 3550 raft_consensus.cc:1270] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250115 10:11:57.852540 3952 consensus_queue.cc:1035] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250115 10:11:57.853339 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a25a38956c0c4194aa7f716f1838f8da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.853435 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a25a38956c0c4194aa7f716f1838f8da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.865538 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8e300c7e8c904d15beed4cf90ef8fdc1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:57.865509 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_afd1a870746a4d1daaf47da6739701b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.865705 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.865710 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afd1a870746a4d1daaf47da6739701b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.869588 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_83574b7bee50441b90359b9dc3f289cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.869710 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83574b7bee50441b90359b9dc3f289cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:57.870200 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b185d0f89c564115aaaf3d37e2757442"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:57.870313 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b185d0f89c564115aaaf3d37e2757442 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:57.872156 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:57.885516 3278 raft_consensus.cc:1270] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250115 10:11:57.885834 3913 consensus_queue.cc:1035] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20250115 10:11:57.896075 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:57.896087 3484 consensus_peers.cc:487] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7352b551832b40039715e5bf18a31ffb. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:57.912503 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:57.923063 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 4786ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:57.961495 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 4786ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:58.007561 4328 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:58.007671 4328 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:58.007853 4328 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:58.008066 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:58.008237 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:11:58.008438 4239 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:11:58.008559 4328 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:11:58.021354 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_56df121bbd4d4e55acbaf7c2ac30957c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.021505 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56df121bbd4d4e55acbaf7c2ac30957c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.021744 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d0fcc51d02e64d42831f872a5b3b02ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:58.021749 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d59e20c98bd84db48c45d49171eff4fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.021873 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0fcc51d02e64d42831f872a5b3b02ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.021888 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d59e20c98bd84db48c45d49171eff4fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.025115 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_28b2604c8a2c4539b770763c8d698cd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.025336 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28b2604c8a2c4539b770763c8d698cd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.025701 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_353a3563b6e74be6bc76ac745d14722b" } new_table_name: "default.Table_d7feadff267d4adcbd58c1243d812fe4" modify_external_catalogs: true
W20250115 10:11:58.026865 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8c99788dae6421b8b2dd4f40e2b63b2 has no consensus state
I20250115 10:11:58.027437 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_29b0a2290843417ab51c63171de9b4e8" } modify_external_catalogs: true
I20250115 10:11:58.027501 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_29b0a2290843417ab51c63171de9b4e8" } modify_external_catalogs: true
I20250115 10:11:58.028381 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet a97bfcb374f042518175279ae95f4d67
W20250115 10:11:58.039815 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:58.040835 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_82afd111262349548f34d91b87848649" } new_table_name: "default.Table_bdc719b9ccac4ab4919217792487de79" modify_external_catalogs: true
W20250115 10:11:58.041801 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 642cd64ad8c44acb8566aeddd47fef9a has no consensus state
I20250115 10:11:58.041776 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5f2ccdf1f85748159368db4e12758084" } modify_external_catalogs: true
I20250115 10:11:58.041836 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5f2ccdf1f85748159368db4e12758084" } modify_external_catalogs: true
I20250115 10:11:58.042600 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 77bc207c9da34c8db395c0611a92f590
I20250115 10:11:58.047144 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3b64b710933d4f06ab796e107db177c0" } new_table_name: "default.Table_bfd274906ff64c15923a398e7b1928b7" modify_external_catalogs: true
I20250115 10:11:58.047664 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b418111124af4e9187418d50448b2d32" } modify_external_catalogs: true
I20250115 10:11:58.047689 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_81b828ac71704ee6b6027b6b97e42a28" } new_table_name: "default.Table_dfa91fc3d99a431984343d0752f41555" modify_external_catalogs: true
I20250115 10:11:58.047753 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b418111124af4e9187418d50448b2d32" } modify_external_catalogs: true
I20250115 10:11:58.048295 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a5fa7462efff4decbe49036d93bee66e" } modify_external_catalogs: true
I20250115 10:11:58.048363 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a5fa7462efff4decbe49036d93bee66e" } modify_external_catalogs: true
I20250115 10:11:58.048554 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8bdb974f22214350a7b433bad2892662" } new_table_name: "default.Table_eb6dbc05842d4cf1b1930201f8cecc7a" modify_external_catalogs: true
W20250115 10:11:58.048947 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet af48bf64e2ca4a3197805c75fb0a12a6 has no consensus state
W20250115 10:11:58.049371 3484 consensus_peers.cc:487] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cbfcedc2f5447a1acb095066d131d52. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:11:58.049521 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ab5dc07e30054cfb8de9b4c453f0b8cb
W20250115 10:11:58.049579 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a577ace8245744d1a42938ddd99ce89b has no consensus state
W20250115 10:11:58.049937 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:58.050238 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet f7a56c28f8c845f8a9bb20760dfab3f0
W20250115 10:11:58.050304 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4283a096b18b4be69e1f57e60c3efd3e has no consensus state
I20250115 10:11:58.052188 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.052306 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.053035 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_721f67c0db1442cdab1eb231d9a5bf31" } modify_external_catalogs: true
I20250115 10:11:58.053092 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_721f67c0db1442cdab1eb231d9a5bf31" } modify_external_catalogs: true
I20250115 10:11:58.054199 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 247f1e90e8df4f1faab41a764b4a10cd
I20250115 10:11:58.055406 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b47be440050d400fb6d760b264f8e902"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.055511 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b47be440050d400fb6d760b264f8e902 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.067341 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bfa733f08d354e4ba9dca2b09152b95f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:58.067373 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cf02cb026779436ba2ab00d32700b1e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.067484 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf02cb026779436ba2ab00d32700b1e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.067483 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfa733f08d354e4ba9dca2b09152b95f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.071128 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3f07cceddbec43d9989ad88b7a2ac81c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.071220 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3f07cceddbec43d9989ad88b7a2ac81c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.071820 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ec128e5d9b6a4ee9aa3433d149db3438"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.071923 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.098040 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:58.151880 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:11:58.191627 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 5059ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:58.194499 2918 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskjHaIeY/build/release/bin/kudu with pid 4222
I20250115 10:11:58.223325 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0d43a0379fa042929ffb70c09407e4f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.223508 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d43a0379fa042929ffb70c09407e4f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.224330 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8b2bd680dfb44952a854b89bf65a2aa9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.224449 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b2bd680dfb44952a854b89bf65a2aa9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.224330 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9c73da03559241438bc5c29b8345bdbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.224793 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c73da03559241438bc5c29b8345bdbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.225220 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 5059ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:58.226752 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fd82dd447b0848bb9d42f028d5a912c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.226859 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd82dd447b0848bb9d42f028d5a912c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.227337 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_722e957d50ab4d00ad9006fe1d6aedc3" } new_table_name: "default.Table_94705e3d87b849c492197ee155b60bfb" modify_external_catalogs: true
W20250115 10:11:58.228335 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 59c2e46358b34baeb494c627bcaa3036 has no consensus state
I20250115 10:11:58.228781 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f0a38195df2c4d73b3c6013fe636c14f" } modify_external_catalogs: true
I20250115 10:11:58.228840 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f0a38195df2c4d73b3c6013fe636c14f" } modify_external_catalogs: true
I20250115 10:11:58.229624 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 4a7e14235ab54b3bb9ad2f7f86627ddf
W20250115 10:11:58.236809 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:58.242290 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c40c2bc4943f4bbcb67a09a8a54a867d" } new_table_name: "default.Table_4e44e0cd2af54f0585de9211108521c0" modify_external_catalogs: true
I20250115 10:11:58.243046 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_28b2604c8a2c4539b770763c8d698cd9" } modify_external_catalogs: true
I20250115 10:11:58.243111 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_28b2604c8a2c4539b770763c8d698cd9" } modify_external_catalogs: true
W20250115 10:11:58.243541 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46b8efd1622a4efcb009f999cb915dfc has no consensus state
I20250115 10:11:58.244020 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 92d516882c8943e1b6efd6674ae4b441
I20250115 10:11:58.250134 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c0ff744e09494f649e7f58be7ef6c2c1" } new_table_name: "default.Table_0e782126bee84bd3ba6a5be9ae46c96c" modify_external_catalogs: true
I20250115 10:11:58.250154 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3f07cceddbec43d9989ad88b7a2ac81c" } modify_external_catalogs: true
I20250115 10:11:58.250118 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_91cb2ed42f4043e6a89cc61f53f5d6c8" } new_table_name: "default.Table_130a7873a4304dd58cac505f0c97ab3c" modify_external_catalogs: true
I20250115 10:11:58.250270 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3f07cceddbec43d9989ad88b7a2ac81c" } modify_external_catalogs: true
I20250115 10:11:58.250802 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b5f15867176642cca77684583cdacba2" } modify_external_catalogs: true
I20250115 10:11:58.250861 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b5f15867176642cca77684583cdacba2" } modify_external_catalogs: true
I20250115 10:11:58.250841 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bdc719b9ccac4ab4919217792487de79" } new_table_name: "default.Table_e5e0cb6900c74884994999c085276243" modify_external_catalogs: true
I20250115 10:11:58.251302 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 62bb9a0948f148feb4f21716f3e4f680
W20250115 10:11:58.251749 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ca2e043501b04096b648d179a13e8653 has no consensus state
I20250115 10:11:58.251966 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e2dadcc3ab104ba9858086b00b4d32d9
W20250115 10:11:58.252023 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 642cd64ad8c44acb8566aeddd47fef9a has no consensus state
W20250115 10:11:58.252080 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ee7ca135ce3439e990c94c7c93fe0e0 has no consensus state
I20250115 10:11:58.253777 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9130efcb487944ea8a09f94aa5e23ad4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.253885 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9130efcb487944ea8a09f94aa5e23ad4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.254828 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d11950a20e0c4811a5b322e91e958167" } modify_external_catalogs: true
I20250115 10:11:58.254884 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d11950a20e0c4811a5b322e91e958167" } modify_external_catalogs: true
I20250115 10:11:58.255753 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 77f7c04c379847e598266b2c129de56e
I20250115 10:11:58.256883 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b8abe6f792f84722953b88b54d7516be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.256981 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8abe6f792f84722953b88b54d7516be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.268824 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_66411014c8114107a7b0e2bcea2e4844"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.268968 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66411014c8114107a7b0e2bcea2e4844 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.269335 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a3b73807076c4f0aabf9e6f82eca2bef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.269430 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3b73807076c4f0aabf9e6f82eca2bef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.272400 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_08ec06f0141d4b3987b31855419390bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.272498 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08ec06f0141d4b3987b31855419390bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.273392 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1eacbd293bea443fa0780ba898123200"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.273480 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eacbd293bea443fa0780ba898123200 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.309370 3214 consensus_peers.cc:487] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9825097e391481da01ad9111c836ec9. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.324086 3214 consensus_peers.cc:487] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4727b40e9db4460b826fcc1ca67c9c8f. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.327175 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:58.378072 3214 consensus_peers.cc:487] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f4dc0c74f2e43db8b87446a236771f2. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.403983 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:58.405354 3214 consensus_peers.cc:487] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f792ae7d54184207825a92d72bc5a323. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.411531 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:58.426252 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2a7aa569d3db483b816af99d0cf55071"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.426395 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a7aa569d3db483b816af99d0cf55071 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.426934 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2648dfb12d924eda9b18368da8df24a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:58.426946 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b7f5565de66f4ea5884b8c57e72d6613"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.427063 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2648dfb12d924eda9b18368da8df24a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.427078 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7f5565de66f4ea5884b8c57e72d6613 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.428244 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2c791d1c1e86451a8080674fe68d383a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.428332 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c791d1c1e86451a8080674fe68d383a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.428817 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_810fd19f35d44985bf0cbf3b1d14b77f" } new_table_name: "default.Table_d3f7fb9bf3ef42b6a545c1df40e90998" modify_external_catalogs: true
I20250115 10:11:58.430137 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_130a7873a4304dd58cac505f0c97ab3c" } modify_external_catalogs: true
I20250115 10:11:58.430194 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_130a7873a4304dd58cac505f0c97ab3c" } modify_external_catalogs: true
W20250115 10:11:58.430588 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 752b8f0cd5b74bc5860108f87f033dca has no consensus state
I20250115 10:11:58.431340 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6ee7ca135ce3439e990c94c7c93fe0e0
I20250115 10:11:58.444069 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_78356a60ecd94e809ce6bf2941bdbdb5" } new_table_name: "default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4" modify_external_catalogs: true
I20250115 10:11:58.444481 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2c47d1065f3942148d15ac44e72497ca" } modify_external_catalogs: true
I20250115 10:11:58.444545 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2c47d1065f3942148d15ac44e72497ca" } modify_external_catalogs: true
W20250115 10:11:58.445416 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d841537abc2437c826e069cc0725ad1 has no consensus state
I20250115 10:11:58.445991 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 1b6f78c147b04c22bccb4f9caa278bf7
I20250115 10:11:58.451694 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bc8c5ca692f44840af807cc5c4fa1171" } modify_external_catalogs: true
I20250115 10:11:58.451772 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bc8c5ca692f44840af807cc5c4fa1171" } modify_external_catalogs: true
I20250115 10:11:58.452281 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_199fc4a523eb4de7bf208708625c05bf" } new_table_name: "default.Table_7b73790b66b24fa6a82b5059181ca640" modify_external_catalogs: true
I20250115 10:11:58.452642 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5e0cb6900c74884994999c085276243" } new_table_name: "default.Table_f6318eb4e7ee49319ddb6663d2f1646b" modify_external_catalogs: true
I20250115 10:11:58.452677 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dd38a16ca30b4b3a826b29a58d509fc7" } new_table_name: "default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c" modify_external_catalogs: true
I20250115 10:11:58.452864 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e9325498aa4b4c129c8e78ad403eba85
I20250115 10:11:58.452654 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5a71cd3e794b49b0b210dcdd074c1758" } modify_external_catalogs: true
I20250115 10:11:58.452950 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5a71cd3e794b49b0b210dcdd074c1758" } modify_external_catalogs: true
W20250115 10:11:58.453675 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3402dc674ab0402f8e0bdd7b8db4b88d has no consensus state
W20250115 10:11:58.454229 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 509f854a424e497f8fa72b70d5f0f651 has no consensus state
W20250115 10:11:58.454234 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 642cd64ad8c44acb8566aeddd47fef9a has no consensus state
I20250115 10:11:58.454367 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9ca9e092b72348c8b903668b9402d8ea
I20250115 10:11:58.455068 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7f11f45ebda04d1d934c330ec17ceccf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.455205 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f11f45ebda04d1d934c330ec17ceccf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.456403 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d8a443adc4734eeba18246236e9852f1" } modify_external_catalogs: true
I20250115 10:11:58.456465 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d8a443adc4734eeba18246236e9852f1" } modify_external_catalogs: true
I20250115 10:11:58.457401 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 6c7eb34e4f784320a987ad8ae32023e2
I20250115 10:11:58.458421 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_01c2044b69094fbda80d5f7c2a6434eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.458521 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_01c2044b69094fbda80d5f7c2a6434eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.462198 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 5322ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:58.470422 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fdbd3c9e5aee44258ffda9b57326cd32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.470536 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdbd3c9e5aee44258ffda9b57326cd32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.470933 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d63e50fd58fd4335ba0165af0f856032"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.471045 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d63e50fd58fd4335ba0165af0f856032 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.473893 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3063f004f9bf41dcb61918c5a80d9ab9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.474004 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3063f004f9bf41dcb61918c5a80d9ab9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.474565 3214 consensus_peers.cc:487] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4839f8e0539d468ea11077d48f8f8266. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:11:58.475160 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3400d62f96644293821b2c773c378d94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.475262 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3400d62f96644293821b2c773c378d94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.496883 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 5322ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:58.516041 3484 consensus_peers.cc:487] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3f88d5d54b74f63a94bf88d3a33cfae. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.516193 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:11:58.535255 3214 consensus_peers.cc:487] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86d086cd94664d40a653d64d06438bda. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.562184 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:58.629225 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c0ff9042b1554e91a840ad8adde05cc9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.629530 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0ff9042b1554e91a840ad8adde05cc9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.629796 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d49228174231497e8980f85375894df5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.629935 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d49228174231497e8980f85375894df5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.629977 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b1441ec916974e33a6e5a290afd937f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.630071 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1441ec916974e33a6e5a290afd937f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.630911 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c199cca34ce04842a194169888b4c5d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:58.630977 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_16f98b9c0db64e58aafb86f0ebad1812" } new_table_name: "default.Table_144b5268ca924ee4b8e869b12ad09043" modify_external_catalogs: true
W20250115 10:11:58.631045 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c199cca34ce04842a194169888b4c5d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.631848 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_92c3df7773a0409fa3515d97fc032468" } modify_external_catalogs: true
I20250115 10:11:58.631918 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_92c3df7773a0409fa3515d97fc032468" } modify_external_catalogs: true
W20250115 10:11:58.633024 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd8b9bf010d245be919f1e912b103770 has no consensus state
I20250115 10:11:58.633416 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 65de0a99d55d4382bb2454b059ae0284
I20250115 10:11:58.645996 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ec83f99def60413b9caf0aecdff9d43a" } new_table_name: "default.Table_80a3efd9c6c746f19ebf7a4bec4ce93b" modify_external_catalogs: true
I20250115 10:11:58.646384 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c10c8969492641c3a4d4690310a93c6a" } modify_external_catalogs: true
I20250115 10:11:58.646456 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c10c8969492641c3a4d4690310a93c6a" } modify_external_catalogs: true
W20250115 10:11:58.647066 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60b1ba7c80c4404b8fed7df709f0aba2 has no consensus state
I20250115 10:11:58.647485 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 311d7b6598854a36ac098a1b23fcf353
I20250115 10:11:58.653582 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_94705e3d87b849c492197ee155b60bfb" } modify_external_catalogs: true
I20250115 10:11:58.653645 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_94705e3d87b849c492197ee155b60bfb" } modify_external_catalogs: true
I20250115 10:11:58.654398 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_83574b7bee50441b90359b9dc3f289cb" } new_table_name: "default.Table_08430ab01322483682c5ea1bb80c05bb" modify_external_catalogs: true
I20250115 10:11:58.654654 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 59c2e46358b34baeb494c627bcaa3036
I20250115 10:11:58.654871 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae86ee92f2c747a5b551f6fe8911ac07" } new_table_name: "default.Table_c5c133466f4340cea44704e70ddd4e1b" modify_external_catalogs: true
I20250115 10:11:58.654907 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd4ba0bc27d94635b73ae80ea5572cec" } modify_external_catalogs: true
I20250115 10:11:58.654946 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7460e59294f44b649751a33d55fbfcd0" } new_table_name: "default.Table_fec7184706584f6ba7fe4a6fc4596962" modify_external_catalogs: true
I20250115 10:11:58.654948 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_bd4ba0bc27d94635b73ae80ea5572cec" } modify_external_catalogs: true
W20250115 10:11:58.655763 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a4af01517cb04be983456a98153f6146 has no consensus state
W20250115 10:11:58.656332 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dde69ff2f574d838d81bea5a53700f5 has no consensus state
W20250115 10:11:58.656373 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea51bbe92f254a3ebbb802868c2e3832 has no consensus state
I20250115 10:11:58.656332 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7fe6bdb417634738aaf27dc483193335
I20250115 10:11:58.656816 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1b401a0e880a4244a7a60cde99fe7a62"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.656939 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b401a0e880a4244a7a60cde99fe7a62 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.657949 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_19ad193516e442b28002f64e3301d7c1" } modify_external_catalogs: true
I20250115 10:11:58.658022 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_19ad193516e442b28002f64e3301d7c1" } modify_external_catalogs: true
I20250115 10:11:58.658838 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 402b8ed9f501436a88fb06a5cebf2740
I20250115 10:11:58.659850 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f448ab1cfae2403393f3884d0a50fd61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.659947 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f448ab1cfae2403393f3884d0a50fd61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.670733 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:11:58.671977 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fe2f3ce38a07444b9849a4cb636ec7c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.672111 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.672505 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_080e6f46b4a4430fbbe8ae52c0055a43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.672600 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_080e6f46b4a4430fbbe8ae52c0055a43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.675931 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_79bc843cce4c40f9ab7fdbe235dda6bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.676038 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79bc843cce4c40f9ab7fdbe235dda6bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.676800 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_16575f283a0b491da19099917b25019d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.676904 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_16575f283a0b491da19099917b25019d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.680198 3085 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8dde69ff2f574d838d81bea5a53700f5 has no consensus state
W20250115 10:11:58.728101 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 5594ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:58.744396 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:11:58.760304 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 5594ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:58.802311 3484 consensus_peers.cc:487] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ba4b779b29841f69fe72527763ab7a1. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.802351 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:58.831946 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_40d71e6a37af45fa841120e98965fdc5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.832100 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40d71e6a37af45fa841120e98965fdc5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.832716 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e9976480454c45ae8f5c492466ad9d9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:58.832736 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d734e721513541c1aa54ea5312db69c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.832840 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9976480454c45ae8f5c492466ad9d9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.832885 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d734e721513541c1aa54ea5312db69c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.833703 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_743c538223aa4516a8e82bb75a2084f2" } new_table_name: "default.Table_b3fbd549a43142f0934459f981bbe3e1" modify_external_catalogs: true
I20250115 10:11:58.833891 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5cde3d62bc8248f3be5fa8764025bbe0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.833974 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cde3d62bc8248f3be5fa8764025bbe0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.834069 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e768f4ab509d4299ae41b1a01abc72c6" } modify_external_catalogs: true
I20250115 10:11:58.834141 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e768f4ab509d4299ae41b1a01abc72c6" } modify_external_catalogs: true
W20250115 10:11:58.835078 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef7f182c4bde468d919523c44fdf3ea4 has no consensus state
I20250115 10:11:58.835701 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5f642fec8d6c475f8c373bdc18d5db57
I20250115 10:11:58.847616 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a3113775cc69465ba72e56cef24d639f" } new_table_name: "default.Table_50877f0a57364b018ca287fbaabd9de3" modify_external_catalogs: true
I20250115 10:11:58.847927 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62fe2d010c9d4125a4d5c1db04d61fc3" } modify_external_catalogs: true
I20250115 10:11:58.847990 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_62fe2d010c9d4125a4d5c1db04d61fc3" } modify_external_catalogs: true
W20250115 10:11:58.848760 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09a3fc9ca6ec4ea9bb72faa7bf388287 has no consensus state
I20250115 10:11:58.849316 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9d7f794e32cb4effb73e059adc60302a
I20250115 10:11:58.855113 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1abb68b92d9b4710b27957fd59761c10" } modify_external_catalogs: true
I20250115 10:11:58.855193 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1abb68b92d9b4710b27957fd59761c10" } modify_external_catalogs: true
W20250115 10:11:58.856101 3214 consensus_peers.cc:487] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01a8681daa9b459ba85dea9410d83256. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:11:58.856395 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a9b235a2126446b8832f6954ff63f78f" } new_table_name: "default.Table_7b8b7074c2ab4429bafb7621ca3dceff" modify_external_catalogs: true
I20250115 10:11:58.856458 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet dccd7f2019334b75874c415c38a15d9c
I20250115 10:11:58.857007 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9e4e628c2c3f426d96228bca70fedc34" } modify_external_catalogs: true
I20250115 10:11:58.857076 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9e4e628c2c3f426d96228bca70fedc34" } modify_external_catalogs: true
I20250115 10:11:58.857116 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5727acff9e444a01ac5b2928b0a7e8b5" } new_table_name: "default.Table_18a195103ffe459baa89d7e5f4c4d6ba" modify_external_catalogs: true
I20250115 10:11:58.857004 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f4f6dbbd49dd4162882aa1747224848e" } new_table_name: "default.Table_34a23834dae942e6a8ae09b65269eb96" modify_external_catalogs: true
W20250115 10:11:58.857411 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3687a386f7fc47b0ba3b2f4cb2538ea1 has no consensus state
I20250115 10:11:58.858326 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7eb37d1bdf3f47d09f35a12fd280836b
W20250115 10:11:58.858475 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c53f12f3a2c6457bb13b13cef42c89ad has no consensus state
I20250115 10:11:58.858668 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4e039abfa4f64cf18f1731b902195963"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.858769 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e039abfa4f64cf18f1731b902195963 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.858829 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 71c23863beb24d27b337fa039d7f04cd has no consensus state
I20250115 10:11:58.859191 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3063f004f9bf41dcb61918c5a80d9ab9" } modify_external_catalogs: true
I20250115 10:11:58.859249 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3063f004f9bf41dcb61918c5a80d9ab9" } modify_external_catalogs: true
I20250115 10:11:58.861366 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_745464477b4d4be793cf32e945afc9f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.861465 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_745464477b4d4be793cf32e945afc9f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.863365 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b684dae31c16464592bf10a593663425
I20250115 10:11:58.873589 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_75c0c070e7964172a05bccbe74583d27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.873718 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75c0c070e7964172a05bccbe74583d27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.873962 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_76c55fb917ec4bc69b74b6cc68bc6081"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.874055 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.877574 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_23bacf2445d441efbcea5c875466e3b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.877686 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23bacf2445d441efbcea5c875466e3b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:58.878469 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_780d6792486f4d65bb71098c78eec010"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:58.878573 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_780d6792486f4d65bb71098c78eec010 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:58.879293 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:58.881867 3484 consensus_peers.cc:487] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3096adefffe04e008f58ecba3c3dd633. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.882068 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:11:58.940312 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:58.940574 3484 consensus_peers.cc:487] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f559e7cafb04ae39af12e7681bbaf24. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:58.996641 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 5857ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:59.034106 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bb295f9a75134872a9c2e24d38b7c80c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.034267 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb295f9a75134872a9c2e24d38b7c80c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.035135 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ed54a8402c694be8ade88c6944c9456d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:59.035147 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cd4e77ef27014f7c80a2c6f5328eeee6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.035343 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd4e77ef27014f7c80a2c6f5328eeee6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.035271 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed54a8402c694be8ade88c6944c9456d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.035769 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_cf9fe3eee1c24d64a5c85788a7cdd0c6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.035859 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf9fe3eee1c24d64a5c85788a7cdd0c6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.035749 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_48dd88cee4bc4d32aad97f2afab08485" } new_table_name: "default.Table_04b06145d63b4efc890eb4dd9de6ad70" modify_external_catalogs: true
I20250115 10:11:59.036298 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_43430be7674b4d00b216d254e6ba8adb" } modify_external_catalogs: true
I20250115 10:11:59.036356 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_43430be7674b4d00b216d254e6ba8adb" } modify_external_catalogs: true
W20250115 10:11:59.037356 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f6baabd5aba4363ae13e5da601a9de8 has no consensus state
W20250115 10:11:59.037711 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 5857ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:59.038516 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:11:59.038628 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet f76c559824054c56b33e6b528352c956
W20250115 10:11:59.038640 3484 consensus_peers.cc:487] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ab77abe34374a6ba6f30bf3a2bd67de. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:11:59.049247 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_663a776c3dab4bffaacba7de61ad20b0" } new_table_name: "default.Table_4233dd487670426c9760dd196a722c8d" modify_external_catalogs: true
I20250115 10:11:59.049793 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d49228174231497e8980f85375894df5" } modify_external_catalogs: true
I20250115 10:11:59.049868 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d49228174231497e8980f85375894df5" } modify_external_catalogs: true
W20250115 10:11:59.050398 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f55439e91f284175a59d35160668fa6c has no consensus state
I20250115 10:11:59.050925 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8ece730b04354fe4b66160f34e4e2d6d
I20250115 10:11:59.056849 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_081afe08bc1e470d9427fd00d2c87560" } modify_external_catalogs: true
I20250115 10:11:59.056905 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_081afe08bc1e470d9427fd00d2c87560" } modify_external_catalogs: true
I20250115 10:11:59.057857 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fd82dd447b0848bb9d42f028d5a912c9" } new_table_name: "default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2" modify_external_catalogs: true
I20250115 10:11:59.057895 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8f6aa255bd164f24a73f4bd8754305e0
W20250115 10:11:59.058696 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 09db89ab7dd543559ae8a11e60c8a873 has no consensus state
I20250115 10:11:59.059072 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7349ef3c502f4bb8b7ad28613c71062c" } modify_external_catalogs: true
I20250115 10:11:59.059099 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8516b6f074b14403bb634c08ea136591" } new_table_name: "default.Table_4e22610e2c0a4ca3acd428db96c08657" modify_external_catalogs: true
I20250115 10:11:59.059140 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7349ef3c502f4bb8b7ad28613c71062c" } modify_external_catalogs: true
I20250115 10:11:59.059294 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8a35819f77bf4c78a5eaa52af124ec22" } new_table_name: "default.Table_a9c119acee6b4b71bf1aa582ed92fda3" modify_external_catalogs: true
W20250115 10:11:59.060192 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df8876bed3cf4b11a5e31fc5e7d2d5f3 has no consensus state
I20250115 10:11:59.060201 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:59.060221 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 4b31b9b2b60c4234951bc38ca7ec1359
W20250115 10:11:59.060352 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.060824 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26351bbe70044075a99982bb380d86a0 has no consensus state
I20250115 10:11:59.063892 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5b2c9b92dc946bf9ee81f8cd2f9f5e6" } modify_external_catalogs: true
I20250115 10:11:59.063964 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e5b2c9b92dc946bf9ee81f8cd2f9f5e6" } modify_external_catalogs: true
I20250115 10:11:59.063880 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae474575b4144851ad889119f33259bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.064100 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae474575b4144851ad889119f33259bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.064742 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 848c2fa6ef244d8db23d0165b23f90de
I20250115 10:11:59.075229 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_25fd90e569f543a08c37804c5c95dd31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.075359 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25fd90e569f543a08c37804c5c95dd31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.075677 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ee9e9053bc3f4441967dea174020753e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.075837 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee9e9053bc3f4441967dea174020753e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.078910 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f5233aff1e7b4284b470ae50d01aa607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.079005 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f5233aff1e7b4284b470ae50d01aa607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.080215 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d37ea38953124a22807cf32598d5f6d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.080296 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d37ea38953124a22807cf32598d5f6d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.113773 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:59.125679 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--webserver_interface=127.2.217.189
--webserver_port=38131
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250115 10:11:59.198259 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:59.215471 4341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:11:59.215703 4341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:11:59.215770 4341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:11:59.216913 4341 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:11:59.216946 4341 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:11:59.216979 4341 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:11:59.217007 4341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:11:59.217033 4341 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:11:59.217060 4341 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:11:59.219013 4341 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.217.189
--webserver_port=38131
--never_fsync=true
--heap_profile_path=/tmp/kudu.4341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:11:59.219226 4341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:11:59.219431 4341 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:11:59.224417 4348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:59.225205 4347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:11:59.226095 4350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:11:59.226781 4341 server_base.cc:1034] running on GCE node
I20250115 10:11:59.226987 4341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:11:59.227203 4341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:11:59.228339 4341 hybrid_clock.cc:648] HybridClock initialized: now 1736935919228330 us; error 24 us; skew 500 ppm
I20250115 10:11:59.229745 4341 webserver.cc:458] Webserver started at http://127.2.217.189:38131/ using document root <none> and password file <none>
I20250115 10:11:59.229945 4341 fs_manager.cc:362] Metadata directory not provided
I20250115 10:11:59.229997 4341 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:11:59.231084 4341 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20250115 10:11:59.231778 4356 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:59.231942 4341 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20250115 10:11:59.232012 4341 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:11:59.232301 4341 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:11:59.237511 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c1c600c53e0b472ea680a14709e39431"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.237675 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1c600c53e0b472ea680a14709e39431 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.237893 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8010a5c5fc7649488137372787886dd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.237996 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8010a5c5fc7649488137372787886dd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.238444 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_37c905a6d3fe455882ef028a290d6588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.238529 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37c905a6d3fe455882ef028a290d6588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.238631 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2deceee1167f46b8aea6e6f3fa075cf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.238677 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2deceee1167f46b8aea6e6f3fa075cf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.238452 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_75c0c070e7964172a05bccbe74583d27" } new_table_name: "default.Table_04a0490002d84d5c8f94d8773248afae" modify_external_catalogs: true
I20250115 10:11:59.239135 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8f6f68b7ceac410e8481f50a0a777d91" } modify_external_catalogs: true
I20250115 10:11:59.239183 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8f6f68b7ceac410e8481f50a0a777d91" } modify_external_catalogs: true
I20250115 10:11:59.249203 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 04d933672fa346b78532639c7340db31
W20250115 10:11:59.249321 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 37921fe63ff94f8983a6624dafaa7a27 has no consensus state
I20250115 10:11:59.250918 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a25a38956c0c4194aa7f716f1838f8da" } new_table_name: "default.Table_ae5773271b544b30abdf0b371cadb4f1" modify_external_catalogs: true
I20250115 10:11:59.251430 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9c73da03559241438bc5c29b8345bdbf" } modify_external_catalogs: true
I20250115 10:11:59.251482 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9c73da03559241438bc5c29b8345bdbf" } modify_external_catalogs: true
W20250115 10:11:59.251868 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29ed70f5db0e492eaf0c42e005736ad1 has no consensus state
I20250115 10:11:59.252748 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e1858e9961e247dd9a1d9bf7f62dc0f8
I20250115 10:11:59.258308 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5480f47dde5a46e38cb6e1ba31296171" } modify_external_catalogs: true
I20250115 10:11:59.258379 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5480f47dde5a46e38cb6e1ba31296171" } modify_external_catalogs: true
I20250115 10:11:59.259244 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 57361c7b5e18423085ddfed157d5a15b
I20250115 10:11:59.259526 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3400d62f96644293821b2c773c378d94" } new_table_name: "default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f" modify_external_catalogs: true
I20250115 10:11:59.260704 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ed54a8402c694be8ade88c6944c9456d" } new_table_name: "default.Table_f9f44fae06734ee2bf16e3b95dfeae31" modify_external_catalogs: true
I20250115 10:11:59.260771 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_01c2044b69094fbda80d5f7c2a6434eb" } modify_external_catalogs: true
I20250115 10:11:59.260823 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_01c2044b69094fbda80d5f7c2a6434eb" } modify_external_catalogs: true
W20250115 10:11:59.261065 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28861e966ce645878983bec6476255bb has no consensus state
I20250115 10:11:59.261346 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5b2d94414ce649b2b707680c82faaa14" } new_table_name: "default.Table_267cadbaca5042b591ea75c7a6273863" modify_external_catalogs: true
I20250115 10:11:59.261929 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1bfdc8992eec4615badc9fecf6deb62d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.262019 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bfdc8992eec4615badc9fecf6deb62d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.262746 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 016899ec9e7a44e48b5342335f1352e3 has no consensus state
I20250115 10:11:59.262814 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d0b9888f5bd348eea9020dc59a375a3f
W20250115 10:11:59.263089 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
I20250115 10:11:59.264813 4341 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:11:59.265134 4341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:11:59.265255 4341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:11:59.265265 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_499253a68cca4fe6aa6a7781913b360d" } modify_external_catalogs: true
I20250115 10:11:59.265316 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_499253a68cca4fe6aa6a7781913b360d" } modify_external_catalogs: true
I20250115 10:11:59.265771 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_dbaca6558a074caa8671547657908e94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.265892 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dbaca6558a074caa8671547657908e94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.266575 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 601a36ba22684ad883d274da06b8bf21
I20250115 10:11:59.269711 4341 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.189:36717
I20250115 10:11:59.269785 4408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.189:36717 every 8 connection(s)
I20250115 10:11:59.270089 4341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
I20250115 10:11:59.271448 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 4341
I20250115 10:11:59.272459 4409 sys_catalog.cc:263] Verifying existing consensus state
I20250115 10:11:59.273305 4409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap starting.
W20250115 10:11:59.274333 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 6135ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:59.276829 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e7a4050314f54e7eb39966cb227cdbb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.276953 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7a4050314f54e7eb39966cb227cdbb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.277479 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_044670dabfc04fca86dc38a6c067ea81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.277578 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_044670dabfc04fca86dc38a6c067ea81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.280248 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_423c7ade2b48460a9a3f81ae55f94b86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.280352 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_423c7ade2b48460a9a3f81ae55f94b86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.281641 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_8835d6fc868b4e7d8d734d91857c3153"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.281733 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8835d6fc868b4e7d8d734d91857c3153 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.281883 4409 log.cc:826] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Log is configured to *not* fsync() on all Append() calls
I20250115 10:11:59.283135 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
W20250115 10:11:59.286375 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:11:59.289858 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:59.296885 4409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=119 ignored=0} mutations{seen=271 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20250115 10:11:59.296988 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:11:59.297251 4409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap complete.
I20250115 10:11:59.299109 4409 raft_consensus.cc:357] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:59.299374 4409 raft_consensus.cc:738] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4346420bb4a5abb9cf66799e35565, State: Initialized, Role: FOLLOWER
I20250115 10:11:59.299479 4409 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 2.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:59.299697 4415 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:11:59.299768 4409 sys_catalog.cc:564] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:11:59.299787 4415 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:11:59.301606 4426 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:11:59.301673 4426 catalog_manager.cc:1553] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: success
I20250115 10:11:59.303023 4426 catalog_manager.cc:1575] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: acquiring CA information for follower catalog manager: success
I20250115 10:11:59.303401 4426 catalog_manager.cc:1603] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20250115 10:11:59.313810 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 6135ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:59.337067 4365 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" instance_seqno: 1736935911647047) as {username='slave'} at 127.2.217.131:52813; Asking this server to re-register.
I20250115 10:11:59.337414 3598 heartbeater.cc:463] Registering TS with master...
W20250115 10:11:59.337761 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:11:59.337831 4365 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:11:59.375970 4365 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" instance_seqno: 1736935911435877) as {username='slave'} at 127.2.217.129:48517; Asking this server to re-register.
I20250115 10:11:59.376304 3328 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:59.376693 4365 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:11:59.403494 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:11:59.448863 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c85f35b680824b1e82b624028c053124"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.449061 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c85f35b680824b1e82b624028c053124 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.449316 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0960f3d6facb43d1af4227b6767c4d4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.449421 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0960f3d6facb43d1af4227b6767c4d4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.450313 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_81cbb970502040e38384e43cc9935f43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:59.450352 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_79af526c42b24e2f8ae1da15d106cbe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.450417 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81cbb970502040e38384e43cc9935f43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.450459 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79af526c42b24e2f8ae1da15d106cbe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.450546 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d3583ad3abc947f0a3962b8b378118bf" } modify_external_catalogs: true
I20250115 10:11:59.450596 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d3583ad3abc947f0a3962b8b378118bf" } modify_external_catalogs: true
I20250115 10:11:59.450728 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0fbc9444d77d4b9d9958f5705235c722" } new_table_name: "default.Table_922dc1d8d8b044e680d01c155391bad7" modify_external_catalogs: true
W20250115 10:11:59.450951 3095 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:11:59.452379 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 166e6390660c485c99b2e115fd1b272f has no consensus state
I20250115 10:11:59.452558 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8148afe619054b87b62ee7d2353ba4c9
I20250115 10:11:59.453166 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b454320ac5c64584aa0d05e66e379bf8" } new_table_name: "default.Table_df67c4a565a145509d588cff0b78d16d" modify_external_catalogs: true
I20250115 10:11:59.453532 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8835d6fc868b4e7d8d734d91857c3153" } modify_external_catalogs: true
I20250115 10:11:59.453588 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8835d6fc868b4e7d8d734d91857c3153" } modify_external_catalogs: true
W20250115 10:11:59.454263 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91f2c04014a14b2084eb988e59040038 has no consensus state
I20250115 10:11:59.454777 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 0806965309fc45e09e0512e679098914
I20250115 10:11:59.459755 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cfcc820f912946a597a93d391a57bdca" } modify_external_catalogs: true
I20250115 10:11:59.459807 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cfcc820f912946a597a93d391a57bdca" } modify_external_catalogs: true
I20250115 10:11:59.460636 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet fc4ed27a7c1a49eea8f85763d8c86343
I20250115 10:11:59.461512 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f5233aff1e7b4284b470ae50d01aa607" } new_table_name: "default.Table_82dccea1c581459d84b2c919ff1b789f" modify_external_catalogs: true
W20250115 10:11:59.462435 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc423aad4e7a49eaacb21c73d5d8c341 has no consensus state
I20250115 10:11:59.463280 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_108893943cce4a42b22b197a7c89ba2b" } new_table_name: "default.Table_b333b72ccb514edca4fd75f9a3de369c" modify_external_catalogs: true
I20250115 10:11:59.463589 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c2a9db01931f49639eceb93ae586db30" } modify_external_catalogs: true
I20250115 10:11:59.463666 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c2a9db01931f49639eceb93ae586db30" } modify_external_catalogs: true
I20250115 10:11:59.463670 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c93e104be3004c1ebcfb3a75b1de30a8" } new_table_name: "default.Table_74abe75013584ccbb2acb8aa9426c527" modify_external_catalogs: true
I20250115 10:11:59.464322 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_476d7d58099946b3b1d48a45041646f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.464428 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_476d7d58099946b3b1d48a45041646f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.464557 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d5da557a18648719980469579c3979f has no consensus state
I20250115 10:11:59.464783 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5fadb7709b904d73aaff050112fc8fb5
W20250115 10:11:59.464906 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8600883e5a5449c59a747a6ef2121c61 has no consensus state
I20250115 10:11:59.467016 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae7b3f2b0d504f1287ca3242c5eac7b4" } modify_external_catalogs: true
I20250115 10:11:59.467094 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae7b3f2b0d504f1287ca3242c5eac7b4" } modify_external_catalogs: true
I20250115 10:11:59.467839 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4088e4c8b4774d9e996844102c1b0d02"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.467936 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4088e4c8b4774d9e996844102c1b0d02 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.468266 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 45a5054000054465bc566e172467ebfe
I20250115 10:11:59.478376 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_083c387389e741fa8d1c07011d4e7f5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.478502 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_083c387389e741fa8d1c07011d4e7f5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.479758 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e762e9011d9f4fe1856dc4923700d779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.479859 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e762e9011d9f4fe1856dc4923700d779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.482327 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_33008166333e4db9b699de7ead1b1c04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.482407 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33008166333e4db9b699de7ead1b1c04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.483170 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_196ff2f45dc94ec58c60a08545468524"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.483281 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_196ff2f45dc94ec58c60a08545468524 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.495777 3484 consensus_peers.cc:487] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:59.522961 3484 consensus_peers.cc:487] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f889cc1201404c8691bf01256750e244. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:11:59.551685 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 6411ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:59.581528 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:11:59.586688 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 6411ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:59.591830 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:11:59.642138 3092 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:11:59.652166 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9b65c31a83d94905b61daa407d4fad12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.652345 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b65c31a83d94905b61daa407d4fad12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.653330 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6c163f8cdde04145839e0eef2e7cb08e" } modify_external_catalogs: true
I20250115 10:11:59.653358 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f44ae96a00bd43a58431315a42d828b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:59.653430 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6c163f8cdde04145839e0eef2e7cb08e" } modify_external_catalogs: true
W20250115 10:11:59.653457 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f44ae96a00bd43a58431315a42d828b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.653492 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.653544 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.653733 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0960f3d6facb43d1af4227b6767c4d4d" } new_table_name: "default.Table_c458004b27914f779f0f85fcdb4a8eb4" modify_external_catalogs: true
I20250115 10:11:59.653756 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d8948c596494484d9102e89e2fae04bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.653823 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8948c596494484d9102e89e2fae04bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.654690 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b47be440050d400fb6d760b264f8e902" } new_table_name: "default.Table_d17d3bf6b75c4f399d0d2532e8366ff1" modify_external_catalogs: true
I20250115 10:11:59.655228 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e039abfa4f64cf18f1731b902195963" } modify_external_catalogs: true
I20250115 10:11:59.655293 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e039abfa4f64cf18f1731b902195963" } modify_external_catalogs: true
W20250115 10:11:59.656014 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc9bc6ae2d124e479908caaaf5dda959 has no consensus state
I20250115 10:11:59.656057 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d07d0f8a0e7f4a11a6a9be0413849fca
W20250115 10:11:59.656674 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1b423922cbb4a42bbdb4de025227118 has no consensus state
I20250115 10:11:59.656679 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet df637faaf5e642ca8647e98da0182a2f
I20250115 10:11:59.661087 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d53d0c9fb98143aa859dd0a6174aeda2" } modify_external_catalogs: true
I20250115 10:11:59.661163 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d53d0c9fb98143aa859dd0a6174aeda2" } modify_external_catalogs: true
I20250115 10:11:59.662106 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 9b8f7f4da78844199204c83ec0e6a0af
I20250115 10:11:59.662910 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_56df121bbd4d4e55acbaf7c2ac30957c" } new_table_name: "default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f" modify_external_catalogs: true
W20250115 10:11:59.663915 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08b7630b6c8b40d89b9829ffc8fc4b2b has no consensus state
I20250115 10:11:59.665372 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f6318eb4e7ee49319ddb6663d2f1646b" } modify_external_catalogs: true
I20250115 10:11:59.665454 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f6318eb4e7ee49319ddb6663d2f1646b" } modify_external_catalogs: true
I20250115 10:11:59.665386 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2a7aa569d3db483b816af99d0cf55071" } new_table_name: "default.Table_1e47eff6e8974d6f89777dcaa46dcd5e" modify_external_catalogs: true
I20250115 10:11:59.665407 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_44498f20bad64b63afb8f233226072a9" } new_table_name: "default.Table_7c60f942a2e347c3b1cc205cb99602e6" modify_external_catalogs: true
I20250115 10:11:59.666005 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_36a2b6b01e684edb9cd4c0f11317ea56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.666121 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36a2b6b01e684edb9cd4c0f11317ea56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.666512 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c045349a48644eda41ea8965b16174d has no consensus state
W20250115 10:11:59.666589 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 797447bdc44c459eb954136e576205e0 has no consensus state
I20250115 10:11:59.666698 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 642cd64ad8c44acb8566aeddd47fef9a
I20250115 10:11:59.668710 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f44ae96a00bd43a58431315a42d828b4" } modify_external_catalogs: true
I20250115 10:11:59.668789 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f44ae96a00bd43a58431315a42d828b4" } modify_external_catalogs: true
I20250115 10:11:59.669615 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet a703e63b54794981950733d5fc7c02c7
I20250115 10:11:59.669785 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.669881 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.679971 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_41584cc62411410fbfa50fc897fa446a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.680166 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41584cc62411410fbfa50fc897fa446a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.681413 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c3ef2cca176941c599f9e7d42f9a35ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.681525 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3ef2cca176941c599f9e7d42f9a35ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.683573 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b1b423922cbb4a42bbdb4de025227118 has no consensus state
I20250115 10:11:59.683979 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.684069 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.684710 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_00c57a31372740fe9620a054ec21d16e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.684867 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00c57a31372740fe9620a054ec21d16e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.688560 4415 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:11:59.688668 4415 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:11:59.688995 4415 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:11:59.689160 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:11:59.689302 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:11:59.689472 4357 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:11:59.689606 4415 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:11:59.710582 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:11:59.710884 4365 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" instance_seqno: 1736935911544757) as {username='slave'} at 127.2.217.130:54173; Asking this server to re-register.
I20250115 10:11:59.711104 3463 heartbeater.cc:463] Registering TS with master...
I20250115 10:11:59.711395 4365 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
W20250115 10:11:59.712153 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:11:59.766696 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:11:59.800647 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:11:59.823199 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 6684ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:11:59.854018 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 6684ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:11:59.854804 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f76e6f08c2594350b4acb1911c672c86"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.854993 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f76e6f08c2594350b4acb1911c672c86 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.855571 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b5612228d70d4480ad349647f31a97fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:11:59.855579 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0e71dac929ff4e3691493a57b54cc977"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.855698 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e71dac929ff4e3691493a57b54cc977 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.855695 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5612228d70d4480ad349647f31a97fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.855587 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6a8d2a07e6ae428a9f675332de315ee7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.856215 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a8d2a07e6ae428a9f675332de315ee7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.856555 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d90dfaad7fe042bc9ee4158afab6b64e" } new_table_name: "default.Table_7ec7928b8e0f409f895e2401238003ac" modify_external_catalogs: true
I20250115 10:11:59.856745 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_04a0490002d84d5c8f94d8773248afae" } modify_external_catalogs: true
I20250115 10:11:59.856791 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_04a0490002d84d5c8f94d8773248afae" } modify_external_catalogs: true
I20250115 10:11:59.857311 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df67c4a565a145509d588cff0b78d16d" } modify_external_catalogs: true
I20250115 10:11:59.857398 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_df67c4a565a145509d588cff0b78d16d" } modify_external_catalogs: true
I20250115 10:11:59.857316 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_40d71e6a37af45fa841120e98965fdc5" } new_table_name: "default.Table_fa021dc761814b88af467b382cc095a0" modify_external_catalogs: true
W20250115 10:11:59.858415 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3cba581c6884fd98503d4883b09d4a6 has no consensus state
I20250115 10:11:59.858433 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 37921fe63ff94f8983a6624dafaa7a27
W20250115 10:11:59.858992 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff89486cde3f49528e4007189911ce4e has no consensus state
I20250115 10:11:59.858999 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 91f2c04014a14b2084eb988e59040038
I20250115 10:11:59.862496 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_50877f0a57364b018ca287fbaabd9de3" } modify_external_catalogs: true
I20250115 10:11:59.862566 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_50877f0a57364b018ca287fbaabd9de3" } modify_external_catalogs: true
I20250115 10:11:59.863484 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 09a3fc9ca6ec4ea9bb72faa7bf388287
I20250115 10:11:59.864377 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7ec7928b8e0f409f895e2401238003ac" } new_table_name: "default.Table_c7469e27336a4059b3c66c48338b843c" modify_external_catalogs: true
W20250115 10:11:59.865254 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3cba581c6884fd98503d4883b09d4a6 has no consensus state
I20250115 10:11:59.867255 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c7469e27336a4059b3c66c48338b843c" } new_table_name: "default.Table_19e945af3350495ca3abc6261a945770" modify_external_catalogs: true
I20250115 10:11:59.867262 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_311dcc333209435c8c22dc455898f8ab" } modify_external_catalogs: true
I20250115 10:11:59.867270 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4e22610e2c0a4ca3acd428db96c08657" } new_table_name: "default.Table_b0e1e8fcf5844b97b462654cfd877ebe" modify_external_catalogs: true
I20250115 10:11:59.867358 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_311dcc333209435c8c22dc455898f8ab" } modify_external_catalogs: true
I20250115 10:11:59.867877 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1ca6c4ea1f824b1f9e350131149239eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.867985 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ca6c4ea1f824b1f9e350131149239eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.868243 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3cba581c6884fd98503d4883b09d4a6 has no consensus state
W20250115 10:11:59.868716 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df8876bed3cf4b11a5e31fc5e7d2d5f3 has no consensus state
I20250115 10:11:59.868754 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 573a35e8f86a4e0b941fe2bff0bb00ba
I20250115 10:11:59.870013 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7d65a58a0e548898ea42847f27b52b6" } modify_external_catalogs: true
I20250115 10:11:59.870071 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f7d65a58a0e548898ea42847f27b52b6" } modify_external_catalogs: true
I20250115 10:11:59.870981 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 2bbb62e941ac41e0a398455c224ea0be
I20250115 10:11:59.871202 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bc518eaf2d604c7e9ce859e76a6d72ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.871299 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc518eaf2d604c7e9ce859e76a6d72ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.881806 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ee808cbef43c429ba5a671726e74c5ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.881949 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee808cbef43c429ba5a671726e74c5ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.882977 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_058d5ec95f2a468ab9d1edf25995bdd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.883100 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_058d5ec95f2a468ab9d1edf25995bdd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.885536 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_109864ef03f142b0be396620ae7e15b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.885627 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_109864ef03f142b0be396620ae7e15b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:11:59.886484 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_25066f18e8044d3a88bc2548ecabd41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:11:59.886585 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25066f18e8044d3a88bc2548ecabd41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:11:59.982992 3484 consensus_peers.cc:487] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:12:00.006812 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:00.025012 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:12:00.026911 3484 consensus_peers.cc:487] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4db40559d7894bb8b80cf27b546c8f56. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:00.057667 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1069ce4193974a938cb848fe3f45dfd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.057840 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1069ce4193974a938cb848fe3f45dfd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.058530 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_41b41ec907cd4106a3e77b05b00a2a0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.058581 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_191db3a0a3d846fab97b1a823300233d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.058660 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b41ec907cd4106a3e77b05b00a2a0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.058702 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_191db3a0a3d846fab97b1a823300233d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.058553 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3aae7f2489e6423f8c2da3c5ae753cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.059175 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3aae7f2489e6423f8c2da3c5ae753cdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.060173 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_94e0be574bb84048bda97839efe3d8ef" } new_table_name: "default.Table_0e49cd66dc9547a3be177283a5c1cb9c" modify_external_catalogs: true
I20250115 10:12:00.060245 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_18a195103ffe459baa89d7e5f4c4d6ba" } modify_external_catalogs: true
I20250115 10:12:00.060276 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c5c133466f4340cea44704e70ddd4e1b" } modify_external_catalogs: true
I20250115 10:12:00.060292 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_18a195103ffe459baa89d7e5f4c4d6ba" } modify_external_catalogs: true
I20250115 10:12:00.060352 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c5c133466f4340cea44704e70ddd4e1b" } modify_external_catalogs: true
I20250115 10:12:00.060256 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_a3a38ccf73394d398f7be3b3c244cdc3" } new_table_name: "default.Table_6f44b54d97af46758931ddbc30f2ec77" modify_external_catalogs: true
I20250115 10:12:00.061726 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet c53f12f3a2c6457bb13b13cef42c89ad
W20250115 10:12:00.061823 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 347621ded3fd4380b1502d1a8c5b0c4a has no consensus state
W20250115 10:12:00.062294 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f8114f64577245c2b3ce70e4399de0c8 has no consensus state
I20250115 10:12:00.062332 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ea51bbe92f254a3ebbb802868c2e3832
I20250115 10:12:00.063860 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_afd1a870746a4d1daaf47da6739701b3" } modify_external_catalogs: true
I20250115 10:12:00.063946 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_afd1a870746a4d1daaf47da6739701b3" } modify_external_catalogs: true
I20250115 10:12:00.064836 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d1ee635d0b8f445cb1ba51ebe3eaea42
I20250115 10:12:00.065675 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_23bacf2445d441efbcea5c875466e3b1" } new_table_name: "default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d" modify_external_catalogs: true
W20250115 10:12:00.066669 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4ab498e7789d4ae18a9f62be2fa2514a has no consensus state
W20250115 10:12:00.067968 2944 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 01285bc3401243e9bcbba5062c80dbfa (table default.Table_15fcb62d8fc24406bc67064de58249e1 [id=d59fc98aa8544ff6adae0bb5b071ad82], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 01285bc3401243e9bcbba5062c80dbfa consensus state has no leader
I20250115 10:12:00.068779 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4233dd487670426c9760dd196a722c8d" } new_table_name: "default.Table_81d92177a29e4f1fa3c869df5e9beb21" modify_external_catalogs: true
I20250115 10:12:00.069243 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cf9fe3eee1c24d64a5c85788a7cdd0c6" } new_table_name: "default.Table_7829e841e23544828bd612b8a8f2fac7" modify_external_catalogs: true
I20250115 10:12:00.069430 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cbd83e1c807149529f12c7b6ea4eec85" } modify_external_catalogs: true
I20250115 10:12:00.069471 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cbd83e1c807149529f12c7b6ea4eec85" } modify_external_catalogs: true
I20250115 10:12:00.069780 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_202be7fd65b14cb88442d558eb06fed9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.069905 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_202be7fd65b14cb88442d558eb06fed9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.070489 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f55439e91f284175a59d35160668fa6c has no consensus state
I20250115 10:12:00.071012 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7e8c06101b444c838be0455e4c4ffc2f
W20250115 10:12:00.071051 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6fe929017262442094800c874183f5de has no consensus state
I20250115 10:12:00.071436 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1bfdc8992eec4615badc9fecf6deb62d" } modify_external_catalogs: true
I20250115 10:12:00.071494 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1bfdc8992eec4615badc9fecf6deb62d" } modify_external_catalogs: true
I20250115 10:12:00.072325 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet bc7203f15c5140b7a17a6b92c7603cb0
I20250115 10:12:00.072615 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3ae844209e2b49ceaed3f8446ee9a1bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.072712 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ae844209e2b49ceaed3f8446ee9a1bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.083977 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3632a48440e242ac8a768d8757c6f577"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.084147 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3632a48440e242ac8a768d8757c6f577 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.084549 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7c398537f01c41e38981374423585dfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.084687 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c398537f01c41e38981374423585dfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.086948 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d4e1d7ec46a147959f818f7758ef8a1a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.087082 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4e1d7ec46a147959f818f7758ef8a1a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.088073 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ae182259745941509eb82571c3c5a485"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.088203 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae182259745941509eb82571c3c5a485 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.091104 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 6951ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.096024 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:12:00.116240 3214 consensus_peers.cc:487] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e56c83017b54e65a066e8e377293b13. This is attempt 6: this message will repeat every 5th retry.
W20250115 10:12:00.124042 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:12:00.126175 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 6951ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.182212 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:12:00.191099 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:00.254284 4436 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:00.254369 4436 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:00.254529 4436 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:12:00.254701 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:12:00.254704 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:12:00.255151 4359 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:12:00.255263 4436 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:12:00.260480 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_74f3d626a2b545e1b38e5829028f0cbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.260627 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_74f3d626a2b545e1b38e5829028f0cbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.261618 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f85e1d83c871435a90c4376f638d34cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.261618 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e0f1a11511f24abc9a4d094b016522fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.261778 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f85e1d83c871435a90c4376f638d34cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.261811 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0f1a11511f24abc9a4d094b016522fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.261677 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5aa2546c19614c58aecd15fa26216c7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.262097 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5aa2546c19614c58aecd15fa26216c7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.262356 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_044670dabfc04fca86dc38a6c067ea81" } modify_external_catalogs: true
I20250115 10:12:00.262391 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7fe87b7c12db49ae8a3f15cf721fcc0a" } new_table_name: "default.Table_7222f6e9b4c2491a9b2c44aa8a11b716" modify_external_catalogs: true
I20250115 10:12:00.262419 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_044670dabfc04fca86dc38a6c067ea81" } modify_external_catalogs: true
I20250115 10:12:00.262916 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_33008166333e4db9b699de7ead1b1c04" } new_table_name: "default.Table_b985790fb06b4c9f916fc1665e0f9035" modify_external_catalogs: true
I20250115 10:12:00.262933 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_66411014c8114107a7b0e2bcea2e4844" } modify_external_catalogs: true
I20250115 10:12:00.263025 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_66411014c8114107a7b0e2bcea2e4844" } modify_external_catalogs: true
I20250115 10:12:00.264086 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 2597e1e4503649a89bd144ebe194bec5
W20250115 10:12:00.264091 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42b786c03fcb49eaafde89b98465230e has no consensus state
W20250115 10:12:00.264160 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4a0811cad8454c2e871aad2101224f34 has no consensus state
I20250115 10:12:00.264168 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet dcdee6f6895f41598ea3a8d49729697d
I20250115 10:12:00.265259 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7b8b7074c2ab4429bafb7621ca3dceff" } modify_external_catalogs: true
I20250115 10:12:00.265313 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7b8b7074c2ab4429bafb7621ca3dceff" } modify_external_catalogs: true
I20250115 10:12:00.266311 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 3687a386f7fc47b0ba3b2f4cb2538ea1
I20250115 10:12:00.267096 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c5f387d5f39f44caadb8c0ddfa6bf57c" } new_table_name: "default.Table_a8431f0582fa439e99b774778d8281ac" modify_external_catalogs: true
W20250115 10:12:00.268060 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6de4d57d53c648b491f66f257414394d has no consensus state
I20250115 10:12:00.271171 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_191db3a0a3d846fab97b1a823300233d" } new_table_name: "default.Table_8f7b91a3b92c401a871bfa219af7c377" modify_external_catalogs: true
I20250115 10:12:00.271523 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_35c3ea76e5264a00b4decd7516405fda" } modify_external_catalogs: true
I20250115 10:12:00.271539 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b985790fb06b4c9f916fc1665e0f9035" } new_table_name: "default.Table_c2adaa84739b46ce89b6276f774c9c01" modify_external_catalogs: true
I20250115 10:12:00.271605 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_35c3ea76e5264a00b4decd7516405fda" } modify_external_catalogs: true
I20250115 10:12:00.271757 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7ce9a506439a41599372c73d37cf0b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.271898 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ce9a506439a41599372c73d37cf0b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.272701 3099 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ac231c1b8e04e8788f7bc368a87acdb has no consensus state
I20250115 10:12:00.272778 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f85e1d83c871435a90c4376f638d34cc" } modify_external_catalogs: true
I20250115 10:12:00.272840 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f85e1d83c871435a90c4376f638d34cc" } modify_external_catalogs: true
W20250115 10:12:00.273401 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4a0811cad8454c2e871aad2101224f34 has no consensus state
I20250115 10:12:00.273422 3098 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8aaf94e0283d4c7ea3d40b0d7d5848ab
I20250115 10:12:00.273875 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e50f27a70ec94717a9d30c528e11b041
I20250115 10:12:00.274137 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_17ae29bb107c41b6add9cf42fc2508c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.274235 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17ae29bb107c41b6add9cf42fc2508c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.291244 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_ee355c3610514bdea292270d56d09f39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.291361 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee355c3610514bdea292270d56d09f39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.291761 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_a07cb910095f454d98b97363e9407cc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.291869 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2e652a03e1bc4c1dbd283ba700042ed8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.291980 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e652a03e1bc4c1dbd283ba700042ed8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.292117 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_3ae0dfef2e8e409fb00bd1244d5c6300"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.292186 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ae0dfef2e8e409fb00bd1244d5c6300 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.291877 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a07cb910095f454d98b97363e9407cc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.294304 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:12:00.337411 3094 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:12:00.360812 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 7223ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.398125 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 7223ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:00.463405 3094 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1df0da61f6314b39b612e24dc39907fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.463584 3094 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1df0da61f6314b39b612e24dc39907fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.463948 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_39ee61035d3b403086a48a76cb6370e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.464051 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39ee61035d3b403086a48a76cb6370e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.464073 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7ed5666a03e441d8bd5b20eb88d5910a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.464201 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ed5666a03e441d8bd5b20eb88d5910a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.465000 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_da80d7c2bd9a4955a1d674908d1b02ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.465070 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fdbd3c9e5aee44258ffda9b57326cd32" } modify_external_catalogs: true
W20250115 10:12:00.465106 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da80d7c2bd9a4955a1d674908d1b02ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.465134 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d8948c596494484d9102e89e2fae04bf" } new_table_name: "default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8" modify_external_catalogs: true
I20250115 10:12:00.465329 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_63a19f72d7be4c89ada9e78fe5395cad" } new_table_name: "default.Table_7028698e27db4b2b89342e4f189b6618" modify_external_catalogs: true
I20250115 10:12:00.465094 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f76e6f08c2594350b4acb1911c672c86" } modify_external_catalogs: true
I20250115 10:12:00.465499 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f76e6f08c2594350b4acb1911c672c86" } modify_external_catalogs: true
I20250115 10:12:00.465139 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fdbd3c9e5aee44258ffda9b57326cd32" } modify_external_catalogs: true
I20250115 10:12:00.466799 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5de330bd3f7648268bec4e12fa9fcfd2
I20250115 10:12:00.466821 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet fc6afffcd3364a3b90713cff3ab8cb70
W20250115 10:12:00.466773 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfe7181347114ccfbf62109147d182b3 has no consensus state
W20250115 10:12:00.466768 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 47205800bd074a9585c4af0f50055a13 has no consensus state
I20250115 10:12:00.466882 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f363410cf26a4ddbbba821d5ea06c2e6" } modify_external_catalogs: true
I20250115 10:12:00.466948 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f363410cf26a4ddbbba821d5ea06c2e6" } modify_external_catalogs: true
I20250115 10:12:00.467959 3092 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 7f530991d6b94a5e850df8af67e7a433
I20250115 10:12:00.468503 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ee355c3610514bdea292270d56d09f39" } new_table_name: "default.Table_7253ee8c9b8345828dee96f057f1203d" modify_external_catalogs: true
W20250115 10:12:00.469405 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c778d7be748405285068f36650902b0 has no consensus state
I20250115 10:12:00.473198 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_dfa91fc3d99a431984343d0752f41555" } new_table_name: "default.Table_f7f004c0e61c486b82180c7317e3b2cd" modify_external_catalogs: true
I20250115 10:12:00.473886 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1df0da61f6314b39b612e24dc39907fc" } modify_external_catalogs: true
I20250115 10:12:00.473958 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1df0da61f6314b39b612e24dc39907fc" } modify_external_catalogs: true
I20250115 10:12:00.473968 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b333b72ccb514edca4fd75f9a3de369c" } new_table_name: "default.Table_83d11d1609a44b49857dd3fd6489c4f6" modify_external_catalogs: true
W20250115 10:12:00.474108 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a577ace8245744d1a42938ddd99ce89b has no consensus state
I20250115 10:12:00.474390 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f9f44fae06734ee2bf16e3b95dfeae31" } modify_external_catalogs: true
I20250115 10:12:00.474447 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f9f44fae06734ee2bf16e3b95dfeae31" } modify_external_catalogs: true
I20250115 10:12:00.474696 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c26d7b0a2c464ea4bd7fe81719d44b19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.474798 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.475312 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 59ef88e34b994ed3a9992657eb88326e
W20250115 10:12:00.475327 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d5da557a18648719980469579c3979f has no consensus state
I20250115 10:12:00.475630 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f98e93dc1edf457d8b10bd2882677285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.475749 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f98e93dc1edf457d8b10bd2882677285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.475950 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 016899ec9e7a44e48b5342335f1352e3
I20250115 10:12:00.493202 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_730810b9477747d6a9ac4fabeceb1305"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.493351 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_730810b9477747d6a9ac4fabeceb1305 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.493742 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_be2c2888c6e541858428dbf2cbd8fcd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.493852 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be2c2888c6e541858428dbf2cbd8fcd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.494611 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d526916fb923487d905f4408bfac2c6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.494659 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6cc1bb874cf24449a25401e70c030f9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.494705 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d526916fb923487d905f4408bfac2c6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.494721 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cc1bb874cf24449a25401e70c030f9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.528247 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:12:00.533083 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:00.534989 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:12:00.584244 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:12:00.634303 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 7495ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.642602 3093 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:12:00.665181 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 7495ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:00.666404 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d049d9f9e2b94476a35abc8a6e30c57e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.666471 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c0fd8860abb44e408284630ba9b8e7bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.666597 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d049d9f9e2b94476a35abc8a6e30c57e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.666611 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0fd8860abb44e408284630ba9b8e7bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.666404 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_bf3a10f29ee148a58b0b2c6c981f5d05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.666695 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.667209 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_746d39dd624c4988b0521a7a6af0e896"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.667316 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_746d39dd624c4988b0521a7a6af0e896 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.667622 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b0e1e8fcf5844b97b462654cfd877ebe" } modify_external_catalogs: true
I20250115 10:12:00.667677 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_b0e1e8fcf5844b97b462654cfd877ebe" } modify_external_catalogs: true
I20250115 10:12:00.667680 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6a8d2a07e6ae428a9f675332de315ee7" } new_table_name: "default.Table_75074a0c849b4155b18cafeaaf7afba3" modify_external_catalogs: true
I20250115 10:12:00.667770 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4be05c9961a84c11a43d04ac34471aaa" } modify_external_catalogs: true
I20250115 10:12:00.667897 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7c398537f01c41e38981374423585dfa" } new_table_name: "default.Table_cecb6f1f23024733adb9c01fa147f123" modify_external_catalogs: true
I20250115 10:12:00.668171 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4be05c9961a84c11a43d04ac34471aaa" } modify_external_catalogs: true
I20250115 10:12:00.668519 3096 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55b0243539814cb48095741bb5d86056" } modify_external_catalogs: true
I20250115 10:12:00.668586 3096 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_55b0243539814cb48095741bb5d86056" } modify_external_catalogs: true
I20250115 10:12:00.669857 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_cd4e77ef27014f7c80a2c6f5328eeee6" } new_table_name: "default.Table_0d603960b0604f3ebe288c27daa21c6f" modify_external_catalogs: true
I20250115 10:12:00.670156 3096 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e5745f0a218a4fa1b390196bbb375e62
W20250115 10:12:00.670174 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aef601e6f3ef4ba387164c239c1139b0 has no consensus state
W20250115 10:12:00.670248 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a485231d2de4fab8b86b4900976c76c has no consensus state
I20250115 10:12:00.670256 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ca8a8ff0a3714522b354522b0b96074d
I20250115 10:12:00.670181 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet df8876bed3cf4b11a5e31fc5e7d2d5f3
W20250115 10:12:00.671316 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9305b7ac82cd4393b28017831a0687ff has no consensus state
I20250115 10:12:00.674604 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_1e47eff6e8974d6f89777dcaa46dcd5e" } new_table_name: "default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b" modify_external_catalogs: true
W20250115 10:12:00.675599 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c045349a48644eda41ea8965b16174d has no consensus state
I20250115 10:12:00.675879 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_80a3efd9c6c746f19ebf7a4bec4ce93b" } modify_external_catalogs: true
I20250115 10:12:00.675899 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d4e1d7ec46a147959f818f7758ef8a1a" } new_table_name: "default.Table_681746e4aa1447c2a068ff6e85d9b022" modify_external_catalogs: true
I20250115 10:12:00.675961 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_80a3efd9c6c746f19ebf7a4bec4ce93b" } modify_external_catalogs: true
I20250115 10:12:00.676420 3099 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8ecc7d4769ff44acae848eddaa22adea" } modify_external_catalogs: true
I20250115 10:12:00.676487 3099 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_8ecc7d4769ff44acae848eddaa22adea" } modify_external_catalogs: true
I20250115 10:12:00.676616 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_639a5d2bc7194b73ac99c75d2d4250fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.676707 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_639a5d2bc7194b73ac99c75d2d4250fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.677306 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_403c08da944445838245a588777ef636"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.677404 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_403c08da944445838245a588777ef636 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.677413 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 353b2e8e545e44768ec77f0cd0caa6e6 has no consensus state
I20250115 10:12:00.678035 3099 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b9fd6ff73bd642d88f30bbdc8d9b8852
I20250115 10:12:00.678112 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 60b1ba7c80c4404b8fed7df709f0aba2
I20250115 10:12:00.695073 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_837ed67810f741a2bfe30f928f9d978c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.695219 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_837ed67810f741a2bfe30f928f9d978c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.695781 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.695909 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.696400 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_519797d132c548c1bd255b0cff880e8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.696509 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_519797d132c548c1bd255b0cff880e8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.696416 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_e419dd2392434a8ab8def3765f49bf85"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.696693 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e419dd2392434a8ab8def3765f49bf85 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.703289 3085 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3402dc674ab0402f8e0bdd7b8db4b88d has no consensus state
W20250115 10:12:00.740844 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:12:00.851006 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:12:00.851315 3484 consensus_peers.cc:487] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec9406dc72bb4e489d76011a69ee2838. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:00.869432 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7b236b5787d24e138bfad3c30003b316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.869635 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b236b5787d24e138bfad3c30003b316 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.869786 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c9a4fdf26f954f40a3e13debd4b15d1b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.869904 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9a4fdf26f954f40a3e13debd4b15d1b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.869791 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_689c6e0ae4cf432b990949ed7f52b6bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:00.869809 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_452d4e866cf043a290b01f92fea60597"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.870121 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_689c6e0ae4cf432b990949ed7f52b6bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.870141 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_452d4e866cf043a290b01f92fea60597 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.871011 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb85a074d574465b97ceed23f101d3b9" } modify_external_catalogs: true
I20250115 10:12:00.871062 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ae182259745941509eb82571c3c5a485" } new_table_name: "default.Table_2f22e0d020084d739129671161bf56c1" modify_external_catalogs: true
I20250115 10:12:00.871095 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_fb85a074d574465b97ceed23f101d3b9" } modify_external_catalogs: true
I20250115 10:12:00.870991 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_f64ce56d7cb34a788274a8c962ac01d7" } new_table_name: "default.Table_38c5e256d4224d1a92280dc17f23f4f6" modify_external_catalogs: true
I20250115 10:12:00.872052 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7c60f942a2e347c3b1cc205cb99602e6" } modify_external_catalogs: true
I20250115 10:12:00.872067 3093 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e61dea524fce42cf9bc44855a823c5ea" } new_table_name: "default.Table_4ef75ebcfb674a44bb6ba3feaa65423d" modify_external_catalogs: true
I20250115 10:12:00.872123 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7c60f942a2e347c3b1cc205cb99602e6" } modify_external_catalogs: true
I20250115 10:12:00.872551 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c458004b27914f779f0f85fcdb4a8eb4" } modify_external_catalogs: true
I20250115 10:12:00.872615 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_c458004b27914f779f0f85fcdb4a8eb4" } modify_external_catalogs: true
W20250115 10:12:00.873061 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfe0522e3e664012a00ec78a09c2816c has no consensus state
I20250115 10:12:00.873064 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d355cdeed83d455b85796b58aa3def98
W20250115 10:12:00.873137 3096 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 019b97a0fa694f15b8ca224fb86803d9 has no consensus state
W20250115 10:12:00.873893 3093 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7a6ec9020494019a32cfb428554bd07 has no consensus state
I20250115 10:12:00.873967 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 797447bdc44c459eb954136e576205e0
I20250115 10:12:00.874148 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet fc9bc6ae2d124e479908caaaf5dda959
I20250115 10:12:00.876143 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_54476b841c2e4f53a2cdd390edb40b1c" } new_table_name: "default.Table_3230c32afd0b4ef4ac496bafefed3a27" modify_external_catalogs: true
W20250115 10:12:00.877094 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 575f1a39f8a54c4cb21cd17d562c0542 has no consensus state
I20250115 10:12:00.877846 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_e1748ad3656d4180bfcd25bf76e98589" } new_table_name: "default.Table_1887031edf1a4f3cb19a2050252610be" modify_external_catalogs: true
I20250115 10:12:00.878584 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_74f3d626a2b545e1b38e5829028f0cbe" } modify_external_catalogs: true
I20250115 10:12:00.878654 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_74f3d626a2b545e1b38e5829028f0cbe" } modify_external_catalogs: true
I20250115 10:12:00.878633 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_eb4ead8621074161aaa1f06e5ed31482"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.878749 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb4ead8621074161aaa1f06e5ed31482 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.878986 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4793bac69ad14dfa954ebc28370ce88a" } modify_external_catalogs: true
I20250115 10:12:00.879034 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4793bac69ad14dfa954ebc28370ce88a" } modify_external_catalogs: true
W20250115 10:12:00.879083 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet def9cfbc6f764499b1c6ac9b6845f5ed has no consensus state
I20250115 10:12:00.879379 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.879477 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.880160 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet e2b8bce86e3e48b8862e1b9bd3781bdd
I20250115 10:12:00.880712 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b867fd9b99a24e6a8d84596ec213c18a
W20250115 10:12:00.886639 3214 consensus_peers.cc:487] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13abbfea00154474b1082cf8ccd14899. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:00.892962 4439 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:00.893039 4439 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:00.893260 4439 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:12:00.893285 2966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:12:00.893448 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:12:00.893636 4359 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:12:00.893755 4439 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250115 10:12:00.897346 3095 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_2f58c731b132438cb439ebc2423f3769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.897502 3095 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f58c731b132438cb439ebc2423f3769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.897939 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.898042 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.898320 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_4913d89203604da2bdfae2e3e5703e8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.898408 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4913d89203604da2bdfae2e3e5703e8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:00.898659 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1c5f565cf47e469aa8fda3d4022e032f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:00.898789 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c5f565cf47e469aa8fda3d4022e032f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:00.908515 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 7762ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.921222 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:12:00.947979 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 7762ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:00.964263 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:12:00.970928 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:12:00.987838 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:00.989652 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:12:01.047819 3099 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:01.072551 3099 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_0c75970bf5ff4311a8bacd12c3ec98d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.072734 3099 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c75970bf5ff4311a8bacd12c3ec98d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.073230 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5fef87752fa54dd8aff528996785b3e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.073231 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_1be7cbef30a848f9ae2ee97dcfe1f267"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.073367 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fef87752fa54dd8aff528996785b3e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.073400 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.073979 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_689c6e0ae4cf432b990949ed7f52b6bb" } new_table_name: "default.Table_efa1540f57c4480ba745894780a97e2c" modify_external_catalogs: true
I20250115 10:12:01.074021 3092 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_af49e808ad814664b3703d748315b8a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.073987 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7222f6e9b4c2491a9b2c44aa8a11b716" } new_table_name: "default.Table_6d001ec2f3794667a04c38c18b76455e" modify_external_catalogs: true
W20250115 10:12:01.074138 3092 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af49e808ad814664b3703d748315b8a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.074172 3094 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3ae0dfef2e8e409fb00bd1244d5c6300" } modify_external_catalogs: true
I20250115 10:12:01.074223 3094 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3ae0dfef2e8e409fb00bd1244d5c6300" } modify_external_catalogs: true
I20250115 10:12:01.074709 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_7028698e27db4b2b89342e4f189b6618" } new_table_name: "default.Table_c37b56f295b54053b5ec08e31a9a30c0" modify_external_catalogs: true
I20250115 10:12:01.074740 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_519797d132c548c1bd255b0cff880e8d" } modify_external_catalogs: true
I20250115 10:12:01.074801 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_519797d132c548c1bd255b0cff880e8d" } modify_external_catalogs: true
I20250115 10:12:01.074988 3101 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ad5d7519568b4d63ac065be986a631d6" } modify_external_catalogs: true
I20250115 10:12:01.075071 3101 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_ad5d7519568b4d63ac065be986a631d6" } modify_external_catalogs: true
W20250115 10:12:01.075850 3095 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a076172bba8e4878978c318d441577bd has no consensus state
I20250115 10:12:01.075945 3094 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet ff179469462b40dcbdbd8140b0c6dc27
W20250115 10:12:01.076022 3096 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42b786c03fcb49eaafde89b98465230e has no consensus state
I20250115 10:12:01.076736 3100 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 8fccf66caad846bfa12e3b7adb6d29f3
I20250115 10:12:01.076833 3101 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet dc003ac03cad4643853bdede9ebea4e9
W20250115 10:12:01.076930 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfe7181347114ccfbf62109147d182b3 has no consensus state
I20250115 10:12:01.077531 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_639a5d2bc7194b73ac99c75d2d4250fc" } new_table_name: "default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea" modify_external_catalogs: true
W20250115 10:12:01.078398 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 50d2f7ec7d44422ebc35e29797bfd456 has no consensus state
I20250115 10:12:01.079519 3098 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_476d7d58099946b3b1d48a45041646f6" } new_table_name: "default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6" modify_external_catalogs: true
W20250115 10:12:01.080363 3098 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d42535a811dc420b94527f7d81efdd13 has no consensus state
I20250115 10:12:01.080766 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5c52b5a64d154706af4220cc2f273a98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.080775 3101 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_335f33157e694a15a82c2f61adb5c44f" } modify_external_catalogs: true
I20250115 10:12:01.080871 3101 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_335f33157e694a15a82c2f61adb5c44f" } modify_external_catalogs: true
W20250115 10:12:01.080878 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c52b5a64d154706af4220cc2f273a98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.081162 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b3d35645a38345699f01877647f097be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.081247 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3d35645a38345699f01877647f097be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.081354 3096 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_38c5e256d4224d1a92280dc17f23f4f6" } modify_external_catalogs: true
I20250115 10:12:01.081404 3096 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_38c5e256d4224d1a92280dc17f23f4f6" } modify_external_catalogs: true
I20250115 10:12:01.082298 3096 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 019b97a0fa694f15b8ca224fb86803d9
I20250115 10:12:01.082371 3101 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 371d9b55fbb24f4485819c273320450d
I20250115 10:12:01.099628 3101 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9898fe7b831a4d8089bb24f1bfd62223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.099824 3101 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9898fe7b831a4d8089bb24f1bfd62223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.100082 3214 consensus_peers.cc:487] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d92890d082e242ccae8ad4e40d056c74. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:01.100564 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.100669 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.101047 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7568c1ece38940aca3b40c2fc57908ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.101154 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_659f850eaa924b75a860677bd9ea33f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.101258 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_659f850eaa924b75a860677bd9ea33f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.101161 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7568c1ece38940aca3b40c2fc57908ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.133811 3098 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:12:01.185326 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 8045ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:01.223619 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 8045ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:01.275786 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_5c001d1a075b4563ad22475f486ee7a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.275786 3098 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f04269f5ae13474e959f42bee487f199"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.275832 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_eacc8529cfbb4cc9a2709dcfa100cfe8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.276010 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eacc8529cfbb4cc9a2709dcfa100cfe8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.276002 3098 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f04269f5ae13474e959f42bee487f199 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.276479 3101 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_6ed41c92835e4b20bc0d79a5a7573355"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.276522 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_3e97b770b64b4413b3b808004eabb08e" } new_table_name: "default.Table_2a85e863471b4a48b3b2c9df1bdd0341" modify_external_catalogs: true
I20250115 10:12:01.276556 3092 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_932d4668fbd84d81a86a019f6c18436f" } new_table_name: "default.Table_3178127dffd14c18a379abc82bbf56ed" modify_external_catalogs: true
W20250115 10:12:01.276573 3101 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ed41c92835e4b20bc0d79a5a7573355 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.276002 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c001d1a075b4563ad22475f486ee7a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.277010 3095 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d3f7fb9bf3ef42b6a545c1df40e90998" } modify_external_catalogs: true
I20250115 10:12:01.277074 3095 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_d3f7fb9bf3ef42b6a545c1df40e90998" } modify_external_catalogs: true
I20250115 10:12:01.277271 3093 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6d001ec2f3794667a04c38c18b76455e" } modify_external_catalogs: true
I20250115 10:12:01.277278 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_79bc843cce4c40f9ab7fdbe235dda6bf" } modify_external_catalogs: true
I20250115 10:12:01.277343 3093 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6d001ec2f3794667a04c38c18b76455e" } modify_external_catalogs: true
I20250115 10:12:01.277361 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_79bc843cce4c40f9ab7fdbe235dda6bf" } modify_external_catalogs: true
I20250115 10:12:01.277982 3100 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4997ef139ec249aa9dc295bb230fde29" } new_table_name: "default.Table_ebe6e92e27e34c1e8a0e162800b38f8f" modify_external_catalogs: true
W20250115 10:12:01.278286 3092 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d368093a74ba4918b0efcc3a909c3a07 has no consensus state
W20250115 10:12:01.278301 3094 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8093f8487b9844718707e2fcdd3ae833 has no consensus state
I20250115 10:12:01.278409 3095 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 752b8f0cd5b74bc5860108f87f033dca
I20250115 10:12:01.278829 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9898fe7b831a4d8089bb24f1bfd62223" } new_table_name: "default.Table_4543989449c243fcad6ffbbd87796a81" modify_external_catalogs: true
I20250115 10:12:01.279104 3093 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 42b786c03fcb49eaafde89b98465230e
I20250115 10:12:01.279104 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet d0a12a58c42a4ef9b674c6e3eaacdf6e
W20250115 10:12:01.279881 3100 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b6a615c0c5d4815b540d81ef3357eb4 has no consensus state
W20250115 10:12:01.280310 3096 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d21906d23acc4ab8b81eceb87ead049f has no consensus state
I20250115 10:12:01.280805 3096 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_eacc8529cfbb4cc9a2709dcfa100cfe8" } new_table_name: "default.Table_5a9b7a75ae964db6a818d54d77e2ced1" modify_external_catalogs: true
W20250115 10:12:01.281678 3096 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a357badf1cd43e384d2de92e3413898 has no consensus state
I20250115 10:12:01.282142 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_056453db36d0482f9828ea16ed3767c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.282222 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_056453db36d0482f9828ea16ed3767c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.282737 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_c09214a5f550425b928dcb0caf8ab823"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.282773 3097 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4913d89203604da2bdfae2e3e5703e8e" } modify_external_catalogs: true
I20250115 10:12:01.282850 3097 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_4913d89203604da2bdfae2e3e5703e8e" } modify_external_catalogs: true
W20250115 10:12:01.282853 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c09214a5f550425b928dcb0caf8ab823 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.283458 3096 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5fef87752fa54dd8aff528996785b3e6" } modify_external_catalogs: true
I20250115 10:12:01.283524 3096 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_5fef87752fa54dd8aff528996785b3e6" } modify_external_catalogs: true
I20250115 10:12:01.284029 3097 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 5dc9cd11bbe245cab8f4ee598f2e8914
I20250115 10:12:01.284538 3096 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 91dd08c73b464555bc1224f5618f9060
I20250115 10:12:01.301924 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_7cc7f5b2700343b7b48aae25a2f75b37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.302045 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cc7f5b2700343b7b48aae25a2f75b37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.302623 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_d90a16759f704e54a0e7cdef7960d41a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.302762 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d90a16759f704e54a0e7cdef7960d41a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.303438 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_46f968c8803347b8b7339b5602e32031"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.303544 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46f968c8803347b8b7339b5602e32031 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.303920 3100 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_583dc203fd4940dfb099846022f31e33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.304013 3100 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_583dc203fd4940dfb099846022f31e33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.336295 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:12:01.363397 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:01.382450 2918 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskjHaIeY/build/release/bin/kudu with pid 2926
W20250115 10:12:01.452204 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 8321ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:01.463814 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:12:01.478296 3100 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:01.478358 3096 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_b439b608419f459f8f77a0800a4ef734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.478394 3097 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_f9afec8418444e6a9efd2a70f734c330"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.478500 3096 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b439b608419f459f8f77a0800a4ef734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:01.478526 3097 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9afec8418444e6a9efd2a70f734c330 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.479081 3100 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6bf1b753120b4945929a94625d231802" } modify_external_catalogs: true
I20250115 10:12:01.479135 3095 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_46f968c8803347b8b7339b5602e32031" } new_table_name: "default.Table_547a65dbda1749c082cfb2aa9f2a2285" modify_external_catalogs: true
I20250115 10:12:01.479174 3101 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_9cb4c818781b40d58f604ee6907db77b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:01.479243 3101 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cb4c818781b40d58f604ee6907db77b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.479326 3094 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_2e652a03e1bc4c1dbd283ba700042ed8" } new_table_name: "default.Table_4b98590d43434ddb8446bd4c522dee69" modify_external_catalogs: true
W20250115 10:12:01.479503 3085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.217.190:46859: connect: Connection refused (error 111)
I20250115 10:12:01.479142 3093 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46172:
name: "default.Table_81168f61f4744059b5716b277280c70c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:01.479148 3100 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_6bf1b753120b4945929a94625d231802" } modify_external_catalogs: true
W20250115 10:12:01.479773 3093 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81168f61f4744059b5716b277280c70c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:01.479660 3092 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0c75970bf5ff4311a8bacd12c3ec98d7" } modify_external_catalogs: true
I20250115 10:12:01.479935 3092 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_0c75970bf5ff4311a8bacd12c3ec98d7" } modify_external_catalogs: true
I20250115 10:12:01.480087 3098 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9557727fc0e5449ba95961d750b88bc4" } modify_external_catalogs: true
I20250115 10:12:01.480146 3098 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_9557727fc0e5449ba95961d750b88bc4" } modify_external_catalogs: true
W20250115 10:12:01.480230 3085 consensus_peers.cc:487] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b -> Peer 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859): Couldn't send request to peer 88f5e7c003a641128acc22b394ab62c7. Status: Network error: Client connection negotiation failed: client connection to 127.2.217.190:46859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:01.480533 3099 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46172:
table { table_name: "default.Table_745464477b4d4be793cf32e945afc9f3" } new_table_name: "default.Table_b4cf6a94f66841f9b76c78de6287614e" modify_external_catalogs: true
W20250115 10:12:01.482897 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 8321ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:01.706322 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d42535a811dc420b94527f7d81efdd13 has no consensus state
W20250115 10:12:01.712189 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 8580ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:01.740682 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 8580ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:01.971747 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 8838ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:02.008108 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 8838ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:02.066426 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.190:46859
--webserver_interface=127.2.217.190
--webserver_port=40155
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20250115 10:12:02.150364 4446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:12:02.150712 4446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 10:12:02.150766 4446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 10:12:02.152482 4446 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:12:02.152522 4446 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:12:02.152542 4446 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:12:02.152556 4446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:12:02.152571 4446 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:12:02.152585 4446 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:12:02.154075 4446 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.190:46859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.217.190
--webserver_port=40155
--never_fsync=true
--heap_profile_path=/tmp/kudu.4446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:12:02.154286 4446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:12:02.154496 4446 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 10:12:02.159026 4454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:12:02.159835 4451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 10:12:02.160633 4452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:12:02.161383 4446 server_base.cc:1034] running on GCE node
I20250115 10:12:02.161571 4446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:12:02.161741 4446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:12:02.162889 4446 hybrid_clock.cc:648] HybridClock initialized: now 1736935922162873 us; error 25 us; skew 500 ppm
I20250115 10:12:02.171861 4446 webserver.cc:458] Webserver started at http://127.2.217.190:40155/ using document root <none> and password file <none>
I20250115 10:12:02.172056 4446 fs_manager.cc:362] Metadata directory not provided
I20250115 10:12:02.172122 4446 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:12:02.173235 4446 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:02.173871 4460 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:02.174036 4446 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:02.174103 4446 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
uuid: "88f5e7c003a641128acc22b394ab62c7"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:12:02.174369 4446 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:12:02.191967 4446 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:12:02.192241 4446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:12:02.192338 4446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 10:12:02.196564 4446 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.190:46859
I20250115 10:12:02.196596 4512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.190:46859 every 8 connection(s)
I20250115 10:12:02.196934 4446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-0/data/info.pb
I20250115 10:12:02.198289 4513 sys_catalog.cc:263] Verifying existing consensus state
I20250115 10:12:02.198812 4513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Bootstrap starting.
I20250115 10:12:02.201735 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 4446
I20250115 10:12:02.209509 3462 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
I20250115 10:12:02.212774 4513 log.cc:826] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Log is configured to *not* fsync() on all Append() calls
W20250115 10:12:02.247920 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 9106ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:02.273077 3327 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
W20250115 10:12:02.281298 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 9106ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:02.296058 4513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1181 overwritten=10 applied=1171 ignored=0} inserts{seen=992 ignored=0} mutations{seen=1074 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250115 10:12:02.296411 4513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Bootstrap complete.
I20250115 10:12:02.298426 4513 raft_consensus.cc:357] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.298717 4513 raft_consensus.cc:738] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f5e7c003a641128acc22b394ab62c7, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.298836 4513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1171, Last appended: 2.1171, Last appended by leader: 1171, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.299165 4513 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:12:02.299121 4520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.299222 4520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:02.302404 4531 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:12:02.302522 4531 catalog_manager.cc:1553] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: loading cluster ID for follower catalog manager: success
I20250115 10:12:02.304437 4531 catalog_manager.cc:1575] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: acquiring CA information for follower catalog manager: success
I20250115 10:12:02.305549 4531 catalog_manager.cc:1603] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:12:02.317713 4477 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" instance_seqno: 1736935911435877) as {username='slave'} at 127.2.217.129:45983; Asking this server to re-register.
I20250115 10:12:02.318068 3327 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:02.318513 4477 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:02.379824 3597 heartbeater.cc:346] Connected to a master server at 127.2.217.190:46859
I20250115 10:12:02.380430 4477 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" instance_seqno: 1736935911647047) as {username='slave'} at 127.2.217.131:49947; Asking this server to re-register.
I20250115 10:12:02.380719 3597 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:02.381052 4477 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:02.408317 4536 raft_consensus.cc:491] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:02.408406 4536 raft_consensus.cc:513] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.408542 4536 leader_election.cc:290] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88f5e7c003a641128acc22b394ab62c7 (127.2.217.190:46859), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:12:02.408882 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:12:02.411669 4487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "efd4346420bb4a5abb9cf66799e35565" candidate_term: 3 candidate_status { last_received { term: 2 index: 222 } } ignore_live_leader: false dest_uuid: "88f5e7c003a641128acc22b394ab62c7" is_pre_election: true
I20250115 10:12:02.411832 4487 raft_consensus.cc:2405] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate efd4346420bb4a5abb9cf66799e35565 for term 3 because replica has last-logged OpId of term: 2 index: 1171, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 222.
I20250115 10:12:02.412017 4357 leader_election.cc:304] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efd4346420bb4a5abb9cf66799e35565; no voters: 88f5e7c003a641128acc22b394ab62c7, cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:12:02.412108 4536 raft_consensus.cc:2743] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250115 10:12:02.514412 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 9378ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:02.550026 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 9378ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:02.559772 3214 consensus_peers.cc:487] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:02.702862 4520 raft_consensus.cc:491] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:02.703011 4520 raft_consensus.cc:513] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.703334 4520 leader_election.cc:290] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:12:02.703554 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1171 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" is_pre_election: true
I20250115 10:12:02.703562 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1171 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565" is_pre_election: true
I20250115 10:12:02.703732 4379 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 2.
I20250115 10:12:02.703933 4463 leader_election.cc:304] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88f5e7c003a641128acc22b394ab62c7, efd4346420bb4a5abb9cf66799e35565; no voters: cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:12:02.704071 4520 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250115 10:12:02.704144 4520 raft_consensus.cc:491] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:02.704176 4520 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:12:02.705235 4520 raft_consensus.cc:513] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.705350 4520 leader_election.cc:290] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 3 election: Requested vote from peers efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717), cdb1ea5a27ca44baa3b0fe127143df0b (127.2.217.188:38283)
I20250115 10:12:02.705490 4379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1171 } } ignore_live_leader: false dest_uuid: "efd4346420bb4a5abb9cf66799e35565"
I20250115 10:12:02.705511 3111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f5e7c003a641128acc22b394ab62c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1171 } } ignore_live_leader: false dest_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b"
I20250115 10:12:02.705569 4379 raft_consensus.cc:3054] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:12:02.706655 4379 raft_consensus.cc:2463] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f5e7c003a641128acc22b394ab62c7 in term 3.
I20250115 10:12:02.706799 4463 leader_election.cc:304] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88f5e7c003a641128acc22b394ab62c7, efd4346420bb4a5abb9cf66799e35565; no voters: cdb1ea5a27ca44baa3b0fe127143df0b
I20250115 10:12:02.706887 4520 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 3 FOLLOWER]: Leader election won for term 3
I20250115 10:12:02.707000 4520 raft_consensus.cc:695] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [term 3 LEADER]: Becoming Leader. State: Replica: 88f5e7c003a641128acc22b394ab62c7, State: Running, Role: LEADER
I20250115 10:12:02.707078 4520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1171, Committed index: 1171, Last appended: 2.1171, Last appended by leader: 1171, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.707348 4538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.707442 4538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:12:02.707564 4540 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250115 10:12:02.708180 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 [id=0041976377904d41939a1ea9a5fcc07e]
I20250115 10:12:02.708240 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_81cbb970502040e38384e43cc9935f43 [id=0097f32bdaf5478bbdd7cb6e58c2e223]
I20250115 10:12:02.708281 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6cc1bb874cf24449a25401e70c030f9e [id=0161accf9e4545e688d747883ea0114d]
I20250115 10:12:02.708323 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2648dfb12d924eda9b18368da8df24a5 [id=0298d09bab6149af8c9c418b3d064b97]
I20250115 10:12:02.708388 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0c75970bf5ff4311a8bacd12c3ec98d7 [id=03162de587a24aef8dc6cfcb976fb9b1]
I20250115 10:12:02.708426 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]
I20250115 10:12:02.708461 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]
I20250115 10:12:02.708509 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]
I20250115 10:12:02.708541 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43]
I20250115 10:12:02.708578 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5b1fd5cfd1424151839bc16fb5c88670 [id=05b392915cd34cf9af16ae61741e53f1]
I20250115 10:12:02.708607 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7f11f45ebda04d1d934c330ec17ceccf [id=05d6c7181b804de9ac10c342612b7e2c]
I20250115 10:12:02.708654 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406]
I20250115 10:12:02.708686 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2deceee1167f46b8aea6e6f3fa075cf7 [id=093d224f08744cf38ab4f22d0c0b6e97]
I20250115 10:12:02.708717 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4c4f267ca02940d58bc4543ec80f03ce [id=0949f4256757430885ac07328c985705]
I20250115 10:12:02.708772 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7b236b5787d24e138bfad3c30003b316 [id=0b1b8cdb67244dc19aed82671327d212]
I20250115 10:12:02.708813 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_16575f283a0b491da19099917b25019d [id=0c3701a4f04444b7bd4bd5e4e0fcd016]
I20250115 10:12:02.708833 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]
I20250115 10:12:02.708861 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57]
I20250115 10:12:02.708906 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e762e9011d9f4fe1856dc4923700d779 [id=0ed50e4d34254318a993c3268808ce39]
I20250115 10:12:02.708945 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d59e20c98bd84db48c45d49171eff4fd [id=10b43b32ad174b12b4a2da8cceaaeac1]
I20250115 10:12:02.708978 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]
I20250115 10:12:02.709020 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7ce9a506439a41599372c73d37cf0b15 [id=147b41dfa10b45599d423ceac25e8094]
I20250115 10:12:02.709067 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c44d243878514ff19a0f78c47f415f6a [id=15c6ceedaafb48a4b75f0e3838295b0f]
I20250115 10:12:02.709120 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070]
I20250115 10:12:02.709152 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f04269f5ae13474e959f42bee487f199 [id=195139f257d2494791df1002a43aee3f]
I20250115 10:12:02.709193 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]
I20250115 10:12:02.709228 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_37e85cc42de44c9ea1e9d33a94d70be8 [id=1a36a0dbf9eb490ba53332a260571b48]
I20250115 10:12:02.709321 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]
I20250115 10:12:02.709367 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_080e6f46b4a4430fbbe8ae52c0055a43 [id=1faa87a45ad24ea7a41e678ed5b4c8d9]
I20250115 10:12:02.709415 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]
I20250115 10:12:02.709468 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_79af526c42b24e2f8ae1da15d106cbe9 [id=22fbb91517214bfeb4c6d732904ac18c]
I20250115 10:12:02.709507 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf [id=23c0981b39e2410196a18d8842f329b3]
I20250115 10:12:02.709535 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]
I20250115 10:12:02.709565 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 [id=25897e7460ce44ab84a870fcae962481]
I20250115 10:12:02.709597 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ded364210b934ba3a4824b517b6db826 [id=268b8b77011f466abc17b7600aceadd6]
I20250115 10:12:02.709647 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_eb4ead8621074161aaa1f06e5ed31482 [id=270edc3310cd4a09aaa6f46e4f889188]
I20250115 10:12:02.709683 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]
I20250115 10:12:02.709721 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_9557727fc0e5449ba95961d750b88bc4 [id=2b92b0f8a8574e8c810ce7062c65acae]
I20250115 10:12:02.709757 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f448ab1cfae2403393f3884d0a50fd61 [id=2cd4c5e9ab1f4e018b47117186f14066]
I20250115 10:12:02.709802 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7cc7f5b2700343b7b48aae25a2f75b37 [id=2d9f80bd6fda4b22af4bb90503c90a4f]
I20250115 10:12:02.709852 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_659f850eaa924b75a860677bd9ea33f7 [id=2e0b0b4cbc9f4f678d7db889c9be970c]
I20250115 10:12:02.709990 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ee808cbef43c429ba5a671726e74c5ac [id=2e12df36e70c48bdb039351c533e802a]
I20250115 10:12:02.710085 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e]
I20250115 10:12:02.710142 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0d43a0379fa042929ffb70c09407e4f2 [id=3094f0694b4b4f308b40e4ffe25cfbf4]
I20250115 10:12:02.710214 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]
I20250115 10:12:02.710273 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d90a16759f704e54a0e7cdef7960d41a [id=33c05baa94c64e3d8139905db7e98f85]
I20250115 10:12:02.710328 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]
I20250115 10:12:02.710376 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]
I20250115 10:12:02.710482 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]
I20250115 10:12:02.710358 4477 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" instance_seqno: 1736935911544757) as {username='slave'} at 127.2.217.130:33727; Asking this server to re-register.
I20250115 10:12:02.710536 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d2c4a3b2009e4f548be4457d598fff95 [id=386128b91ada4ecca121f2d2053390a8]
I20250115 10:12:02.710570 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]
I20250115 10:12:02.710608 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]
I20250115 10:12:02.710644 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b7f5565de66f4ea5884b8c57e72d6613 [id=39e850f5f01a452fba3674612dbc6548]
I20250115 10:12:02.710728 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d63e50fd58fd4335ba0165af0f856032 [id=3bedd46181134cf7bdc3b443a5aff915]
I20250115 10:12:02.710754 3462 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:02.710810 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883]
I20250115 10:12:02.710880 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1eacbd293bea443fa0780ba898123200 [id=3d13f917c9a04d4cb429be32533ec2f0]
I20250115 10:12:02.710924 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]
I20250115 10:12:02.711067 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]
I20250115 10:12:02.711072 4477 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:02.711165 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]
I20250115 10:12:02.711216 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]
I20250115 10:12:02.711277 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]
I20250115 10:12:02.711323 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e]
I20250115 10:12:02.711380 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]
I20250115 10:12:02.711412 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f6a790f7709f440d98f1567067ed68a2 [id=47674ee5aac44634ba202fe90d14d49d]
I20250115 10:12:02.711455 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4e44e0cd2af54f0585de9211108521c0 [id=4a0764b4a46f4278973b2c7b7a1cf35f]
I20250115 10:12:02.711491 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2]
I20250115 10:12:02.711526 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_dbaca6558a074caa8671547657908e94 [id=4c4374e6c65149d087e5507ced04d9fc]
I20250115 10:12:02.711562 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]
I20250115 10:12:02.711614 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]
I20250115 10:12:02.711654 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]
I20250115 10:12:02.711685 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]
I20250115 10:12:02.711733 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]
I20250115 10:12:02.711764 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c73488a369ec4bc196196444fa9c3632 [id=4fdef59a83b241a785c3ed32b8eeb977]
I20250115 10:12:02.711812 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ee9e9053bc3f4441967dea174020753e [id=50e32bfecf514cb0972986f128ff095a]
I20250115 10:12:02.711860 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]
I20250115 10:12:02.711898 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]
I20250115 10:12:02.711935 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_452d4e866cf043a290b01f92fea60597 [id=56ba6004943340809edbf23f7af8bf71]
I20250115 10:12:02.711968 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]
I20250115 10:12:02.712007 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]
I20250115 10:12:02.712040 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_196ff2f45dc94ec58c60a08545468524 [id=588ca457130b479db3f999ed2f492120]
I20250115 10:12:02.712088 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_681746e4aa1447c2a068ff6e85d9b022 [id=59ace488897c42a3a28b6118667f6403]
I20250115 10:12:02.712119 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]
I20250115 10:12:02.712164 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]
I20250115 10:12:02.712196 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_00c57a31372740fe9620a054ec21d16e [id=5da2380bb07b43758f04bbd828525b53]
I20250115 10:12:02.712231 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_746d39dd624c4988b0521a7a6af0e896 [id=5e846a21e7a54dcda298097ce402c196]
I20250115 10:12:02.712267 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]
I20250115 10:12:02.712302 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 [id=5f8793d7d917468b822398f75b3c7b36]
I20250115 10:12:02.712333 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]
I20250115 10:12:02.712379 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_780d6792486f4d65bb71098c78eec010 [id=65d6de2c925e407094df78186e79ddf7]
I20250115 10:12:02.712410 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6]
I20250115 10:12:02.712455 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]
I20250115 10:12:02.712482 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]
I20250115 10:12:02.712514 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c09214a5f550425b928dcb0caf8ab823 [id=694250c24a29434a8486d3679391c59c]
I20250115 10:12:02.712543 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0bfecbf8f6db434c853e2fc9024e5c2d [id=69843267a5254af281348136b8df9daa]
I20250115 10:12:02.712586 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c85f35b680824b1e82b624028c053124 [id=6d6c1ae6d0114e97bc24eaedecf1c904]
I20250115 10:12:02.712622 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf]
I20250115 10:12:02.712661 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]
I20250115 10:12:02.712692 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b1441ec916974e33a6e5a290afd937f2 [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]
I20250115 10:12:02.712721 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_41584cc62411410fbfa50fc897fa446a [id=6f19ad27a4ef4fe4b447cb2eea68d043]
I20250115 10:12:02.712754 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_109864ef03f142b0be396620ae7e15b2 [id=70979ea2e90c4564947e7bfcf4d59e72]
I20250115 10:12:02.712807 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]
I20250115 10:12:02.712836 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a883df24d37b447baa84acc5f6c62d45 [id=721c4375c79a45feb26f677535de05c2]
I20250115 10:12:02.712865 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8]
I20250115 10:12:02.712924 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5c52b5a64d154706af4220cc2f273a98 [id=75a3cabc6ab0415992e902b02ea54d47]
I20250115 10:12:02.712965 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a3b73807076c4f0aabf9e6f82eca2bef [id=791960255cad40b1814de43ae15c9ee7]
I20250115 10:12:02.713018 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]
I20250115 10:12:02.713104 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_93ee920c32874d4888ddf9c25fbdff06 [id=7be4cd372cf148b6ad10b57523e826ea]
I20250115 10:12:02.713141 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b5612228d70d4480ad349647f31a97fc [id=7c32f09490d24567885955928d4e3d75]
I20250115 10:12:02.713196 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_36a2b6b01e684edb9cd4c0f11317ea56 [id=7e11745e5dd243d69cb4463cc11edf26]
I20250115 10:12:02.713248 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]
I20250115 10:12:02.713285 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_37c905a6d3fe455882ef028a290d6588 [id=7f25a9ec0c1d4d2ab8e54772756694be]
I20250115 10:12:02.713336 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]
I20250115 10:12:02.713379 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b3d35645a38345699f01877647f097be [id=7ffb156709624e9bace6cb13a4d83007]
I20250115 10:12:02.713405 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]
I20250115 10:12:02.713442 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7ed5666a03e441d8bd5b20eb88d5910a [id=81d22d650beb49f5827086b74342581e]
I20250115 10:12:02.713474 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_403c08da944445838245a588777ef636 [id=833c3f479c5b49b4978b5d508bb1d101]
I20250115 10:12:02.713510 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f469479d54a445cc94bea2d511828e08 [id=83adf17cb14849c7839e7682093de0c9]
I20250115 10:12:02.713548 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f1faf951819049d9aac897e67c029beb [id=86cef7da77da456089b46d9647ee7e3f]
I20250115 10:12:02.713582 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 [id=86e6124c18724ba1bc7fc8c8772d1fc5]
I20250115 10:12:02.713621 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]
I20250115 10:12:02.713657 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_af49e808ad814664b3703d748315b8a4 [id=89304ed813b04d0682ad058ee2168202]
I20250115 10:12:02.713697 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]
I20250115 10:12:02.713730 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb [id=8afca2ed08bc4ea392257397837f8db0]
I20250115 10:12:02.713773 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]
I20250115 10:12:02.713819 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 [id=8d38c2511ddc4940b470805a54f8b1c4]
I20250115 10:12:02.713881 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]
I20250115 10:12:02.713914 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_25fd90e569f543a08c37804c5c95dd31 [id=93f0f05ce5b44db1949a47c0d0bab532]
I20250115 10:12:02.713949 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_083c387389e741fa8d1c07011d4e7f5d [id=940ec8ab0c8a48be99dbb34e0ef6d263]
I20250115 10:12:02.713979 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_837ed67810f741a2bfe30f928f9d978c [id=94b2e5bbafba4dd986b674d0041216e0]
I20250115 10:12:02.714025 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d0fcc51d02e64d42831f872a5b3b02ee [id=965a2b7a6e3241afac6499010b596aa5]
I20250115 10:12:02.714058 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_79f48757c279457faeca60d711a7d129 [id=96c9813386964880ad745a3cd4d857e2]
I20250115 10:12:02.714102 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]
I20250115 10:12:02.714133 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5cde3d62bc8248f3be5fa8764025bbe0 [id=9871ed3c25464e07acb51a093f7c15d5]
I20250115 10:12:02.714165 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 [id=988e12ca3c094601a1189d8558614dae]
I20250115 10:12:02.714213 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_745464477b4d4be793cf32e945afc9f3 [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]
I20250115 10:12:02.714257 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c0ff9042b1554e91a840ad8adde05cc9 [id=a02b68d5690c4d22bd6228e2cda045c0]
I20250115 10:12:02.714299 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe]
I20250115 10:12:02.714331 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ca7bc6e893be4465b1582ee64173500c [id=a1b3933dfb524284b565d94d1e849821]
I20250115 10:12:02.714390 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]
I20250115 10:12:02.714427 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]
I20250115 10:12:02.714463 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]
I20250115 10:12:02.714500 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f98e93dc1edf457d8b10bd2882677285 [id=a49d7416b0c84365bc92418b8d448a65]
I20250115 10:12:02.714532 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842]
I20250115 10:12:02.714568 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_058d5ec95f2a468ab9d1edf25995bdd8 [id=a4e90033d1204cb8b8fbcf057528391c]
I20250115 10:12:02.714622 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c1c600c53e0b472ea680a14709e39431 [id=a5a191eb03004d86863bb4390fad5543]
I20250115 10:12:02.714651 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3aae7f2489e6423f8c2da3c5ae753cdf [id=a5da5f258250489a9d39ce2b87fc1a86]
I20250115 10:12:02.714687 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]
I20250115 10:12:02.714704 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]
I20250115 10:12:02.714722 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]
I20250115 10:12:02.714747 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]
I20250115 10:12:02.714772 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98]
I20250115 10:12:02.714810 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]
I20250115 10:12:02.714854 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2c791d1c1e86451a8080674fe68d383a [id=abfc4758ddad43c7aef0fd67d1ff5bbb]
I20250115 10:12:02.714896 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]
I20250115 10:12:02.714927 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]
I20250115 10:12:02.714963 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 [id=aeff809e211042a1b0bf7a57d8c754e8]
I20250115 10:12:02.714996 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fa2f46d367594fc2b0076ad6db01dee7 [id=af57231131444910ada6130cbbfdada5]
I20250115 10:12:02.715035 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3632a48440e242ac8a768d8757c6f577 [id=b0be58963f2a48e2be7e161f71298d0e]
I20250115 10:12:02.715070 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]
I20250115 10:12:02.715123 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819]
I20250115 10:12:02.715178 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d526916fb923487d905f4408bfac2c6c [id=b4307531291f4c738bd60ef5de92874a]
I20250115 10:12:02.715221 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_917623c2758441459e6b366741de339e [id=b46be727cbca46aab34220b80239d39a]
I20250115 10:12:02.715265 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]
I20250115 10:12:02.715301 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1b401a0e880a4244a7a60cde99fe7a62 [id=b657ebccf5124395b20e91032a0f1cd4]
I20250115 10:12:02.715342 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]
I20250115 10:12:02.715381 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5c001d1a075b4563ad22475f486ee7a2 [id=b6eea97a6c9c486098f3e23f4a342cd5]
I20250115 10:12:02.715436 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]
I20250115 10:12:02.715476 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]
I20250115 10:12:02.715512 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]
I20250115 10:12:02.715546 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]
I20250115 10:12:02.715597 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_be6f200b0d3f4f46a97001d4956b8e8f [id=bd2ea93d44e4471fbef2e817ef124c60]
I20250115 10:12:02.715632 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]
I20250115 10:12:02.715667 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890]
I20250115 10:12:02.715746 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]
I20250115 10:12:02.715791 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_583dc203fd4940dfb099846022f31e33 [id=c4035a1a23384ac9b0e51f8642f497de]
I20250115 10:12:02.715828 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]
I20250115 10:12:02.715873 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_8b2bd680dfb44952a854b89bf65a2aa9 [id=c7b15c3adc96499b9b60ad4bd58cc3b2]
I20250115 10:12:02.715921 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]
I20250115 10:12:02.715960 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]
I20250115 10:12:02.716001 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]
I20250115 10:12:02.716049 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2e652a03e1bc4c1dbd283ba700042ed8 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]
I20250115 10:12:02.716082 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_202be7fd65b14cb88442d558eb06fed9 [id=ca363805a72c4ed6af847c3a1b61803e]
I20250115 10:12:02.716117 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]
I20250115 10:12:02.716152 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1c5f565cf47e469aa8fda3d4022e032f [id=cca7bb92e53a40b793e4e8f5033401fe]
I20250115 10:12:02.716192 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c]
I20250115 10:12:02.716235 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]
I20250115 10:12:02.716287 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_82dccea1c581459d84b2c919ff1b789f [id=d232a42364804631b9e5f03417214a3b]
I20250115 10:12:02.716352 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]
I20250115 10:12:02.716405 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794]
I20250115 10:12:02.716445 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]
I20250115 10:12:02.716475 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]
I20250115 10:12:02.716506 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ae474575b4144851ad889119f33259bd [id=da4f430e2a734e3a94a2b2517f52e805]
I20250115 10:12:02.716543 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]
I20250115 10:12:02.716574 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]
I20250115 10:12:02.716603 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]
I20250115 10:12:02.716645 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]
I20250115 10:12:02.716675 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]
I20250115 10:12:02.716706 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_39ee61035d3b403086a48a76cb6370e4 [id=dfff9fb7e37e4beb8e5ed6c321814a9f]
I20250115 10:12:02.716743 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]
I20250115 10:12:02.716773 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]
I20250115 10:12:02.716815 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]
I20250115 10:12:02.716847 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]
I20250115 10:12:02.716876 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]
I20250115 10:12:02.716904 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e7a4050314f54e7eb39966cb227cdbb1 [id=e3aea013614447c38bd1f620138574a8]
I20250115 10:12:02.716934 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_25066f18e8044d3a88bc2548ecabd41a [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]
I20250115 10:12:02.716961 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]
I20250115 10:12:02.717015 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]
I20250115 10:12:02.717046 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]
I20250115 10:12:02.717073 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]
I20250115 10:12:02.717110 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]
I20250115 10:12:02.717145 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]
I20250115 10:12:02.717191 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_b854510e625043a7b89fa31b5d30acfb [id=eb27a3b7ec52442a882104e9ffaf008b]
I20250115 10:12:02.717221 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_4f01791bcbd34a10bc736ecbd706f53d [id=eb7190820bc3484982ba925dfd67b9f2]
I20250115 10:12:02.717257 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f [id=ebcd9bd681dc4a5298c3599542ce206f]
I20250115 10:12:02.717295 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]
I20250115 10:12:02.717324 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_bc518eaf2d604c7e9ce859e76a6d72ac [id=ec98d4501a674ea1888c0b341153947c]
I20250115 10:12:02.717368 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_1069ce4193974a938cb848fe3f45dfd0 [id=ee5989ff607243e38ee167a4d318eaaf]
I20250115 10:12:02.717399 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]
I20250115 10:12:02.717435 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_32ae9c8978b2495c93454b757401f5ff [id=eff900c27c8440e9a460c50fb125893f]
I20250115 10:12:02.717466 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]
I20250115 10:12:02.717496 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]
I20250115 10:12:02.717525 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]
I20250115 10:12:02.717558 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]
I20250115 10:12:02.717598 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]
I20250115 10:12:02.717641 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]
I20250115 10:12:02.717689 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_056453db36d0482f9828ea16ed3767c4 [id=f7cac8ff4a2f4f47961cfa687ac95f73]
I20250115 10:12:02.717739 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_46f968c8803347b8b7339b5602e32031 [id=f93e7218dc4947b5bc778789c1be1480]
I20250115 10:12:02.717770 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]
I20250115 10:12:02.717820 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]
I20250115 10:12:02.717852 4540 catalog_manager.cc:670] Loaded metadata for table default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]
I20250115 10:12:02.718442 4540 tablet_loader.cc:96] loaded metadata for tablet 00e78a8b61e142199ba7bf73e3879b98 (table default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad])
I20250115 10:12:02.718497 4540 tablet_loader.cc:96] loaded metadata for tablet 0496864e655e40dfac38619adbf4fd87 (table default.Table_00c57a31372740fe9620a054ec21d16e [id=5da2380bb07b43758f04bbd828525b53])
I20250115 10:12:02.718529 4540 tablet_loader.cc:96] loaded metadata for tablet 06c5994686054f51802fb9125beb85c4 (table default.Table_1c5f565cf47e469aa8fda3d4022e032f [id=cca7bb92e53a40b793e4e8f5033401fe])
I20250115 10:12:02.718559 4540 tablet_loader.cc:96] loaded metadata for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8])
I20250115 10:12:02.718586 4540 tablet_loader.cc:96] loaded metadata for tablet 0922008e726c4e53b00b287261a2f0a3 (table default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9])
I20250115 10:12:02.718606 4540 tablet_loader.cc:96] loaded metadata for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c])
I20250115 10:12:02.718636 4540 tablet_loader.cc:96] loaded metadata for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855])
I20250115 10:12:02.718664 4540 tablet_loader.cc:96] loaded metadata for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (table default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f])
I20250115 10:12:02.718690 4540 tablet_loader.cc:96] loaded metadata for tablet 0c6a04e982ee493d815322ec6b2f267e (table default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec])
I20250115 10:12:02.718732 4540 tablet_loader.cc:96] loaded metadata for tablet 0d5cf0e380d348f1ae2f05db1a010a19 (table default.Table_b3d35645a38345699f01877647f097be [id=7ffb156709624e9bace6cb13a4d83007])
I20250115 10:12:02.718758 4540 tablet_loader.cc:96] loaded metadata for tablet 0d7c1c0ac4d3487187907a49343381c0 (table default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7])
I20250115 10:12:02.718793 4540 tablet_loader.cc:96] loaded metadata for tablet 0e033d609eef46a792b1a568ec2936de (table default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794])
I20250115 10:12:02.718822 4540 tablet_loader.cc:96] loaded metadata for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (table default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458])
I20250115 10:12:02.718847 4540 tablet_loader.cc:96] loaded metadata for tablet 0e23a070a8454f3b8bd1620ac4535a12 (table default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 [id=25897e7460ce44ab84a870fcae962481])
I20250115 10:12:02.718873 4540 tablet_loader.cc:96] loaded metadata for tablet 0fbb9cfc01df408eaae41b38e8c62c86 (table default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2])
I20250115 10:12:02.718902 4540 tablet_loader.cc:96] loaded metadata for tablet 12379200d11e4ed3800f609d34a54ea7 (table default.Table_c09214a5f550425b928dcb0caf8ab823 [id=694250c24a29434a8486d3679391c59c])
I20250115 10:12:02.718933 4540 tablet_loader.cc:96] loaded metadata for tablet 1385fb81dff24e709d5d45fb9d616369 (table default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf [id=23c0981b39e2410196a18d8842f329b3])
I20250115 10:12:02.718963 4540 tablet_loader.cc:96] loaded metadata for tablet 140bf4fc35274f2284c24534d3644695 (table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf])
I20250115 10:12:02.718991 4540 tablet_loader.cc:96] loaded metadata for tablet 14a9663596174aa1b72ce71e49183a2b (table default.Table_202be7fd65b14cb88442d558eb06fed9 [id=ca363805a72c4ed6af847c3a1b61803e])
I20250115 10:12:02.719017 4540 tablet_loader.cc:96] loaded metadata for tablet 14cea13b41bd47faafe774471c4163dc (table default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7])
I20250115 10:12:02.719043 4540 tablet_loader.cc:96] loaded metadata for tablet 14f3aea0cf684f749027f817eb3b13b7 (table default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7])
I20250115 10:12:02.719072 4540 tablet_loader.cc:96] loaded metadata for tablet 1650bac5bd96467fb3d586b23ebd77be (table default.Table_ca7bc6e893be4465b1582ee64173500c [id=a1b3933dfb524284b565d94d1e849821])
I20250115 10:12:02.719097 4540 tablet_loader.cc:96] loaded metadata for tablet 166e6390660c485c99b2e115fd1b272f (table default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259])
I20250115 10:12:02.719144 4540 tablet_loader.cc:96] loaded metadata for tablet 17837499b096462394d993f39efce677 (table default.Table_5cde3d62bc8248f3be5fa8764025bbe0 [id=9871ed3c25464e07acb51a093f7c15d5])
I20250115 10:12:02.719188 4540 tablet_loader.cc:96] loaded metadata for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e])
I20250115 10:12:02.719219 4540 tablet_loader.cc:96] loaded metadata for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57])
I20250115 10:12:02.719439 4540 tablet_loader.cc:96] loaded metadata for tablet 1e9c62a11d4744e199765f855fd0840b (table default.Table_1eacbd293bea443fa0780ba898123200 [id=3d13f917c9a04d4cb429be32533ec2f0])
I20250115 10:12:02.719467 4540 tablet_loader.cc:96] loaded metadata for tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b])
I20250115 10:12:02.719501 4540 tablet_loader.cc:96] loaded metadata for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514])
I20250115 10:12:02.719527 4540 tablet_loader.cc:96] loaded metadata for tablet 2836a492586e489daafc2da719455f39 (table default.Table_39ee61035d3b403086a48a76cb6370e4 [id=dfff9fb7e37e4beb8e5ed6c321814a9f])
I20250115 10:12:02.719542 4540 tablet_loader.cc:96] loaded metadata for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333])
I20250115 10:12:02.719569 4540 tablet_loader.cc:96] loaded metadata for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4])
I20250115 10:12:02.719596 4540 tablet_loader.cc:96] loaded metadata for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 (table default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983])
I20250115 10:12:02.719620 4540 tablet_loader.cc:96] loaded metadata for tablet 2d30f49da63241a2a794a7a18e026473 (table default.Table_3aae7f2489e6423f8c2da3c5ae753cdf [id=a5da5f258250489a9d39ce2b87fc1a86])
I20250115 10:12:02.719645 4540 tablet_loader.cc:96] loaded metadata for tablet 2d5da557a18648719980469579c3979f (table default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43])
I20250115 10:12:02.719686 4540 tablet_loader.cc:96] loaded metadata for tablet 2e55b7e2b95b4eb895da942829c4556f (table default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2])
I20250115 10:12:02.719754 4540 tablet_loader.cc:96] loaded metadata for tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3])
I20250115 10:12:02.719797 4540 tablet_loader.cc:96] loaded metadata for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca])
I20250115 10:12:02.719825 4540 tablet_loader.cc:96] loaded metadata for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b])
I20250115 10:12:02.719842 4540 tablet_loader.cc:96] loaded metadata for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_681746e4aa1447c2a068ff6e85d9b022 [id=59ace488897c42a3a28b6118667f6403])
I20250115 10:12:02.719859 4540 tablet_loader.cc:96] loaded metadata for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b])
I20250115 10:12:02.719875 4540 tablet_loader.cc:96] loaded metadata for tablet 359eb3a976bd409b8e2d4b72f0b2348c (table default.Table_f469479d54a445cc94bea2d511828e08 [id=83adf17cb14849c7839e7682093de0c9])
I20250115 10:12:02.719903 4540 tablet_loader.cc:96] loaded metadata for tablet 367694b5edf143ef81e99e348543659a (table default.Table_058d5ec95f2a468ab9d1edf25995bdd8 [id=a4e90033d1204cb8b8fbcf057528391c])
I20250115 10:12:02.719928 4540 tablet_loader.cc:96] loaded metadata for tablet 368df29ba175447ba4c009c7eb15a49d (table default.Table_746d39dd624c4988b0521a7a6af0e896 [id=5e846a21e7a54dcda298097ce402c196])
I20250115 10:12:02.719946 4540 tablet_loader.cc:96] loaded metadata for tablet 36b19ae7373c4de688ae30eb7e1d9eab (table default.Table_1069ce4193974a938cb848fe3f45dfd0 [id=ee5989ff607243e38ee167a4d318eaaf])
I20250115 10:12:02.719978 4540 tablet_loader.cc:96] loaded metadata for tablet 3b89df9f987e46ae98fe21df847cb311 (table default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080])
I20250115 10:12:02.719995 4540 tablet_loader.cc:96] loaded metadata for tablet 3c66c13648b6478b8420778f48ba208a (table default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d])
I20250115 10:12:02.720031 4540 tablet_loader.cc:96] loaded metadata for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61])
I20250115 10:12:02.720049 4540 tablet_loader.cc:96] loaded metadata for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2 (table default.Table_79f48757c279457faeca60d711a7d129 [id=96c9813386964880ad745a3cd4d857e2])
I20250115 10:12:02.720067 4540 tablet_loader.cc:96] loaded metadata for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_2648dfb12d924eda9b18368da8df24a5 [id=0298d09bab6149af8c9c418b3d064b97])
I20250115 10:12:02.720090 4540 tablet_loader.cc:96] loaded metadata for tablet 3f9295765384410d9ee9380b4db88ed0 (table default.Table_ded364210b934ba3a4824b517b6db826 [id=268b8b77011f466abc17b7600aceadd6])
I20250115 10:12:02.720108 4540 tablet_loader.cc:96] loaded metadata for tablet 3fecca0f91e04702b438c9639303fac2 (table default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e])
I20250115 10:12:02.720130 4540 tablet_loader.cc:96] loaded metadata for tablet 41e2e034ea974448922f2cb0529bd196 (table default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884])
I20250115 10:12:02.720155 4540 tablet_loader.cc:96] loaded metadata for tablet 424956b90563455d8140a49fcaa05206 (table default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf])
I20250115 10:12:02.720171 4540 tablet_loader.cc:96] loaded metadata for tablet 4283a096b18b4be69e1f57e60c3efd3e (table default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe])
I20250115 10:12:02.720223 4540 tablet_loader.cc:96] loaded metadata for tablet 46b8efd1622a4efcb009f999cb915dfc (table default.Table_4e44e0cd2af54f0585de9211108521c0 [id=4a0764b4a46f4278973b2c7b7a1cf35f])
I20250115 10:12:02.720242 4540 tablet_loader.cc:96] loaded metadata for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b])
I20250115 10:12:02.720261 4540 tablet_loader.cc:96] loaded metadata for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5 (table default.Table_37c905a6d3fe455882ef028a290d6588 [id=7f25a9ec0c1d4d2ab8e54772756694be])
I20250115 10:12:02.720283 4540 tablet_loader.cc:96] loaded metadata for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d])
I20250115 10:12:02.720299 4540 tablet_loader.cc:96] loaded metadata for tablet 4a0811cad8454c2e871aad2101224f34 (table default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819])
I20250115 10:12:02.720319 4540 tablet_loader.cc:96] loaded metadata for tablet 4ab498e7789d4ae18a9f62be2fa2514a (table default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02])
I20250115 10:12:02.720342 4540 tablet_loader.cc:96] loaded metadata for tablet 4ae4f2e19e4443b38430cdb95bd82f91 (table default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986])
I20250115 10:12:02.720363 4540 tablet_loader.cc:96] loaded metadata for tablet 4c49b39058164387990c4f6dc170785e (table default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 [id=8d38c2511ddc4940b470805a54f8b1c4])
I20250115 10:12:02.720381 4540 tablet_loader.cc:96] loaded metadata for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d])
I20250115 10:12:02.720402 4540 tablet_loader.cc:96] loaded metadata for tablet 4d31f180a3fc499fbd505c986593a7f5 (table default.Table_eb4ead8621074161aaa1f06e5ed31482 [id=270edc3310cd4a09aaa6f46e4f889188])
I20250115 10:12:02.720433 4540 tablet_loader.cc:96] loaded metadata for tablet 4ec3c400b50a4c8b9c490158732582f5 (table default.Table_be6f200b0d3f4f46a97001d4956b8e8f [id=bd2ea93d44e4471fbef2e817ef124c60])
I20250115 10:12:02.720456 4540 tablet_loader.cc:96] loaded metadata for tablet 4f6baabd5aba4363ae13e5da601a9de8 (table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534])
I20250115 10:12:02.720477 4540 tablet_loader.cc:96] loaded metadata for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45])
I20250115 10:12:02.720492 4540 tablet_loader.cc:96] loaded metadata for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872])
I20250115 10:12:02.720508 4540 tablet_loader.cc:96] loaded metadata for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7ce9a506439a41599372c73d37cf0b15 [id=147b41dfa10b45599d423ceac25e8094])
I20250115 10:12:02.720531 4540 tablet_loader.cc:96] loaded metadata for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 (table default.Table_ee9e9053bc3f4441967dea174020753e [id=50e32bfecf514cb0972986f128ff095a])
I20250115 10:12:02.720556 4540 tablet_loader.cc:96] loaded metadata for tablet 5403eb7ca3b74d6e8110f97c17e1aa67 (table default.Table_fa2f46d367594fc2b0076ad6db01dee7 [id=af57231131444910ada6130cbbfdada5])
I20250115 10:12:02.720571 4540 tablet_loader.cc:96] loaded metadata for tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947])
I20250115 10:12:02.720592 4540 tablet_loader.cc:96] loaded metadata for tablet 54d9aaaa37d540cab41de4a083b36917 (table default.Table_d0fcc51d02e64d42831f872a5b3b02ee [id=965a2b7a6e3241afac6499010b596aa5])
I20250115 10:12:02.720611 4540 tablet_loader.cc:96] loaded metadata for tablet 55ed45d371a34a51a42fb04f4a450ae5 (table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee])
I20250115 10:12:02.720636 4540 tablet_loader.cc:96] loaded metadata for tablet 575f1a39f8a54c4cb21cd17d562c0542 (table default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67])
I20250115 10:12:02.720679 4540 tablet_loader.cc:96] loaded metadata for tablet 576e273ac51f4eb498faccab336c479d (table default.Table_c85f35b680824b1e82b624028c053124 [id=6d6c1ae6d0114e97bc24eaedecf1c904])
I20250115 10:12:02.720696 4540 tablet_loader.cc:96] loaded metadata for tablet 5778f29ace314ea18b42afd0b7c1642b (table default.Table_403c08da944445838245a588777ef636 [id=833c3f479c5b49b4978b5d508bb1d101])
I20250115 10:12:02.720731 4540 tablet_loader.cc:96] loaded metadata for tablet 57d3800d79794d3bad6c50d2dc8e9258 (table default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d])
I20250115 10:12:02.720757 4540 tablet_loader.cc:96] loaded metadata for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2])
I20250115 10:12:02.720806 4540 tablet_loader.cc:96] loaded metadata for tablet 5d0b60522b15489d9726af73a7bd1ee5 (table default.Table_d90a16759f704e54a0e7cdef7960d41a [id=33c05baa94c64e3d8139905db7e98f85])
I20250115 10:12:02.720829 4540 tablet_loader.cc:96] loaded metadata for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77])
I20250115 10:12:02.720851 4540 tablet_loader.cc:96] loaded metadata for tablet 5f37b29ba1cb4a0289268ba1241527b8 (table default.Table_f448ab1cfae2403393f3884d0a50fd61 [id=2cd4c5e9ab1f4e018b47117186f14066])
I20250115 10:12:02.720875 4540 tablet_loader.cc:96] loaded metadata for tablet 5fac40fff8de4004858af6e2ae986d46 (table default.Table_0bfecbf8f6db434c853e2fc9024e5c2d [id=69843267a5254af281348136b8df9daa])
I20250115 10:12:02.720906 4540 tablet_loader.cc:96] loaded metadata for tablet 60cc9a1b2c4348ada0d8dab958aded09 (table default.Table_46f968c8803347b8b7339b5602e32031 [id=f93e7218dc4947b5bc778789c1be1480])
I20250115 10:12:02.720937 4540 tablet_loader.cc:96] loaded metadata for tablet 616166bc9d5d4651999b1d2e0a1851bb (table default.Table_36a2b6b01e684edb9cd4c0f11317ea56 [id=7e11745e5dd243d69cb4463cc11edf26])
I20250115 10:12:02.720961 4540 tablet_loader.cc:96] loaded metadata for tablet 62aee0b0490e44a3aa820781bc9e4072 (table default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 [id=86e6124c18724ba1bc7fc8c8772d1fc5])
I20250115 10:12:02.720995 4540 tablet_loader.cc:96] loaded metadata for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839])
I20250115 10:12:02.721014 4540 tablet_loader.cc:96] loaded metadata for tablet 63b83ca446824b88978e3dc3269d43a3 (table default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c])
I20250115 10:12:02.721036 4540 tablet_loader.cc:96] loaded metadata for tablet 6435fd1953d440c8b4d9745a5dcd15f6 (table default.Table_79af526c42b24e2f8ae1da15d106cbe9 [id=22fbb91517214bfeb4c6d732904ac18c])
I20250115 10:12:02.721060 4540 tablet_loader.cc:96] loaded metadata for tablet 65a0bd78c1e7409bb41392fd8f9a0862 (table default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757])
I20250115 10:12:02.721091 4540 tablet_loader.cc:96] loaded metadata for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_c73488a369ec4bc196196444fa9c3632 [id=4fdef59a83b241a785c3ed32b8eeb977])
I20250115 10:12:02.721110 4540 tablet_loader.cc:96] loaded metadata for tablet 6be683cdd24844eebaad0ed6a36be25f (table default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8])
I20250115 10:12:02.721138 4540 tablet_loader.cc:96] loaded metadata for tablet 6d8e47c05a4b46d9a032852ad67b29ae (table default.Table_16575f283a0b491da19099917b25019d [id=0c3701a4f04444b7bd4bd5e4e0fcd016])
I20250115 10:12:02.721154 4540 tablet_loader.cc:96] loaded metadata for tablet 6d9a83c4de3849498be5c6e4f9c8b00c (table default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8])
I20250115 10:12:02.721182 4540 tablet_loader.cc:96] loaded metadata for tablet 6de4d57d53c648b491f66f257414394d (table default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf])
I20250115 10:12:02.721210 4540 tablet_loader.cc:96] loaded metadata for tablet 6f33cd582313436ba2a8a71cb708384c (table default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9])
I20250115 10:12:02.721231 4540 tablet_loader.cc:96] loaded metadata for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9])
I20250115 10:12:02.721253 4540 tablet_loader.cc:96] loaded metadata for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000])
I20250115 10:12:02.721272 4540 tablet_loader.cc:96] loaded metadata for tablet 707f0e47915e4a8998a97a8680394e5d (table default.Table_5b1fd5cfd1424151839bc16fb5c88670 [id=05b392915cd34cf9af16ae61741e53f1])
I20250115 10:12:02.721289 4540 tablet_loader.cc:96] loaded metadata for tablet 709a9b0953dd4b108825b663d703e609 (table default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57])
I20250115 10:12:02.721311 4540 tablet_loader.cc:96] loaded metadata for tablet 7144ec81e9244eb49715450aeda5f82f (table default.Table_b1441ec916974e33a6e5a290afd937f2 [id=6ef4f40281e34b0c95e1b3eb2a8f04a0])
I20250115 10:12:02.721330 4540 tablet_loader.cc:96] loaded metadata for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc])
I20250115 10:12:02.721347 4540 tablet_loader.cc:96] loaded metadata for tablet 74a62d026bb94c0fb908b36b38aa0f7f (table default.Table_080e6f46b4a4430fbbe8ae52c0055a43 [id=1faa87a45ad24ea7a41e678ed5b4c8d9])
I20250115 10:12:02.721369 4540 tablet_loader.cc:96] loaded metadata for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a])
I20250115 10:12:02.721393 4540 tablet_loader.cc:96] loaded metadata for tablet 75ab349b64b745ed97c3dae843b059aa (table default.Table_b854510e625043a7b89fa31b5d30acfb [id=eb27a3b7ec52442a882104e9ffaf008b])
I20250115 10:12:02.721416 4540 tablet_loader.cc:96] loaded metadata for tablet 7629a309511c4251b1e9ce231ef0fcf0 (table default.Table_b7f5565de66f4ea5884b8c57e72d6613 [id=39e850f5f01a452fba3674612dbc6548])
I20250115 10:12:02.721437 4540 tablet_loader.cc:96] loaded metadata for tablet 76499a085d9d4f74818684d3148a4866 (table default.Table_c1c600c53e0b472ea680a14709e39431 [id=a5a191eb03004d86863bb4390fad5543])
I20250115 10:12:02.721455 4540 tablet_loader.cc:96] loaded metadata for tablet 766ddeab54194401aeb942516e42dc84 (table default.Table_e762e9011d9f4fe1856dc4923700d779 [id=0ed50e4d34254318a993c3268808ce39])
I20250115 10:12:02.721477 4540 tablet_loader.cc:96] loaded metadata for tablet 77b422773c3346199383ca64330719c6 (table default.Table_f04269f5ae13474e959f42bee487f199 [id=195139f257d2494791df1002a43aee3f])
I20250115 10:12:02.721503 4540 tablet_loader.cc:96] loaded metadata for tablet 77cd70765e54417fbf6234fe59480518 (table default.Table_d2c4a3b2009e4f548be4457d598fff95 [id=386128b91ada4ecca121f2d2053390a8])
I20250115 10:12:02.721532 4540 tablet_loader.cc:96] loaded metadata for tablet 7a9d422fdac347ff85eca778c29858e8 (table default.Table_25fd90e569f543a08c37804c5c95dd31 [id=93f0f05ce5b44db1949a47c0d0bab532])
I20250115 10:12:02.721562 4540 tablet_loader.cc:96] loaded metadata for tablet 7cd6b39cd88247bfa120903465b676b2 (table default.Table_32ae9c8978b2495c93454b757401f5ff [id=eff900c27c8440e9a460c50fb125893f])
I20250115 10:12:02.721588 4540 tablet_loader.cc:96] loaded metadata for tablet 7f6244234f7447debe9cdce30e4919b6 (table default.Table_917623c2758441459e6b366741de339e [id=b46be727cbca46aab34220b80239d39a])
I20250115 10:12:02.721611 4540 tablet_loader.cc:96] loaded metadata for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea])
I20250115 10:12:02.721645 4540 tablet_loader.cc:96] loaded metadata for tablet 817a8a975fea4da9a994e78f86da961f (table default.Table_a3b73807076c4f0aabf9e6f82eca2bef [id=791960255cad40b1814de43ae15c9ee7])
I20250115 10:12:02.721663 4540 tablet_loader.cc:96] loaded metadata for tablet 8191b81bdad74a9b8aa049473325720b (table default.Table_f6a790f7709f440d98f1567067ed68a2 [id=47674ee5aac44634ba202fe90d14d49d])
I20250115 10:12:02.721688 4540 tablet_loader.cc:96] loaded metadata for tablet 82c66363913e47399c4e1e8533bdadd0 (table default.Table_f1faf951819049d9aac897e67c029beb [id=86cef7da77da456089b46d9647ee7e3f])
I20250115 10:12:02.721712 4540 tablet_loader.cc:96] loaded metadata for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c0ff9042b1554e91a840ad8adde05cc9 [id=a02b68d5690c4d22bd6228e2cda045c0])
I20250115 10:12:02.721735 4540 tablet_loader.cc:96] loaded metadata for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842])
I20250115 10:12:02.721756 4540 tablet_loader.cc:96] loaded metadata for tablet 87d8167b34064888be6e4df4dfde0b31 (table default.Table_196ff2f45dc94ec58c60a08545468524 [id=588ca457130b479db3f999ed2f492120])
I20250115 10:12:02.721786 4540 tablet_loader.cc:96] loaded metadata for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9 (table default.Table_2c791d1c1e86451a8080674fe68d383a [id=abfc4758ddad43c7aef0fd67d1ff5bbb])
I20250115 10:12:02.721817 4540 tablet_loader.cc:96] loaded metadata for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98])
I20250115 10:12:02.721834 4540 tablet_loader.cc:96] loaded metadata for tablet 8a3ebf56500b4c97b7553644d62fe83a (table default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19])
I20250115 10:12:02.721850 4540 tablet_loader.cc:96] loaded metadata for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db])
I20250115 10:12:02.721875 4540 tablet_loader.cc:96] loaded metadata for tablet 8c045349a48644eda41ea8965b16174d (table default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8])
I20250115 10:12:02.721894 4540 tablet_loader.cc:96] loaded metadata for tablet 8c0541097b0b4916b559c14e48e08540 (table default.Table_bc518eaf2d604c7e9ce859e76a6d72ac [id=ec98d4501a674ea1888c0b341153947c])
I20250115 10:12:02.721910 4540 tablet_loader.cc:96] loaded metadata for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985])
I20250115 10:12:02.721927 4540 tablet_loader.cc:96] loaded metadata for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_7f11f45ebda04d1d934c330ec17ceccf [id=05d6c7181b804de9ac10c342612b7e2c])
I20250115 10:12:02.721956 4540 tablet_loader.cc:96] loaded metadata for tablet 9077d0eed1974bc898370b5d5554be71 (table default.Table_2e652a03e1bc4c1dbd283ba700042ed8 [id=c9fb24c78a664a3e9ba2d66bf974f1b9])
I20250115 10:12:02.721983 4540 tablet_loader.cc:96] loaded metadata for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e])
I20250115 10:12:02.722004 4540 tablet_loader.cc:96] loaded metadata for tablet 97bb29eb3de04d65aa91e7ae8c652170 (table default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83])
I20250115 10:12:02.722021 4540 tablet_loader.cc:96] loaded metadata for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091])
I20250115 10:12:02.722041 4540 tablet_loader.cc:96] loaded metadata for tablet 98e5519e80144b7582d76b7f9d8d6ffa (table default.Table_b5612228d70d4480ad349647f31a97fc [id=7c32f09490d24567885955928d4e3d75])
I20250115 10:12:02.722070 4540 tablet_loader.cc:96] loaded metadata for tablet 9bc7d63d8661445cb804762413eac194 (table default.Table_056453db36d0482f9828ea16ed3767c4 [id=f7cac8ff4a2f4f47961cfa687ac95f73])
I20250115 10:12:02.722107 4540 tablet_loader.cc:96] loaded metadata for tablet 9fbcd4787a734c5bba29f8a600abf874 (table default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048])
I20250115 10:12:02.722129 4540 tablet_loader.cc:96] loaded metadata for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82])
I20250115 10:12:02.722147 4540 tablet_loader.cc:96] loaded metadata for tablet a154d22681d34329b497747e84ce41cf (table default.Table_4c4f267ca02940d58bc4543ec80f03ce [id=0949f4256757430885ac07328c985705])
I20250115 10:12:02.722164 4540 tablet_loader.cc:96] loaded metadata for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0])
I20250115 10:12:02.722183 4540 tablet_loader.cc:96] loaded metadata for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890])
I20250115 10:12:02.722208 4540 tablet_loader.cc:96] loaded metadata for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_37e85cc42de44c9ea1e9d33a94d70be8 [id=1a36a0dbf9eb490ba53332a260571b48])
I20250115 10:12:02.722223 4540 tablet_loader.cc:96] loaded metadata for tablet a7e2086241df4b4fac5e481c5e8295a9 (table default.Table_7b236b5787d24e138bfad3c30003b316 [id=0b1b8cdb67244dc19aed82671327d212])
I20250115 10:12:02.722259 4540 tablet_loader.cc:96] loaded metadata for tablet ac8b3c397070467196b73dedcacf22de (table default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5])
I20250115 10:12:02.722276 4540 tablet_loader.cc:96] loaded metadata for tablet ad975dacafc94bc89c3996aa58a9b5a1 (table default.Table_7ed5666a03e441d8bd5b20eb88d5910a [id=81d22d650beb49f5827086b74342581e])
I20250115 10:12:02.722297 4540 tablet_loader.cc:96] loaded metadata for tablet ae2368e4ae294470995667b87ad701fe (table default.Table_c44d243878514ff19a0f78c47f415f6a [id=15c6ceedaafb48a4b75f0e3838295b0f])
I20250115 10:12:02.722319 4540 tablet_loader.cc:96] loaded metadata for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b])
I20250115 10:12:02.722338 4540 tablet_loader.cc:96] loaded metadata for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787])
I20250115 10:12:02.722354 4540 tablet_loader.cc:96] loaded metadata for tablet afe405846f924decb1786b338a306f62 (table default.Table_0d43a0379fa042929ffb70c09407e4f2 [id=3094f0694b4b4f308b40e4ffe25cfbf4])
I20250115 10:12:02.722373 4540 tablet_loader.cc:96] loaded metadata for tablet afebbabd8d914cd0804a0c64830ef84e (table default.Table_41584cc62411410fbfa50fc897fa446a [id=6f19ad27a4ef4fe4b447cb2eea68d043])
I20250115 10:12:02.722395 4540 tablet_loader.cc:96] loaded metadata for tablet b110fe6c13204cf295abb29839f3380b (table default.Table_7cc7f5b2700343b7b48aae25a2f75b37 [id=2d9f80bd6fda4b22af4bb90503c90a4f])
I20250115 10:12:02.722414 4540 tablet_loader.cc:96] loaded metadata for tablet b114b291fd734797bd6622d89e309925 (table default.Table_f98e93dc1edf457d8b10bd2882677285 [id=a49d7416b0c84365bc92418b8d448a65])
I20250115 10:12:02.722432 4540 tablet_loader.cc:96] loaded metadata for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070])
I20250115 10:12:02.722453 4540 tablet_loader.cc:96] loaded metadata for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_25066f18e8044d3a88bc2548ecabd41a [id=e42d14cf5e5e4f728fcf6c4e8eb4938e])
I20250115 10:12:02.722474 4540 tablet_loader.cc:96] loaded metadata for tablet b33c7ecdd251412eaeed45e378e5cc75 (table default.Table_93ee920c32874d4888ddf9c25fbdff06 [id=7be4cd372cf148b6ad10b57523e826ea])
I20250115 10:12:02.722501 4540 tablet_loader.cc:96] loaded metadata for tablet b3e3be71c4324a5589a397ae76198f27 (table default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501])
I20250115 10:12:02.722518 4540 tablet_loader.cc:96] loaded metadata for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_4f01791bcbd34a10bc736ecbd706f53d [id=eb7190820bc3484982ba925dfd67b9f2])
I20250115 10:12:02.722534 4540 tablet_loader.cc:96] loaded metadata for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (table default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2])
I20250115 10:12:02.722551 4540 tablet_loader.cc:96] loaded metadata for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a (table default.Table_d59e20c98bd84db48c45d49171eff4fd [id=10b43b32ad174b12b4a2da8cceaaeac1])
I20250115 10:12:02.722579 4540 tablet_loader.cc:96] loaded metadata for tablet b7a6ec9020494019a32cfb428554bd07 (table default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e])
I20250115 10:12:02.722599 4540 tablet_loader.cc:96] loaded metadata for tablet b9c28bb9d70940a59449ad5afb4a6313 (table default.Table_109864ef03f142b0be396620ae7e15b2 [id=70979ea2e90c4564947e7bfcf4d59e72])
I20250115 10:12:02.722638 4540 tablet_loader.cc:96] loaded metadata for tablet ba609491f7ed4686b374fd7c0a5e39f8 (table default.Table_81cbb970502040e38384e43cc9935f43 [id=0097f32bdaf5478bbdd7cb6e58c2e223])
I20250115 10:12:02.722658 4540 tablet_loader.cc:96] loaded metadata for tablet bb4d112daca24c82931daf050edbd846 (table default.Table_2deceee1167f46b8aea6e6f3fa075cf7 [id=093d224f08744cf38ab4f22d0c0b6e97])
I20250115 10:12:02.722693 4540 tablet_loader.cc:96] loaded metadata for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f])
I20250115 10:12:02.722718 4540 tablet_loader.cc:96] loaded metadata for tablet bcd888d924fd43b590710613560f16d5 (table default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977])
I20250115 10:12:02.722746 4540 tablet_loader.cc:96] loaded metadata for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610])
I20250115 10:12:02.722774 4540 tablet_loader.cc:96] loaded metadata for tablet bf882dcd84be4b38af533b64dfb4fd95 (table default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 [id=0041976377904d41939a1ea9a5fcc07e])
I20250115 10:12:02.722800 4540 tablet_loader.cc:96] loaded metadata for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab])
I20250115 10:12:02.722818 4540 tablet_loader.cc:96] loaded metadata for tablet c35ca809b19541479146f385e1d3cebe (table default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177])
I20250115 10:12:02.722846 4540 tablet_loader.cc:96] loaded metadata for tablet c64affc7645145069d6197ede241585e (table default.Table_9557727fc0e5449ba95961d750b88bc4 [id=2b92b0f8a8574e8c810ce7062c65acae])
I20250115 10:12:02.722867 4540 tablet_loader.cc:96] loaded metadata for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_5c52b5a64d154706af4220cc2f273a98 [id=75a3cabc6ab0415992e902b02ea54d47])
I20250115 10:12:02.722884 4540 tablet_loader.cc:96] loaded metadata for tablet c77afc007fac49848786aaecd4d1e214 (table default.Table_780d6792486f4d65bb71098c78eec010 [id=65d6de2c925e407094df78186e79ddf7])
I20250115 10:12:02.722919 4540 tablet_loader.cc:96] loaded metadata for tablet c85d63cc502f418b91aec39245c707b9 (table default.Table_837ed67810f741a2bfe30f928f9d978c [id=94b2e5bbafba4dd986b674d0041216e0])
I20250115 10:12:02.722940 4540 tablet_loader.cc:96] loaded metadata for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 [id=988e12ca3c094601a1189d8558614dae])
I20250115 10:12:02.722968 4540 tablet_loader.cc:96] loaded metadata for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b])
I20250115 10:12:02.722992 4540 tablet_loader.cc:96] loaded metadata for tablet cb353ea066dc474cac07e3adcfa6574d (table default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11])
I20250115 10:12:02.723011 4540 tablet_loader.cc:96] loaded metadata for tablet cb8ecc0818304f5e9522bba63a4aca4d (table default.Table_dbaca6558a074caa8671547657908e94 [id=4c4374e6c65149d087e5507ced04d9fc])
I20250115 10:12:02.723034 4540 tablet_loader.cc:96] loaded metadata for tablet cb9629071de44cf69621ae3b2fd4e762 (table default.Table_af49e808ad814664b3703d748315b8a4 [id=89304ed813b04d0682ad058ee2168202])
I20250115 10:12:02.723054 4540 tablet_loader.cc:96] loaded metadata for tablet cc395ae76a494a8eb682b7ef34dcb169 (table default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5])
I20250115 10:12:02.723078 4540 tablet_loader.cc:96] loaded metadata for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b])
I20250115 10:12:02.723102 4540 tablet_loader.cc:96] loaded metadata for tablet cd8c55fd071d42b880becb81e6f70f27 (table default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb [id=8afca2ed08bc4ea392257397837f8db0])
I20250115 10:12:02.723124 4540 tablet_loader.cc:96] loaded metadata for tablet ce84190f55b14902ab678a98e622dc4f (table default.Table_6cc1bb874cf24449a25401e70c030f9e [id=0161accf9e4545e688d747883ea0114d])
I20250115 10:12:02.723142 4540 tablet_loader.cc:96] loaded metadata for tablet ce8455d282d34bbe9822a00a28d4c3ec (table default.Table_659f850eaa924b75a860677bd9ea33f7 [id=2e0b0b4cbc9f4f678d7db889c9be970c])
I20250115 10:12:02.723165 4540 tablet_loader.cc:96] loaded metadata for tablet cf859ca6a22947ba80f99872d6dc6600 (table default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff])
I20250115 10:12:02.723192 4540 tablet_loader.cc:96] loaded metadata for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214])
I20250115 10:12:02.723213 4540 tablet_loader.cc:96] loaded metadata for tablet cff61c5261f44b12b0da4cd3b6e58ddc (table default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971])
I20250115 10:12:02.723234 4540 tablet_loader.cc:96] loaded metadata for tablet d02e33022c3840c28623200adb56e3bc (table default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 [id=aeff809e211042a1b0bf7a57d8c754e8])
I20250115 10:12:02.723254 4540 tablet_loader.cc:96] loaded metadata for tablet d07f6f091ee847e49d1c64bee583a7a4 (table default.Table_e7a4050314f54e7eb39966cb227cdbb1 [id=e3aea013614447c38bd1f620138574a8])
I20250115 10:12:02.723284 4540 tablet_loader.cc:96] loaded metadata for tablet d0e3265da9be49518705bedf6daa27a1 (table default.Table_d63e50fd58fd4335ba0165af0f856032 [id=3bedd46181134cf7bdc3b443a5aff915])
I20250115 10:12:02.723307 4540 tablet_loader.cc:96] loaded metadata for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e (table default.Table_5c001d1a075b4563ad22475f486ee7a2 [id=b6eea97a6c9c486098f3e23f4a342cd5])
I20250115 10:12:02.723325 4540 tablet_loader.cc:96] loaded metadata for tablet d190044d103e441193e224c667108543 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b])
I20250115 10:12:02.723354 4540 tablet_loader.cc:96] loaded metadata for tablet d200e7e299214ab8aad3a42a4d513da5 (table default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204])
I20250115 10:12:02.723373 4540 tablet_loader.cc:96] loaded metadata for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883])
I20250115 10:12:02.723390 4540 tablet_loader.cc:96] loaded metadata for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193 (table default.Table_3632a48440e242ac8a768d8757c6f577 [id=b0be58963f2a48e2be7e161f71298d0e])
I20250115 10:12:02.723415 4540 tablet_loader.cc:96] loaded metadata for tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30])
I20250115 10:12:02.723438 4540 tablet_loader.cc:96] loaded metadata for tablet d35847dc829b4b3d94c0fb68ec6c2b31 (table default.Table_0c75970bf5ff4311a8bacd12c3ec98d7 [id=03162de587a24aef8dc6cfcb976fb9b1])
I20250115 10:12:02.723455 4540 tablet_loader.cc:96] loaded metadata for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235])
I20250115 10:12:02.723480 4540 tablet_loader.cc:96] loaded metadata for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61])
I20250115 10:12:02.723500 4540 tablet_loader.cc:96] loaded metadata for tablet d5419822600e463a9efb81ad86a10292 (table default.Table_452d4e866cf043a290b01f92fea60597 [id=56ba6004943340809edbf23f7af8bf71])
I20250115 10:12:02.723536 4540 tablet_loader.cc:96] loaded metadata for tablet d73af05d7fd349b083eb74352a62a1fe (table default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9])
I20250115 10:12:02.723579 4540 tablet_loader.cc:96] loaded metadata for tablet dc2b34be581f44028fed1514c78d1874 (table default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f])
I20250115 10:12:02.723600 4540 tablet_loader.cc:96] loaded metadata for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 (table default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9])
I20250115 10:12:02.723631 4540 tablet_loader.cc:96] loaded metadata for tablet ded005e366d4460f9acbcbb7b75397ef (table default.Table_a883df24d37b447baa84acc5f6c62d45 [id=721c4375c79a45feb26f677535de05c2])
I20250115 10:12:02.723654 4540 tablet_loader.cc:96] loaded metadata for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74])
I20250115 10:12:02.723681 4540 tablet_loader.cc:96] loaded metadata for tablet e178610c1a394217b152082dfd6bb8d0 (table default.Table_d526916fb923487d905f4408bfac2c6c [id=b4307531291f4c738bd60ef5de92874a])
I20250115 10:12:02.724184 4540 tablet_loader.cc:96] loaded metadata for tablet e3dd43785e2541d8be54b6ca339a754d (table default.Table_ee808cbef43c429ba5a671726e74c5ac [id=2e12df36e70c48bdb039351c533e802a])
I20250115 10:12:02.724253 4540 tablet_loader.cc:96] loaded metadata for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a])
I20250115 10:12:02.724295 4540 tablet_loader.cc:96] loaded metadata for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce])
I20250115 10:12:02.724349 4540 tablet_loader.cc:96] loaded metadata for tablet ec6cdec27e9941ed9b485228f93b4d60 (table default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a])
I20250115 10:12:02.724380 4540 tablet_loader.cc:96] loaded metadata for tablet ee6597804e5c41618870133c9d4ad1b3 (table default.Table_8b2bd680dfb44952a854b89bf65a2aa9 [id=c7b15c3adc96499b9b60ad4bd58cc3b2])
I20250115 10:12:02.724422 4540 tablet_loader.cc:96] loaded metadata for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6])
I20250115 10:12:02.724448 4540 tablet_loader.cc:96] loaded metadata for tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6])
I20250115 10:12:02.724479 4540 tablet_loader.cc:96] loaded metadata for tablet f0d6e064ac3645a0a855d97262f6e9ed (table default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 [id=5f8793d7d917468b822398f75b3c7b36])
I20250115 10:12:02.724505 4540 tablet_loader.cc:96] loaded metadata for tablet f2230f6de9a54e98aa83435d37f68807 (table default.Table_ae474575b4144851ad889119f33259bd [id=da4f430e2a734e3a94a2b2517f52e805])
I20250115 10:12:02.724537 4540 tablet_loader.cc:96] loaded metadata for tablet f3cba581c6884fd98503d4883b09d4a6 (table default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406])
I20250115 10:12:02.724567 4540 tablet_loader.cc:96] loaded metadata for tablet f4cee0b04c6e4eb39dd22668aacb2801 (table default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853])
I20250115 10:12:02.724593 4540 tablet_loader.cc:96] loaded metadata for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6])
I20250115 10:12:02.724618 4540 tablet_loader.cc:96] loaded metadata for tablet f560f9e7e84d47faa147b33495e85055 (table default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99])
I20250115 10:12:02.724654 4540 tablet_loader.cc:96] loaded metadata for tablet f682c7942a454d86a5df19eeac533361 (table default.Table_083c387389e741fa8d1c07011d4e7f5d [id=940ec8ab0c8a48be99dbb34e0ef6d263])
I20250115 10:12:02.724680 4540 tablet_loader.cc:96] loaded metadata for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (table default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5])
I20250115 10:12:02.724709 4540 tablet_loader.cc:96] loaded metadata for tablet f8114f64577245c2b3ce70e4399de0c8 (table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173])
I20250115 10:12:02.724742 4540 tablet_loader.cc:96] loaded metadata for tablet f9256780f6e94b7ebd1276df07baf19d (table default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede])
I20250115 10:12:02.724766 4540 tablet_loader.cc:96] loaded metadata for tablet f96f4c52a2124c05b0e124a89eacaa71 (table default.Table_583dc203fd4940dfb099846022f31e33 [id=c4035a1a23384ac9b0e51f8642f497de])
I20250115 10:12:02.724797 4540 tablet_loader.cc:96] loaded metadata for tablet f9acac6e5e8a486ea8e269359498c3a7 (table default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f])
I20250115 10:12:02.724821 4540 tablet_loader.cc:96] loaded metadata for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_745464477b4d4be793cf32e945afc9f3 [id=9eb9d10afdf744c78a2c4e2a5c5eed6e])
I20250115 10:12:02.724849 4540 tablet_loader.cc:96] loaded metadata for tablet fb04f46a17134bc28719be34085f714f (table default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f [id=ebcd9bd681dc4a5298c3599542ce206f])
I20250115 10:12:02.724884 4540 tablet_loader.cc:96] loaded metadata for tablet fc423aad4e7a49eaacb21c73d5d8c341 (table default.Table_82dccea1c581459d84b2c919ff1b789f [id=d232a42364804631b9e5f03417214a3b])
I20250115 10:12:02.724923 4540 tablet_loader.cc:96] loaded metadata for tablet fc6b5ec8e472414789f9619ae958fa34 (table default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25])
I20250115 10:12:02.724951 4540 tablet_loader.cc:96] loaded metadata for tablet fcf567628009460dbb7bfa582f69b4f1 (table default.Table_1b401a0e880a4244a7a60cde99fe7a62 [id=b657ebccf5124395b20e91032a0f1cd4])
I20250115 10:12:02.724974 4540 tablet_loader.cc:96] loaded metadata for tablet fd76846bc164480d9b77aa3d096260cb (table default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009])
I20250115 10:12:02.725003 4540 tablet_loader.cc:96] loaded metadata for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf])
I20250115 10:12:02.725039 4540 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250115 10:12:02.725693 4540 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:12:02.725730 4540 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250115 10:12:02.726348 4540 catalog_manager.cc:1505] Loading token signing keys...
I20250115 10:12:02.726812 4540 catalog_manager.cc:5910] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Loaded TSK: 0
I20250115 10:12:02.726970 4540 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250115 10:12:02.736282 3111 raft_consensus.cc:3049] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 LEADER]: Stepping down as leader of term 2
I20250115 10:12:02.736358 3111 raft_consensus.cc:738] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdb1ea5a27ca44baa3b0fe127143df0b, State: Running, Role: LEADER
I20250115 10:12:02.736321 4379 raft_consensus.cc:1270] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 3 FOLLOWER]: Refusing update from remote peer 88f5e7c003a641128acc22b394ab62c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 222. Preceding OpId from leader: term: 3 index: 1173. (index mismatch)
I20250115 10:12:02.736423 3111 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 222, Committed index: 1171, Last appended: 2.1181, Last appended by leader: 1181, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:02.736523 3111 raft_consensus.cc:3054] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 2 FOLLOWER]: Advancing to term 3
I20250115 10:12:02.736678 4520 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1172, Last known committed idx: 222, Time since last communication: 0.000s
I20250115 10:12:02.737198 3111 raft_consensus.cc:1270] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [term 3 FOLLOWER]: Refusing update from remote peer 88f5e7c003a641128acc22b394ab62c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 1181. Preceding OpId from leader: term: 3 index: 1173. (term mismatch)
I20250115 10:12:02.737242 3111 pending_rounds.cc:77] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting all ops after (but not including) 1172
I20250115 10:12:02.737283 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1173
I20250115 10:12:02.737383 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1174
I20250115 10:12:02.737429 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1175
W20250115 10:12:02.737452 3095 catalog_manager.cc:3841] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.737468 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1176
W20250115 10:12:02.737525 3097 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:12:02.737529 3094 catalog_manager.cc:3841] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.737584 3097 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 958) took 1259 ms. Trace:
I20250115 10:12:02.737615 3094 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46172 (request call id 962) took 1258 ms. Trace:
I20250115 10:12:02.737604 3097 rpcz_store.cc:276] 0115 10:12:01.478330 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.478351 (+ 21us) service_pool.cc:225] Handling call
0115 10:12:01.478558 (+ 207us) catalog_manager.cc:2076] Acquired catalog manager lock
0115 10:12:01.478601 (+ 43us) catalog_manager.cc:2122] Created new table and tablet info
0115 10:12:02.737582 (+1258981us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.478774 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.478778 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.478778 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.478778 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.478782 (+ 4us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.478783 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.478783 (+ 0us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.478786 (+ 3us) tablet.cc:698] Row locks acquired
0115 10:12:01.478786 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.478788 (+ 2us) write_op.cc:270] Start()
0115 10:12:01.478789 (+ 1us) write_op.cc:276] Timestamp: P: 1736935921478763 usec, L: 0
0115 10:12:01.478789 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.478810 (+ 21us) log.cc:844] Serialized 433 byte log entry
0115 10:12:02.737333 (+1258523us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.737339 (+ 6us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.737340 (+ 1us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.737348 (+ 8us) write_op.cc:454] Released schema lock
0115 10:12:02.737349 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":46,"raft.run_cpu_time_us":33,"raft.run_wall_time_us":33,"replication_time_us":1258530,"spinlock_wait_cycles":63232}]]}
I20250115 10:12:02.737643 3094 rpcz_store.cc:276] 0115 10:12:01.479082 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479309 (+ 227us) service_pool.cc:225] Handling call
0115 10:12:01.479392 (+ 83us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.479397 (+ 5us) catalog_manager.cc:3627] Apply alter schema
0115 10:12:01.479408 (+ 11us) catalog_manager.cc:3659] Acquired catalog manager lock
0115 10:12:01.479415 (+ 7us) catalog_manager.cc:3817] Updating metadata on disk
0115 10:12:02.737612 (+1258197us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.479609 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.479613 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.479613 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.479613 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.479616 (+ 3us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.479617 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.479617 (+ 0us) tablet.cc:682] Acquiring locks for 1 operations
0115 10:12:01.479620 (+ 3us) tablet.cc:698] Row locks acquired
0115 10:12:01.479620 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.479621 (+ 1us) write_op.cc:270] Start()
0115 10:12:01.479622 (+ 1us) write_op.cc:276] Timestamp: P: 1736935921479596 usec, L: 0
0115 10:12:01.479623 (+ 1us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.479643 (+ 20us) log.cc:844] Serialized 405 byte log entry
0115 10:12:02.737487 (+1257844us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.737488 (+ 1us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.737488 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.737494 (+ 6us) write_op.cc:454] Released schema lock
0115 10:12:02.737495 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"replication_time_us":1257862,"spinlock_wait_cycles":9088}]]}
I20250115 10:12:02.737509 3095 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46172 (request call id 961) took 1258 ms. Trace:
W20250115 10:12:02.737833 3094 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.217.130:37017 (request call id 252) took 1032 ms (client timeout 1000 ms). Trace:
W20250115 10:12:02.737848 3101 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20250115 10:12:02.737833 3097 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.2.217.131:44957 (request call id 354) took 1253 ms (client timeout 1000 ms). Trace:
I20250115 10:12:02.737939 3101 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 963) took 1258 ms. Trace:
W20250115 10:12:02.737926 3097 rpcz_store.cc:269] 0115 10:12:01.484482 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.737804 (+1253322us) service_pool.cc:212] Skipping call since client already timed out
0115 10:12:02.737827 (+ 23us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20250115 10:12:02.737900 3094 rpcz_store.cc:269] 0115 10:12:01.705401 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.737808 (+1032407us) service_pool.cc:212] Skipping call since client already timed out
0115 10:12:02.737828 (+ 20us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20250115 10:12:02.737968 3101 rpcz_store.cc:276] 0115 10:12:01.479096 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479159 (+ 63us) service_pool.cc:225] Handling call
0115 10:12:01.479265 (+ 106us) catalog_manager.cc:2076] Acquired catalog manager lock
0115 10:12:01.479296 (+ 31us) catalog_manager.cc:2122] Created new table and tablet info
0115 10:12:02.737938 (+1258642us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.479578 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.479582 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.479582 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.479582 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.479586 (+ 4us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.479586 (+ 0us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.479586 (+ 0us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.479589 (+ 3us) tablet.cc:698] Row locks acquired
0115 10:12:01.479590 (+ 1us) write_op.cc:260] PREPARE: finished
0115 10:12:01.479591 (+ 1us) write_op.cc:270] Start()
0115 10:12:01.479592 (+ 1us) write_op.cc:276] Timestamp: P: 1736935921479566 usec, L: 0
0115 10:12:01.479592 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.479602 (+ 10us) log.cc:844] Serialized 433 byte log entry
0115 10:12:02.737452 (+1257850us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.737453 (+ 1us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.737453 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.737455 (+ 2us) write_op.cc:454] Released schema lock
0115 10:12:02.737456 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":212,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"replication_time_us":1257858}]]}
I20250115 10:12:02.737876 3095 rpcz_store.cc:276] 0115 10:12:01.479067 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479110 (+ 43us) service_pool.cc:225] Handling call
0115 10:12:01.479204 (+ 94us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.479213 (+ 9us) catalog_manager.cc:3627] Apply alter schema
0115 10:12:01.479227 (+ 14us) catalog_manager.cc:3659] Acquired catalog manager lock
0115 10:12:01.479239 (+ 12us) catalog_manager.cc:3817] Updating metadata on disk
0115 10:12:02.737504 (+1258265us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.479501 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.479509 (+ 8us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.479509 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.479510 (+ 1us) tablet.cc:659] Decoding operations
0115 10:12:01.479517 (+ 7us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.479519 (+ 2us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.479520 (+ 1us) tablet.cc:682] Acquiring locks for 1 operations
0115 10:12:01.479526 (+ 6us) tablet.cc:698] Row locks acquired
0115 10:12:01.479526 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.479531 (+ 5us) write_op.cc:270] Start()
0115 10:12:01.479534 (+ 3us) write_op.cc:276] Timestamp: P: 1736935921479505 usec, L: 0
0115 10:12:01.479534 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.479558 (+ 24us) log.cc:844] Serialized 405 byte log entry
0115 10:12:02.737408 (+1257850us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.737408 (+ 0us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.737409 (+ 1us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.737410 (+ 1us) write_op.cc:454] Released schema lock
0115 10:12:02.737410 (+ 0us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"replication_time_us":1257870}]]}
I20250115 10:12:02.737510 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1177
I20250115 10:12:02.738642 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1178
W20250115 10:12:02.738651 3100 catalog_manager.cc:2786] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.738694 3100 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46172 (request call id 959) took 1259 ms. Trace:
W20250115 10:12:02.738708 3093 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250115 10:12:02.738773 3093 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 960) took 1259 ms. Trace:
I20250115 10:12:02.738790 3093 rpcz_store.cc:276] 0115 10:12:01.479052 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479114 (+ 62us) service_pool.cc:225] Handling call
0115 10:12:01.479796 (+ 682us) catalog_manager.cc:2076] Acquired catalog manager lock
0115 10:12:01.479831 (+ 35us) catalog_manager.cc:2122] Created new table and tablet info
0115 10:12:02.738772 (+1258941us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.479918 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.479921 (+ 3us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.479921 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.479921 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.479925 (+ 4us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.479925 (+ 0us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.479926 (+ 1us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.479929 (+ 3us) tablet.cc:698] Row locks acquired
0115 10:12:01.479929 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.479931 (+ 2us) write_op.cc:270] Start()
0115 10:12:01.479932 (+ 1us) write_op.cc:276] Timestamp: P: 1736935921479906 usec, L: 0
0115 10:12:01.479933 (+ 1us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.479941 (+ 8us) log.cc:844] Serialized 433 byte log entry
0115 10:12:02.738670 (+1258729us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.738671 (+ 1us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.738672 (+ 1us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.738675 (+ 3us) write_op.cc:454] Released schema lock
0115 10:12:02.738676 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":11520,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"replication_time_us":1258735}]]}
I20250115 10:12:02.738734 3100 rpcz_store.cc:276] 0115 10:12:01.479033 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479051 (+ 18us) service_pool.cc:225] Handling call
0115 10:12:01.479766 (+ 715us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.479771 (+ 5us) catalog_manager.cc:2753] Modifying in-memory table state
0115 10:12:01.479779 (+ 8us) catalog_manager.cc:2762] Locking tablets
0115 10:12:01.479785 (+ 6us) catalog_manager.cc:2776] Removing table and tablets from system table
0115 10:12:02.738692 (+1258907us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.479867 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.479872 (+ 5us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.479872 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.479872 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.479878 (+ 6us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.479879 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.479880 (+ 1us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.479885 (+ 5us) tablet.cc:698] Row locks acquired
0115 10:12:01.479886 (+ 1us) write_op.cc:260] PREPARE: finished
0115 10:12:01.479888 (+ 2us) write_op.cc:270] Start()
0115 10:12:01.479890 (+ 2us) write_op.cc:276] Timestamp: P: 1736935921479863 usec, L: 0
0115 10:12:01.479890 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.479905 (+ 15us) log.cc:844] Serialized 533 byte log entry
0115 10:12:02.738617 (+1258712us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.738619 (+ 2us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.738619 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.738623 (+ 4us) write_op.cc:454] Released schema lock
0115 10:12:02.738624 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":14,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"replication_time_us":1258721}]]}
I20250115 10:12:02.738687 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1179
I20250115 10:12:02.739259 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1180
I20250115 10:12:02.739296 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1181
W20250115 10:12:02.739498 3099 catalog_manager.cc:3841] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.739545 3099 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46172 (request call id 966) took 1259 ms. Trace:
I20250115 10:12:02.739569 3099 rpcz_store.cc:276] 0115 10:12:01.480464 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.480507 (+ 43us) service_pool.cc:225] Handling call
0115 10:12:01.480604 (+ 97us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.480612 (+ 8us) catalog_manager.cc:3627] Apply alter schema
0115 10:12:01.480624 (+ 12us) catalog_manager.cc:3659] Acquired catalog manager lock
0115 10:12:01.480633 (+ 9us) catalog_manager.cc:3817] Updating metadata on disk
0115 10:12:02.739543 (+1258910us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.480726 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.480733 (+ 7us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.480733 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.480733 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.480738 (+ 5us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.480739 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.480740 (+ 1us) tablet.cc:682] Acquiring locks for 1 operations
0115 10:12:01.480744 (+ 4us) tablet.cc:698] Row locks acquired
0115 10:12:01.480744 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.480747 (+ 3us) write_op.cc:270] Start()
0115 10:12:01.480749 (+ 2us) write_op.cc:276] Timestamp: P: 1736935921480722 usec, L: 0
0115 10:12:01.480750 (+ 1us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.480780 (+ 30us) log.cc:844] Serialized 405 byte log entry
0115 10:12:02.739378 (+1258598us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.739379 (+ 1us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.739380 (+ 1us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.739385 (+ 5us) write_op.cc:454] Released schema lock
0115 10:12:02.739387 (+ 2us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":43,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":78,"raft.queue_time_us":31,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":2,"replication_time_us":1258620}]]}
I20250115 10:12:02.739739 3099 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46172 (request call id 972) took 1254 ms. Trace:
I20250115 10:12:02.739753 3094 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46172 (request call id 967) took 1259 ms. Trace:
W20250115 10:12:02.739286 3092 catalog_manager.cc:2786] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.739825 3094 rpcz_store.cc:276] 0115 10:12:01.480724 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.738050 (+1257326us) service_pool.cc:225] Handling call
0115 10:12:02.739694 (+ 1644us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x55a7e54e6c14. stack: 00007f41d36d40ba 00007f41d4217b8d 00007f41d4e36e15 00007f41d4ec5842 00007f41d3cba557 00007f41d3cbb4fb 00007f41d36e6e93 00007f41d3a126da 00007f41d1b4371e
0115 10:12:02.739749 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3265920}
I20250115 10:12:02.739864 3092 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46172 (request call id 964) took 1260 ms. Trace:
I20250115 10:12:02.739907 3094 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 973) took 1236 ms. Trace:
I20250115 10:12:02.739936 3094 rpcz_store.cc:276] 0115 10:12:01.503591 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.739868 (+1236277us) service_pool.cc:225] Handling call
0115 10:12:02.739905 (+ 37us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250115 10:12:02.740015 3094 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 974) took 1235 ms. Trace:
I20250115 10:12:02.739785 3099 rpcz_store.cc:276] 0115 10:12:01.484858 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.739668 (+1254810us) service_pool.cc:225] Handling call
0115 10:12:02.739737 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250115 10:12:02.740039 3094 rpcz_store.cc:276] 0115 10:12:01.504289 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.739989 (+1235700us) service_pool.cc:225] Handling call
0115 10:12:02.740013 (+ 24us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250115 10:12:02.740087 3094 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 976) took 1234 ms. Trace:
I20250115 10:12:02.740101 3099 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 975) took 1235 ms. Trace:
I20250115 10:12:02.740108 3094 rpcz_store.cc:276] 0115 10:12:01.505448 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.740064 (+1234616us) service_pool.cc:225] Handling call
0115 10:12:02.740086 (+ 22us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250115 10:12:02.740137 3099 rpcz_store.cc:276] 0115 10:12:01.505054 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.740052 (+1234998us) service_pool.cc:225] Handling call
0115 10:12:02.740099 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20250115 10:12:02.739315 3098 catalog_manager.cc:2786] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20250115 10:12:02.740211 3098 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46172 (request call id 965) took 1260 ms. Trace:
I20250115 10:12:02.740231 3098 rpcz_store.cc:276] 0115 10:12:01.479991 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.480073 (+ 82us) service_pool.cc:225] Handling call
0115 10:12:01.480179 (+ 106us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.480182 (+ 3us) catalog_manager.cc:2753] Modifying in-memory table state
0115 10:12:01.480187 (+ 5us) catalog_manager.cc:2762] Locking tablets
0115 10:12:01.480191 (+ 4us) catalog_manager.cc:2776] Removing table and tablets from system table
0115 10:12:02.740209 (+1260018us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.480330 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.480334 (+ 4us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.480335 (+ 1us) write_op.cc:435] Acquired schema lock
0115 10:12:01.480335 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.480340 (+ 5us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.480341 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.480341 (+ 0us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.480345 (+ 4us) tablet.cc:698] Row locks acquired
0115 10:12:01.480345 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.480347 (+ 2us) write_op.cc:270] Start()
0115 10:12:01.480349 (+ 2us) write_op.cc:276] Timestamp: P: 1736935921480322 usec, L: 0
0115 10:12:01.480349 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.480361 (+ 12us) log.cc:844] Serialized 533 byte log entry
0115 10:12:02.739280 (+1258919us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.739281 (+ 1us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.739281 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.739282 (+ 1us) write_op.cc:454] Released schema lock
0115 10:12:02.739283 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":44,"raft.queue_time_us":20,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":1,"replication_time_us":1258928}]]}
I20250115 10:12:02.739886 3092 rpcz_store.cc:276] 0115 10:12:01.479465 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.479641 (+ 176us) service_pool.cc:225] Handling call
0115 10:12:01.479966 (+ 325us) catalog_manager.cc:2348] Looking up, locking, and authorizing table
0115 10:12:01.479969 (+ 3us) catalog_manager.cc:2753] Modifying in-memory table state
0115 10:12:01.479978 (+ 9us) catalog_manager.cc:2762] Locking tablets
0115 10:12:01.479982 (+ 4us) catalog_manager.cc:2776] Removing table and tablets from system table
0115 10:12:02.739863 (+1259881us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.480256 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.480262 (+ 6us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.480263 (+ 1us) write_op.cc:435] Acquired schema lock
0115 10:12:01.480263 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.480270 (+ 7us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.480271 (+ 1us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.480272 (+ 1us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.480278 (+ 6us) tablet.cc:698] Row locks acquired
0115 10:12:01.480278 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.480281 (+ 3us) write_op.cc:270] Start()
0115 10:12:01.480283 (+ 2us) write_op.cc:276] Timestamp: P: 1736935921480255 usec, L: 0
0115 10:12:01.480283 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.480302 (+ 19us) log.cc:844] Serialized 533 byte log entry
0115 10:12:02.739235 (+1258933us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.739237 (+ 2us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.739237 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.739240 (+ 3us) write_op.cc:454] Released schema lock
0115 10:12:02.739241 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":3328,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":199,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":71,"raft.queue_time_us":66,"raft.run_cpu_time_us":2,"raft.run_wall_time_us":3,"replication_time_us":1258948}]]}
I20250115 10:12:02.739753 3101 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46172 (request call id 968) took 1257 ms. Trace:
I20250115 10:12:02.740381 3101 rpcz_store.cc:276] 0115 10:12:01.482091 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.738089 (+1255998us) service_pool.cc:225] Handling call
0115 10:12:02.739694 (+ 1605us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x55a7e54e6c14. stack: 00007f41d36d40ba 00007f41d4217b8d 00007f41d4e36e15 00007f41d4ec5842 00007f41d3cba557 00007f41d3cbb4fb 00007f41d36e6e93 00007f41d3a126da 00007f41d1b4371e
0115 10:12:02.739749 (+ 55us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3238144}
I20250115 10:12:02.740648 3100 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46172 (request call id 971) took 1256 ms. Trace:
I20250115 10:12:02.740680 3100 rpcz_store.cc:276] 0115 10:12:01.484466 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.739018 (+1254552us) service_pool.cc:225] Handling call
0115 10:12:02.740615 (+ 1597us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x55a7e54e6c14. stack: 00007f41d36d40ba 00007f41d4217b8d 00007f41d4e36e15 00007f41d4ec52c2 00007f41d3cba557 00007f41d3cbb4fb 00007f41d36e6e93 00007f41d3a126da 00007f41d1b4371e
0115 10:12:02.740643 (+ 28us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3430144}
I20250115 10:12:02.740748 3093 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 970) took 1256 ms. Trace:
I20250115 10:12:02.740767 3093 rpcz_store.cc:276] 0115 10:12:01.484444 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.738869 (+1254425us) service_pool.cc:225] Handling call
0115 10:12:02.740725 (+ 1856us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x55a7e54e6c14. stack: 00007f41d36d40ba 00007f41d4217b8d 00007f41d4e36e15 00007f41d4ec50c2 00007f41d3cba557 00007f41d3cbb4fb 00007f41d36e6e93 00007f41d3a126da 00007f41d1b4371e
0115 10:12:02.740747 (+ 22us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3713280}
I20250115 10:12:02.740885 3095 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 969) took 1257 ms. Trace:
I20250115 10:12:02.740906 3095 rpcz_store.cc:276] 0115 10:12:01.483641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:02.738244 (+1254603us) service_pool.cc:225] Handling call
0115 10:12:02.740839 (+ 2595us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x55a7e54e6c14. stack: 00007f41d36d40ba 00007f41d4217b8d 00007f41d4e36e15 00007f41d4ec50c2 00007f41d3cba557 00007f41d3cbb4fb 00007f41d36e6e93 00007f41d3a126da 00007f41d1b4371e
0115 10:12:02.740884 (+ 45us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5074304}
W20250115 10:12:02.742136 3088 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3c778d7be748405285068f36650902b0 has no consensus state
W20250115 10:12:02.743989 3605 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.217.188:38283)
W20250115 10:12:02.744077 3605 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.2.217.188:38283)
W20250115 10:12:02.744189 3605 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.2.217.188:38283)
I20250115 10:12:02.744910 4538 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1172, Last known committed idx: 1171, Time since last communication: 0.000s
I20250115 10:12:02.744979 4538 consensus_queue.cc:1225] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [LEADER]: Peer cdb1ea5a27ca44baa3b0fe127143df0b log is divergent from this leader: its last log entry 2.1172 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1171
W20250115 10:12:02.745079 3484 consensus_peers.cc:487] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d667834206fe4410a22b4944b3494462. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:02.746294 4446 master_runner.cc:232] Existing masters have differing terms: 2 vs 3
I20250115 10:12:02.746348 4446 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20250115 10:12:02.747020 3111 pending_rounds.cc:77] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting all ops after (but not including) 1171
I20250115 10:12:02.747064 3111 pending_rounds.cc:99] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b: Aborting uncommitted WRITE_OP operation due to leader change: 2.1172
W20250115 10:12:02.747143 3096 catalog_manager.cc:2177] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20250115 10:12:02.747203 3096 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46172 (request call id 957) took 1268 ms. Trace:
I20250115 10:12:02.747228 3096 rpcz_store.cc:276] 0115 10:12:01.478293 (+ 0us) service_pool.cc:168] Inserting onto call queue
0115 10:12:01.478325 (+ 32us) service_pool.cc:225] Handling call
0115 10:12:01.478533 (+ 208us) catalog_manager.cc:2076] Acquired catalog manager lock
0115 10:12:01.478580 (+ 47us) catalog_manager.cc:2122] Created new table and tablet info
0115 10:12:02.747200 (+1268620us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0115 10:12:01.478669 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0115 10:12:01.478678 (+ 9us) write_op.cc:432] Acquiring schema lock in shared mode
0115 10:12:01.478678 (+ 0us) write_op.cc:435] Acquired schema lock
0115 10:12:01.478678 (+ 0us) tablet.cc:659] Decoding operations
0115 10:12:01.478688 (+ 10us) write_op.cc:620] Acquiring the partition lock for write op
0115 10:12:01.478691 (+ 3us) write_op.cc:641] Partition lock acquired for write op
0115 10:12:01.478692 (+ 1us) tablet.cc:682] Acquiring locks for 2 operations
0115 10:12:01.478702 (+ 10us) tablet.cc:698] Row locks acquired
0115 10:12:01.478702 (+ 0us) write_op.cc:260] PREPARE: finished
0115 10:12:01.478709 (+ 7us) write_op.cc:270] Start()
0115 10:12:01.478713 (+ 4us) write_op.cc:276] Timestamp: P: 1736935921478683 usec, L: 0
0115 10:12:01.478713 (+ 0us) op_driver.cc:348] REPLICATION: starting
0115 10:12:01.478745 (+ 32us) log.cc:844] Serialized 433 byte log entry
0115 10:12:02.747094 (+1268349us) op_driver.cc:464] REPLICATION: finished
0115 10:12:02.747096 (+ 2us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0115 10:12:02.747096 (+ 0us) write_op.cc:489] Releasing partition, row and schema locks
0115 10:12:02.747101 (+ 5us) write_op.cc:454] Released schema lock
0115 10:12:02.747102 (+ 1us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":21,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":104,"raft.queue_time_us":96,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"replication_time_us":1268373}]]}
I20250115 10:12:02.747606 4545 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.747694 4545 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:02.748423 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f9afec8418444e6a9efd2a70f734c330"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.748627 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9afec8418444e6a9efd2a70f734c330 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.748924 4476 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2e652a03e1bc4c1dbd283ba700042ed8" } new_table_name: "default.Table_4b98590d43434ddb8446bd4c522dee69" modify_external_catalogs: true
I20250115 10:12:02.749183 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9cb4c818781b40d58f604ee6907db77b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.749269 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cb4c818781b40d58f604ee6907db77b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.749387 4470 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_46f968c8803347b8b7339b5602e32031" } new_table_name: "default.Table_547a65dbda1749c082cfb2aa9f2a2285" modify_external_catalogs: true
I20250115 10:12:02.749487 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_81168f61f4744059b5716b277280c70c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.749531 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81168f61f4744059b5716b277280c70c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.749606 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6bf1b753120b4945929a94625d231802" } modify_external_catalogs: true
I20250115 10:12:02.749630 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6bf1b753120b4945929a94625d231802" } modify_external_catalogs: true
I20250115 10:12:02.749691 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_745464477b4d4be793cf32e945afc9f3" } new_table_name: "default.Table_b4cf6a94f66841f9b76c78de6287614e" modify_external_catalogs: true
I20250115 10:12:02.749771 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b1441ec916974e33a6e5a290afd937f2" } new_table_name: "default.Table_fe545b7b662f4b1ea513d915b9c36acf" modify_external_catalogs: true
I20250115 10:12:02.749871 4469 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1cbd1f5d9b4243c9b562f75483e4faad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.749917 4469 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cbd1f5d9b4243c9b562f75483e4faad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.749991 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_82dccea1c581459d84b2c919ff1b789f" } modify_external_catalogs: true
I20250115 10:12:02.750013 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_82dccea1c581459d84b2c919ff1b789f" } modify_external_catalogs: true
I20250115 10:12:02.752329 4541 mvcc.cc:204] Tried to move back new op lower bound from 7114489539525881856 to 7114489539408736256. Current Snapshot: MvccSnapshot[applied={T|T < 7114489539525881856}]
I20250115 10:12:02.752517 4520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.752591 4520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:12:02.755944 4545 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.756080 4545 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdb1ea5a27ca44baa3b0fe127143df0b [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:02.757258 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet d667834206fe4410a22b4944b3494462 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:02.758317 4476 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9077d0eed1974bc898370b5d5554be71 consensus state has no leader
I20250115 10:12:02.758420 4476 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9d52dcd1ccf440018ac9b2aec17bd275"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.758522 4476 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d52dcd1ccf440018ac9b2aec17bd275 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.758702 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_986991a3650c46aebfbc781c1ca6dc6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.758780 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_986991a3650c46aebfbc781c1ca6dc6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:02.758903 4470 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60cc9a1b2c4348ada0d8dab958aded09 consensus state has no leader
I20250115 10:12:02.758963 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8c3be9ad849f479dbc770b2d6ec9f237"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.759047 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c3be9ad849f479dbc770b2d6ec9f237 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.759219 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9557727fc0e5449ba95961d750b88bc4" } modify_external_catalogs: true
I20250115 10:12:02.759269 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9557727fc0e5449ba95961d750b88bc4" } modify_external_catalogs: true
W20250115 10:12:02.759472 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fa36e39d9f1c4cecbd0f6679b0397e3c consensus state has no leader
I20250115 10:12:02.759526 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0c75970bf5ff4311a8bacd12c3ec98d7" } modify_external_catalogs: true
I20250115 10:12:02.759562 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0c75970bf5ff4311a8bacd12c3ec98d7" } modify_external_catalogs: true
W20250115 10:12:02.759729 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7144ec81e9244eb49715450aeda5f82f consensus state has no leader
I20250115 10:12:02.759783 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4f01791bcbd34a10bc736ecbd706f53d" } new_table_name: "default.Table_045a1ead2aaf41af83c54e75caaed252" modify_external_catalogs: true
I20250115 10:12:02.759907 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 1b251ef905b74375bd9b387cc8b057c0 (DEFAULT_TABLE table=default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.759963 4469 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ee9e9053bc3f4441967dea174020753e" } modify_external_catalogs: true
I20250115 10:12:02.760002 4469 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ee9e9053bc3f4441967dea174020753e" } modify_external_catalogs: true
I20250115 10:12:02.760023 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251ef905b74375bd9b387cc8b057c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.760221 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (DEFAULT_TABLE table=default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.760254 3525 tablet_service.cc:1467] Processing CreateTablet for tablet ff89486cde3f49528e4007189911ce4e (DEFAULT_TABLE table=default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.760318 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.760368 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff89486cde3f49528e4007189911ce4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.760429 3514 tablet_service.cc:1467] Processing CreateTablet for tablet b2462c50d3684176aa5ff5caf79f9644 (DEFAULT_TABLE table=default.Table_25066f18e8044d3a88bc2548ecabd41a [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.760497 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2462c50d3684176aa5ff5caf79f9644. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.761245 3529 tablet_service.cc:1467] Processing CreateTablet for tablet d190044d103e441193e224c667108543 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.761309 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d190044d103e441193e224c667108543. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.761508 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 2836a492586e489daafc2da719455f39 (DEFAULT_TABLE table=default.Table_39ee61035d3b403086a48a76cb6370e4 [id=dfff9fb7e37e4beb8e5ed6c321814a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.761580 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2836a492586e489daafc2da719455f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.761667 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d42535a811dc420b94527f7d81efdd13 (DEFAULT_TABLE table=default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.761737 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42535a811dc420b94527f7d81efdd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.762176 3529 tablet_service.cc:1467] Processing CreateTablet for tablet a4af01517cb04be983456a98153f6146 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.762245 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4af01517cb04be983456a98153f6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.762532 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 9bc7d63d8661445cb804762413eac194 (DEFAULT_TABLE table=default.Table_056453db36d0482f9828ea16ed3767c4 [id=f7cac8ff4a2f4f47961cfa687ac95f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.762607 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc7d63d8661445cb804762413eac194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.762710 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 28861e966ce645878983bec6476255bb (DEFAULT_TABLE table=default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.762794 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28861e966ce645878983bec6476255bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.763161 3524 tablet_service.cc:1467] Processing CreateTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.763234 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff61c5261f44b12b0da4cd3b6e58ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.763780 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 5461620a4b644906ad7d9694dfc80177 (DEFAULT_TABLE table=default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.763828 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 (DEFAULT_TABLE table=default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.763867 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5461620a4b644906ad7d9694dfc80177. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.763904 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 3c66c13648b6478b8420778f48ba208a (DEFAULT_TABLE table=default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.763926 3528 tablet_service.cc:1467] Processing CreateTablet for tablet f9256780f6e94b7ebd1276df07baf19d (DEFAULT_TABLE table=default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.763983 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66c13648b6478b8420778f48ba208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.764089 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9256780f6e94b7ebd1276df07baf19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.764354 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd6b39cd88247bfa120903465b676b2 (DEFAULT_TABLE table=default.Table_32ae9c8978b2495c93454b757401f5ff [id=eff900c27c8440e9a460c50fb125893f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.764428 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd6b39cd88247bfa120903465b676b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.765110 3511 tablet_service.cc:1467] Processing CreateTablet for tablet cd8b9bf010d245be919f1e912b103770 (DEFAULT_TABLE table=default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.765147 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed45d371a34a51a42fb04f4a450ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.765460 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 3b89df9f987e46ae98fe21df847cb311 (DEFAULT_TABLE table=default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.765549 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b89df9f987e46ae98fe21df847cb311. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.765770 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8b9bf010d245be919f1e912b103770. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.766654 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0541097b0b4916b559c14e48e08540 (DEFAULT_TABLE table=default.Table_bc518eaf2d604c7e9ce859e76a6d72ac [id=ec98d4501a674ea1888c0b341153947c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.766728 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0541097b0b4916b559c14e48e08540. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.767724 3519 tablet_service.cc:1467] Processing CreateTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.767761 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c0b9984c36924f0fbab00b37829f98ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:02.767810 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b580a5dc6a9c4a0f8b65ad9a92804e09. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.767853 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0b9984c36924f0fbab00b37829f98ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.768393 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 0c6a04e982ee493d815322ec6b2f267e (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.768482 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6a04e982ee493d815322ec6b2f267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.768854 3523 tablet_service.cc:1467] Processing CreateTablet for tablet b3e3be71c4324a5589a397ae76198f27 (DEFAULT_TABLE table=default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.768889 3483 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:54164 dropped due to backpressure: service queue is full with 50 items
I20250115 10:12:02.768932 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 75ab349b64b745ed97c3dae843b059aa (DEFAULT_TABLE table=default.Table_b854510e625043a7b89fa31b5d30acfb [id=eb27a3b7ec52442a882104e9ffaf008b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.768971 3511 tablet_service.cc:1467] Processing CreateTablet for tablet c35ca809b19541479146f385e1d3cebe (DEFAULT_TABLE table=default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.769078 3516 tablet_service.cc:1467] Processing CreateTablet for tablet cfe7181347114ccfbf62109147d182b3 (DEFAULT_TABLE table=default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.769166 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 6f33cd582313436ba2a8a71cb708384c (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.768898 3518 tablet_service.cc:1467] Processing CreateTablet for tablet b573af4521064addb5bf2da9c70a79f0 (DEFAULT_TABLE table=default.Table_4f01791bcbd34a10bc736ecbd706f53d [id=eb7190820bc3484982ba925dfd67b9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.769454 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6621592191408cb1eeaf69869258a5 (DEFAULT_TABLE table=default.Table_c73488a369ec4bc196196444fa9c3632 [id=4fdef59a83b241a785c3ed32b8eeb977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.771898 3513 tablet_service.cc:1467] Processing CreateTablet for tablet def9cfbc6f764499b1c6ac9b6845f5ed (DEFAULT_TABLE table=default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.773456 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (DEFAULT_TABLE table=default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.773823 3597 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
W20250115 10:12:02.773866 4463 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:54164 dropped due to backpressure: service queue is full with 50 items
I20250115 10:12:02.773962 3528 tablet_service.cc:1467] Processing CreateTablet for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193 (DEFAULT_TABLE table=default.Table_3632a48440e242ac8a768d8757c6f577 [id=b0be58963f2a48e2be7e161f71298d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.768940 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3be71c4324a5589a397ae76198f27. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.774477 3484 consensus_peers.cc:487] T 8cbfcedc2f5447a1acb095066d131d52 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cbfcedc2f5447a1acb095066d131d52. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:02.774595 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7181347114ccfbf62109147d182b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.774724 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9cfbc6f764499b1c6ac9b6845f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.775393 3523 tablet_service.cc:1467] Processing CreateTablet for tablet f560f9e7e84d47faa147b33495e85055 (DEFAULT_TABLE table=default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.775467 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560f9e7e84d47faa147b33495e85055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.775682 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (DEFAULT_TABLE table=default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.775749 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 8191b81bdad74a9b8aa049473325720b (DEFAULT_TABLE table=default.Table_f6a790f7709f440d98f1567067ed68a2 [id=47674ee5aac44634ba202fe90d14d49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.775791 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbd61aec79d479d9eea8d807cd5fb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.776146 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8191b81bdad74a9b8aa049473325720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.776455 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 (DEFAULT_TABLE table=default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.776526 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbb9cfc01df408eaae41b38e8c62c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.776818 3516 tablet_service.cc:1467] Processing CreateTablet for tablet ad975dacafc94bc89c3996aa58a9b5a1 (DEFAULT_TABLE table=default.Table_7ed5666a03e441d8bd5b20eb88d5910a [id=81d22d650beb49f5827086b74342581e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.776885 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad975dacafc94bc89c3996aa58a9b5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.777191 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 140bf4fc35274f2284c24534d3644695 (DEFAULT_TABLE table=default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.777280 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140bf4fc35274f2284c24534d3644695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.777578 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ab349b64b745ed97c3dae843b059aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.777824 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 74a62d026bb94c0fb908b36b38aa0f7f (DEFAULT_TABLE table=default.Table_080e6f46b4a4430fbbe8ae52c0055a43 [id=1faa87a45ad24ea7a41e678ed5b4c8d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.777890 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a62d026bb94c0fb908b36b38aa0f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.778220 3513 tablet_service.cc:1467] Processing CreateTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 (DEFAULT_TABLE table=default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.778290 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae1ff74cce48ada0a373f9e65508a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.778335 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b573af4521064addb5bf2da9c70a79f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.778651 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 509f854a424e497f8fa72b70d5f0f651 (DEFAULT_TABLE table=default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.778741 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f854a424e497f8fa72b70d5f0f651. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.779424 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 71c23863beb24d27b337fa039d7f04cd (DEFAULT_TABLE table=default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.779457 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 1e9c62a11d4744e199765f855fd0840b (DEFAULT_TABLE table=default.Table_1eacbd293bea443fa0780ba898123200 [id=3d13f917c9a04d4cb429be32533ec2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.779492 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c23863beb24d27b337fa039d7f04cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.779613 3517 tablet_service.cc:1467] Processing CreateTablet for tablet d0e3265da9be49518705bedf6daa27a1 (DEFAULT_TABLE table=default.Table_d63e50fd58fd4335ba0165af0f856032 [id=3bedd46181134cf7bdc3b443a5aff915]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.779680 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3265da9be49518705bedf6daa27a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.779810 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c62a11d4744e199765f855fd0840b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.780398 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 21d5a121a87648ecbb842f52bc361602 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.780462 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d5a121a87648ecbb842f52bc361602. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.780542 3517 tablet_service.cc:1467] Processing CreateTablet for tablet bc3658cad19e46969abecacf490f43f1 (DEFAULT_TABLE table=default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.780608 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc3658cad19e46969abecacf490f43f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.780711 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 62aee0b0490e44a3aa820781bc9e4072 (DEFAULT_TABLE table=default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 [id=86e6124c18724ba1bc7fc8c8772d1fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.780777 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aee0b0490e44a3aa820781bc9e4072. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.781308 3518 tablet_service.cc:1467] Processing CreateTablet for tablet e91450b4369844ea9ab09383b3dbc8ee (DEFAULT_TABLE table=default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.781373 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91450b4369844ea9ab09383b3dbc8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.781437 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 77cd70765e54417fbf6234fe59480518 (DEFAULT_TABLE table=default.Table_d2c4a3b2009e4f548be4457d598fff95 [id=386128b91ada4ecca121f2d2053390a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.781503 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd70765e54417fbf6234fe59480518. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.781634 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 8441d13c5b0c47bb9e16655c964ab58f (DEFAULT_TABLE table=default.Table_c0ff9042b1554e91a840ad8adde05cc9 [id=a02b68d5690c4d22bd6228e2cda045c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.781697 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8441d13c5b0c47bb9e16655c964ab58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.782202 3518 tablet_service.cc:1467] Processing CreateTablet for tablet d368093a74ba4918b0efcc3a909c3a07 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.782264 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368093a74ba4918b0efcc3a909c3a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.782343 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 74ab86571c3a469da7a51cf6033c5b10 (DEFAULT_TABLE table=default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.782410 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab86571c3a469da7a51cf6033c5b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.782568 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 6be683cdd24844eebaad0ed6a36be25f (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.782676 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be683cdd24844eebaad0ed6a36be25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.783144 3518 tablet_service.cc:1467] Processing CreateTablet for tablet af48bf64e2ca4a3197805c75fb0a12a6 (DEFAULT_TABLE table=default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.783216 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af48bf64e2ca4a3197805c75fb0a12a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.783399 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 29ed70f5db0e492eaf0c42e005736ad1 (DEFAULT_TABLE table=default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.783478 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ed70f5db0e492eaf0c42e005736ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.783607 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 8093f8487b9844718707e2fcdd3ae833 (DEFAULT_TABLE table=default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.783684 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8093f8487b9844718707e2fcdd3ae833. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.783747 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f33cd582313436ba2a8a71cb708384c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.784021 3530 tablet_service.cc:1467] Processing CreateTablet for tablet ae2368e4ae294470995667b87ad701fe (DEFAULT_TABLE table=default.Table_c44d243878514ff19a0f78c47f415f6a [id=15c6ceedaafb48a4b75f0e3838295b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.784102 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2368e4ae294470995667b87ad701fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.784919 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 8a485231d2de4fab8b86b4900976c76c (DEFAULT_TABLE table=default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.784991 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a485231d2de4fab8b86b4900976c76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.785092 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0b60522b15489d9726af73a7bd1ee5 (DEFAULT_TABLE table=default.Table_d90a16759f704e54a0e7cdef7960d41a [id=33c05baa94c64e3d8139905db7e98f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.785198 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0b60522b15489d9726af73a7bd1ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.786115 3515 tablet_service.cc:1467] Processing CreateTablet for tablet d21906d23acc4ab8b81eceb87ead049f (DEFAULT_TABLE table=default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.786195 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21906d23acc4ab8b81eceb87ead049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.786300 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 576e273ac51f4eb498faccab336c479d (DEFAULT_TABLE table=default.Table_c85f35b680824b1e82b624028c053124 [id=6d6c1ae6d0114e97bc24eaedecf1c904]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.786386 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576e273ac51f4eb498faccab336c479d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.787187 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.787272 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3ebf56500b4c97b7553644d62fe83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.787379 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec3c400b50a4c8b9c490158732582f5 (DEFAULT_TABLE table=default.Table_be6f200b0d3f4f46a97001d4956b8e8f [id=bd2ea93d44e4471fbef2e817ef124c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.768858 3519 tablet_service.cc:1467] Processing CreateTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (DEFAULT_TABLE table=default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.787884 3524 tablet_service.cc:1467] Processing CreateTablet for tablet f0d6e064ac3645a0a855d97262f6e9ed (DEFAULT_TABLE table=default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 [id=5f8793d7d917468b822398f75b3c7b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.788223 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.788308 3522 tablet_service.cc:1467] Processing CreateTablet for tablet fc6b5ec8e472414789f9619ae958fa34 (DEFAULT_TABLE table=default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.788399 3521 tablet_service.cc:1467] Processing CreateTablet for tablet fb04f46a17134bc28719be34085f714f (DEFAULT_TABLE table=default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f [id=ebcd9bd681dc4a5298c3599542ce206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.788455 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04f46a17134bc28719be34085f714f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.788583 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.788717 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35ca809b19541479146f385e1d3cebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.788800 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.788923 3525 tablet_service.cc:1467] Processing CreateTablet for tablet d5419822600e463a9efb81ad86a10292 (DEFAULT_TABLE table=default.Table_452d4e866cf043a290b01f92fea60597 [id=56ba6004943340809edbf23f7af8bf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.789036 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.789049 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 97bb29eb3de04d65aa91e7ae8c652170 (DEFAULT_TABLE table=default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.789157 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6621592191408cb1eeaf69869258a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.789328 3529 tablet_service.cc:1467] Processing CreateTablet for tablet bcd888d924fd43b590710613560f16d5 (DEFAULT_TABLE table=default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.790047 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6b5ec8e472414789f9619ae958fa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.790153 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a0bd78c1e7409bb41392fd8f9a0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.790262 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d6e064ac3645a0a855d97262f6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.790345 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fe9bedd4b74166a4f4c34ec0b87f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.790637 3523 tablet_service.cc:1467] Processing CreateTablet for tablet afe405846f924decb1786b338a306f62 (DEFAULT_TABLE table=default.Table_0d43a0379fa042929ffb70c09407e4f2 [id=3094f0694b4b4f308b40e4ffe25cfbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.790783 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec3c400b50a4c8b9c490158732582f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.791146 4462 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 9077d0eed1974bc898370b5d5554be71 (table default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9077d0eed1974bc898370b5d5554be71 consensus state has no leader
I20250115 10:12:02.791774 3521 tablet_service.cc:1467] Processing CreateTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 (DEFAULT_TABLE table=default.Table_0c75970bf5ff4311a8bacd12c3ec98d7 [id=03162de587a24aef8dc6cfcb976fb9b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.791857 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35847dc829b4b3d94c0fb68ec6c2b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.792515 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 7629a309511c4251b1e9ce231ef0fcf0 (DEFAULT_TABLE table=default.Table_b7f5565de66f4ea5884b8c57e72d6613 [id=39e850f5f01a452fba3674612dbc6548]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.792593 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7629a309511c4251b1e9ce231ef0fcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.792860 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 3c778d7be748405285068f36650902b0 (DEFAULT_TABLE table=default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.792937 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c778d7be748405285068f36650902b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.793493 3530 tablet_service.cc:1467] Processing CreateTablet for tablet ce84190f55b14902ab678a98e622dc4f (DEFAULT_TABLE table=default.Table_6cc1bb874cf24449a25401e70c030f9e [id=0161accf9e4545e688d747883ea0114d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.793560 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84190f55b14902ab678a98e622dc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.793900 3521 tablet_service.cc:1467] Processing CreateTablet for tablet b33c7ecdd251412eaeed45e378e5cc75 (DEFAULT_TABLE table=default.Table_93ee920c32874d4888ddf9c25fbdff06 [id=7be4cd372cf148b6ad10b57523e826ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.793967 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c7ecdd251412eaeed45e378e5cc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.794497 3530 tablet_service.cc:1467] Processing CreateTablet for tablet f55439e91f284175a59d35160668fa6c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.794570 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55439e91f284175a59d35160668fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.794754 3521 tablet_service.cc:1467] Processing CreateTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 (DEFAULT_TABLE table=default.Table_82dccea1c581459d84b2c919ff1b789f [id=d232a42364804631b9e5f03417214a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.794834 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc423aad4e7a49eaacb21c73d5d8c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.795600 3530 tablet_service.cc:1467] Processing CreateTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 (DEFAULT_TABLE table=default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.795614 4536 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:02.795684 4536 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:02.796002 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 5d841537abc2437c826e069cc0725ad1 (DEFAULT_TABLE table=default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.795686 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9acac6e5e8a486ea8e269359498c3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.796663 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841537abc2437c826e069cc0725ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.796837 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:02.796972 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:02.797072 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 166e6390660c485c99b2e115fd1b272f (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.797142 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166e6390660c485c99b2e115fd1b272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.797089 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d1416c23bfb64fd684934aa0671cec95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:02.797197 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1416c23bfb64fd684934aa0671cec95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:02.797201 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:12:02.797411 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
W20250115 10:12:02.797457 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:12:02.797474 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:02.797489 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:12:02.797513 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:12:02.797538 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
W20250115 10:12:02.797559 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:12:02.797576 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:12:02.797600 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
W20250115 10:12:02.797624 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:02.797650 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
W20250115 10:12:02.797665 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
I20250115 10:12:02.797646 3518 tablet_service.cc:1467] Processing CreateTablet for tablet a154d22681d34329b497747e84ce41cf (DEFAULT_TABLE table=default.Table_4c4f267ca02940d58bc4543ec80f03ce [id=0949f4256757430885ac07328c985705]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.797685 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
W20250115 10:12:02.797708 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
W20250115 10:12:02.797740 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:02.797739 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154d22681d34329b497747e84ce41cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.797806 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b573af4521064addb5bf2da9c70a79f0 consensus state has no leader
I20250115 10:12:02.797832 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b439b608419f459f8f77a0800a4ef734"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:02.797930 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:02.797976 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet c64affc7645145069d6197ede241585e
W20250115 10:12:02.797921 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b439b608419f459f8f77a0800a4ef734 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:02.798161 3528 tablet_service.cc:1467] Processing CreateTablet for tablet d07f6f091ee847e49d1c64bee583a7a4 (DEFAULT_TABLE table=default.Table_e7a4050314f54e7eb39966cb227cdbb1 [id=e3aea013614447c38bd1f620138574a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.798197 4469 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:02.798230 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07f6f091ee847e49d1c64bee583a7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.798631 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (DEFAULT_TABLE table=default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.798707 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6a615c0c5d4815b540d81ef3357eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.799489 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 41e2e034ea974448922f2cb0529bd196 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.799558 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2e034ea974448922f2cb0529bd196. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.799934 3216 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:43854 dropped due to backpressure: service queue is full with 50 items
I20250115 10:12:02.800657 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 5461620a4b644906ad7d9694dfc80177 (DEFAULT_TABLE table=default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.800763 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5461620a4b644906ad7d9694dfc80177. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.801110 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 1b251ef905b74375bd9b387cc8b057c0 (DEFAULT_TABLE table=default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.801198 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251ef905b74375bd9b387cc8b057c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.802464 3254 tablet_service.cc:1467] Processing CreateTablet for tablet d190044d103e441193e224c667108543 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.802546 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d190044d103e441193e224c667108543. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.803378 4569 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:02.803622 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 2836a492586e489daafc2da719455f39 (DEFAULT_TABLE table=default.Table_39ee61035d3b403086a48a76cb6370e4 [id=dfff9fb7e37e4beb8e5ed6c321814a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.808518 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bb29eb3de04d65aa91e7ae8c652170. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.808629 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe405846f924decb1786b338a306f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.809407 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 (DEFAULT_TABLE table=default.Table_ee9e9053bc3f4441967dea174020753e [id=50e32bfecf514cb0972986f128ff095a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.810449 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5419822600e463a9efb81ad86a10292. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.810734 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09db89ab7dd543559ae8a11e60c8a873. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.810904 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd888d924fd43b590710613560f16d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.812228 4463 catalog_manager.cc:4615] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): CreateTablet RPC failed for tablet 82c66363913e47399c4e1e8533bdadd0: Remote error: Service unavailable: CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:54164 dropped due to backpressure: service queue is full with 50 items
I20250115 10:12:02.812397 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 5185ff7621e742eb81fa8964ec9ff20b (DEFAULT_TABLE table=default.Table_7ce9a506439a41599372c73d37cf0b15 [id=147b41dfa10b45599d423ceac25e8094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.812469 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5185ff7621e742eb81fa8964ec9ff20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.803701 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2836a492586e489daafc2da719455f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.813568 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8e47c05a4b46d9a032852ad67b29ae (DEFAULT_TABLE table=default.Table_16575f283a0b491da19099917b25019d [id=0c3701a4f04444b7bd4bd5e4e0fcd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.813645 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8e47c05a4b46d9a032852ad67b29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.813671 3522 tablet_service.cc:1467] Processing CreateTablet for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (DEFAULT_TABLE table=default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.813776 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.814093 3254 tablet_service.cc:1467] Processing CreateTablet for tablet a4af01517cb04be983456a98153f6146 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.814167 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4af01517cb04be983456a98153f6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.814585 3529 tablet_service.cc:1467] Processing CreateTablet for tablet a76df2d8b00c46949afac48a55d8200f (DEFAULT_TABLE table=default.Table_37e85cc42de44c9ea1e9d33a94d70be8 [id=1a36a0dbf9eb490ba53332a260571b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.814656 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76df2d8b00c46949afac48a55d8200f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.814666 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 46b8efd1622a4efcb009f999cb915dfc (DEFAULT_TABLE table=default.Table_4e44e0cd2af54f0585de9211108521c0 [id=4a0764b4a46f4278973b2c7b7a1cf35f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.814747 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b8efd1622a4efcb009f999cb915dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.815066 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (DEFAULT_TABLE table=default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.815156 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.815626 3529 tablet_service.cc:1467] Processing CreateTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 (DEFAULT_TABLE table=default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.803881 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 9bc7d63d8661445cb804762413eac194 (DEFAULT_TABLE table=default.Table_056453db36d0482f9828ea16ed3767c4 [id=f7cac8ff4a2f4f47961cfa687ac95f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.815893 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc7d63d8661445cb804762413eac194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.816320 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2 (DEFAULT_TABLE table=default.Table_79f48757c279457faeca60d711a7d129 [id=96c9813386964880ad745a3cd4d857e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.816928 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 424956b90563455d8140a49fcaa05206 (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.816965 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6244234f7447debe9cdce30e4919b6 (DEFAULT_TABLE table=default.Table_917623c2758441459e6b366741de339e [id=b46be727cbca46aab34220b80239d39a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.817021 3258 tablet_service.cc:1467] Processing CreateTablet for tablet b3e3be71c4324a5589a397ae76198f27 (DEFAULT_TABLE table=default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.817091 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3be71c4324a5589a397ae76198f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.817687 3528 tablet_service.cc:1467] Processing CreateTablet for tablet ee6597804e5c41618870133c9d4ad1b3 (DEFAULT_TABLE table=default.Table_8b2bd680dfb44952a854b89bf65a2aa9 [id=c7b15c3adc96499b9b60ad4bd58cc3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.818075 3258 tablet_service.cc:1467] Processing CreateTablet for tablet c35ca809b19541479146f385e1d3cebe (DEFAULT_TABLE table=default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.818084 3524 tablet_service.cc:1467] Processing CreateTablet for tablet c85d63cc502f418b91aec39245c707b9 (DEFAULT_TABLE table=default.Table_837ed67810f741a2bfe30f928f9d978c [id=94b2e5bbafba4dd986b674d0041216e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.818150 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35ca809b19541479146f385e1d3cebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.818298 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 3552b8e936ad4aeba0eadc95577f5414 (DEFAULT_TABLE table=default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.819020 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.819092 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a0bd78c1e7409bb41392fd8f9a0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.819134 3519 tablet_service.cc:1467] Processing CreateTablet for tablet 60cc9a1b2c4348ada0d8dab958aded09 (DEFAULT_TABLE table=default.Table_547a65dbda1749c082cfb2aa9f2a2285 [id=f93e7218dc4947b5bc778789c1be1480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.819217 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 5fac40fff8de4004858af6e2ae986d46 (DEFAULT_TABLE table=default.Table_0bfecbf8f6db434c853e2fc9024e5c2d [id=69843267a5254af281348136b8df9daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.815706 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6cdec27e9941ed9b485228f93b4d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.819461 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.803972 3256 tablet_service.cc:1467] Processing CreateTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.819821 3516 tablet_service.cc:1467] Processing CreateTablet for tablet cb353ea066dc474cac07e3adcfa6574d (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.819871 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff61c5261f44b12b0da4cd3b6e58ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.819886 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb353ea066dc474cac07e3adcfa6574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.820348 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 17837499b096462394d993f39efce677 (DEFAULT_TABLE table=default.Table_5cde3d62bc8248f3be5fa8764025bbe0 [id=9871ed3c25464e07acb51a093f7c15d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.820420 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17837499b096462394d993f39efce677. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.820812 3256 tablet_service.cc:1467] Processing CreateTablet for tablet fc6b5ec8e472414789f9619ae958fa34 (DEFAULT_TABLE table=default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.820822 3516 tablet_service.cc:1467] Processing CreateTablet for tablet ef7f182c4bde468d919523c44fdf3ea4 (DEFAULT_TABLE table=default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.820904 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6b5ec8e472414789f9619ae958fa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.820904 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f182c4bde468d919523c44fdf3ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.821328 3515 tablet_service.cc:1467] Processing CreateTablet for tablet c94cb50778e44890bd8c4bdc868673e3 (DEFAULT_TABLE table=default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 [id=988e12ca3c094601a1189d8558614dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.821399 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94cb50778e44890bd8c4bdc868673e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.821820 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 (DEFAULT_TABLE table=default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.821820 3256 tablet_service.cc:1467] Processing CreateTablet for tablet ae2368e4ae294470995667b87ad701fe (DEFAULT_TABLE table=default.Table_c44d243878514ff19a0f78c47f415f6a [id=15c6ceedaafb48a4b75f0e3838295b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.821892 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2368e4ae294470995667b87ad701fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.821892 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f1a39f8a54c4cb21cd17d562c0542. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.822275 3515 tablet_service.cc:1467] Processing CreateTablet for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (DEFAULT_TABLE table=default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.822347 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36e39d9f1c4cecbd0f6679b0397e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.822819 3256 tablet_service.cc:1467] Processing CreateTablet for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193 (DEFAULT_TABLE table=default.Table_3632a48440e242ac8a768d8757c6f577 [id=b0be58963f2a48e2be7e161f71298d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.822814 3516 tablet_service.cc:1467] Processing CreateTablet for tablet f2230f6de9a54e98aa83435d37f68807 (DEFAULT_TABLE table=default.Table_ae474575b4144851ad889119f33259bd [id=da4f430e2a734e3a94a2b2517f52e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.822890 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.822913 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2230f6de9a54e98aa83435d37f68807. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.823377 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 1650bac5bd96467fb3d586b23ebd77be (DEFAULT_TABLE table=default.Table_ca7bc6e893be4465b1582ee64173500c [id=a1b3933dfb524284b565d94d1e849821]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.823452 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650bac5bd96467fb3d586b23ebd77be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804060 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 (DEFAULT_TABLE table=default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.823908 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed45d371a34a51a42fb04f4a450ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.824169 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552b8e936ad4aeba0eadc95577f5414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.824447 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cc9a1b2c4348ada0d8dab958aded09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.825042 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 97bb29eb3de04d65aa91e7ae8c652170 (DEFAULT_TABLE table=default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.825109 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bb29eb3de04d65aa91e7ae8c652170. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.825119 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 367694b5edf143ef81e99e348543659a (DEFAULT_TABLE table=default.Table_058d5ec95f2a468ab9d1edf25995bdd8 [id=a4e90033d1204cb8b8fbcf057528391c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.825212 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367694b5edf143ef81e99e348543659a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.825510 3519 tablet_service.cc:1467] Processing CreateTablet for tablet fd76846bc164480d9b77aa3d096260cb (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.825593 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd76846bc164480d9b77aa3d096260cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.825899 3526 tablet_service.cc:1467] Processing CreateTablet for tablet b114b291fd734797bd6622d89e309925 (DEFAULT_TABLE table=default.Table_f98e93dc1edf457d8b10bd2882677285 [id=a49d7416b0c84365bc92418b8d448a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.825959 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114b291fd734797bd6622d89e309925. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.826205 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 0c6a04e982ee493d815322ec6b2f267e (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.826284 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6a04e982ee493d815322ec6b2f267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.826630 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a (DEFAULT_TABLE table=default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.826644 3519 tablet_service.cc:1467] Processing CreateTablet for tablet 2d30f49da63241a2a794a7a18e026473 (DEFAULT_TABLE table=default.Table_3aae7f2489e6423f8c2da3c5ae753cdf [id=a5da5f258250489a9d39ce2b87fc1a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.826683 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab498e7789d4ae18a9f62be2fa2514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.826719 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d30f49da63241a2a794a7a18e026473. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.827245 3249 tablet_service.cc:1467] Processing CreateTablet for tablet f0d6e064ac3645a0a855d97262f6e9ed (DEFAULT_TABLE table=default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 [id=5f8793d7d917468b822398f75b3c7b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.827289 3515 tablet_service.cc:1467] Processing CreateTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.827312 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d6e064ac3645a0a855d97262f6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.827345 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc395ae76a494a8eb682b7ef34dcb169. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.827584 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d63cc502f418b91aec39245c707b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.827807 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424956b90563455d8140a49fcaa05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804136 3250 tablet_service.cc:1467] Processing CreateTablet for tablet f9256780f6e94b7ebd1276df07baf19d (DEFAULT_TABLE table=default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.828833 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 0a612decf0634bd588f45c8953c6b201 (DEFAULT_TABLE table=default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.828907 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 8a357badf1cd43e384d2de92e3413898 (DEFAULT_TABLE table=default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.829015 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a357badf1cd43e384d2de92e3413898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.829941 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9 (DEFAULT_TABLE table=default.Table_2c791d1c1e86451a8080674fe68d383a [id=abfc4758ddad43c7aef0fd67d1ff5bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.830017 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.830029 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 98993cb75de34c0babb894a5d17d6d12 (DEFAULT_TABLE table=default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.830121 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98993cb75de34c0babb894a5d17d6d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.830724 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 4d31f180a3fc499fbd505c986593a7f5 (DEFAULT_TABLE table=default.Table_eb4ead8621074161aaa1f06e5ed31482 [id=270edc3310cd4a09aaa6f46e4f889188]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.830812 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d31f180a3fc499fbd505c986593a7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.831076 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.831121 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.831146 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.831183 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet c64affc7645145069d6197ede241585e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.831207 3527 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.831249 3527 tablet_service.cc:1467] Processing CreateTablet for tablet ba609491f7ed4686b374fd7c0a5e39f8 (DEFAULT_TABLE table=default.Table_81cbb970502040e38384e43cc9935f43 [id=0097f32bdaf5478bbdd7cb6e58c2e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.831313 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba609491f7ed4686b374fd7c0a5e39f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.831910 3518 tablet_service.cc:1467] Processing CreateTablet for tablet f3cba581c6884fd98503d4883b09d4a6 (DEFAULT_TABLE table=default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.831986 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cba581c6884fd98503d4883b09d4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.832121 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a612decf0634bd588f45c8953c6b201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.832942 3518 tablet_service.cc:1467] Processing CreateTablet for tablet dc2b34be581f44028fed1514c78d1874 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.833041 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2b34be581f44028fed1514c78d1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.833084 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 47205800bd074a9585c4af0f50055a13 (DEFAULT_TABLE table=default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.833565 3256 tablet_service.cc:1467] Processing CreateTablet for tablet def9cfbc6f764499b1c6ac9b6845f5ed (DEFAULT_TABLE table=default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.833992 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47205800bd074a9585c4af0f50055a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.834079 3258 tablet_service.cc:1467] Processing CreateTablet for tablet fb04f46a17134bc28719be34085f714f (DEFAULT_TABLE table=default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f [id=ebcd9bd681dc4a5298c3599542ce206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.834137 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6597804e5c41618870133c9d4ad1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.834255 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9256780f6e94b7ebd1276df07baf19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.834378 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:02.834451 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:02.834471 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:02.834493 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
I20250115 10:12:02.834522 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:02.834559 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
W20250115 10:12:02.834736 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d42535a811dc420b94527f7d81efdd13 consensus state has no leader
W20250115 10:12:02.834789 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 28861e966ce645878983bec6476255bb consensus state has no leader
W20250115 10:12:02.834810 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 1b251ef905b74375bd9b387cc8b057c0 consensus state has no leader
W20250115 10:12:02.834828 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a4af01517cb04be983456a98153f6146 consensus state has no leader
W20250115 10:12:02.834857 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ff89486cde3f49528e4007189911ce4e consensus state has no leader
I20250115 10:12:02.834867 3249 tablet_service.cc:1467] Processing CreateTablet for tablet bcd888d924fd43b590710613560f16d5 (DEFAULT_TABLE table=default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.834887 4468 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet cd8b9bf010d245be919f1e912b103770 consensus state has no leader
I20250115 10:12:02.834961 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9cfbc6f764499b1c6ac9b6845f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.835100 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 06c5994686054f51802fb9125beb85c4 (DEFAULT_TABLE table=default.Table_1c5f565cf47e469aa8fda3d4022e032f [id=cca7bb92e53a40b793e4e8f5033401fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.835178 3528 tablet_service.cc:1467] Processing CreateTablet for tablet aef601e6f3ef4ba387164c239c1139b0 (DEFAULT_TABLE table=default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.835680 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:12:02.835683 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04f46a17134bc28719be34085f714f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.835831 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd888d924fd43b590710613560f16d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.835867 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 368df29ba175447ba4c009c7eb15a49d (DEFAULT_TABLE table=default.Table_746d39dd624c4988b0521a7a6af0e896 [id=5e846a21e7a54dcda298097ce402c196]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.836544 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 347621ded3fd4380b1502d1a8c5b0c4a (DEFAULT_TABLE table=default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.837002 3512 tablet_service.cc:1467] Processing CreateTablet for tablet e178610c1a394217b152082dfd6bb8d0 (DEFAULT_TABLE table=default.Table_d526916fb923487d905f4408bfac2c6c [id=b4307531291f4c738bd60ef5de92874a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.837168 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.837280 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09db89ab7dd543559ae8a11e60c8a873. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.837865 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe929017262442094800c874183f5de (DEFAULT_TABLE table=default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.815706 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 5403eb7ca3b74d6e8110f97c17e1aa67 (DEFAULT_TABLE table=default.Table_fa2f46d367594fc2b0076ad6db01dee7 [id=af57231131444910ada6130cbbfdada5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.835197 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c5994686054f51802fb9125beb85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.838667 3249 tablet_service.cc:1467] Processing CreateTablet for tablet d5419822600e463a9efb81ad86a10292 (DEFAULT_TABLE table=default.Table_452d4e866cf043a290b01f92fea60597 [id=56ba6004943340809edbf23f7af8bf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.838791 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5419822600e463a9efb81ad86a10292. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.839010 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.839105 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff85958d3c46069b1dd9bf5cb75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.839453 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e178610c1a394217b152082dfd6bb8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.839691 3250 tablet_service.cc:1467] Processing CreateTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (DEFAULT_TABLE table=default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.839797 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fe9bedd4b74166a4f4c34ec0b87f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.840370 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 3067eaaa090b4ffb95b2e741453113ed (DEFAULT_TABLE table=default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.840451 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3067eaaa090b4ffb95b2e741453113ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.840488 3512 tablet_service.cc:1467] Processing CreateTablet for tablet c64affc7645145069d6197ede241585e (DEFAULT_TABLE table=default.Table_9557727fc0e5449ba95961d750b88bc4 [id=2b92b0f8a8574e8c810ce7062c65acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.840561 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64affc7645145069d6197ede241585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.840782 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6621592191408cb1eeaf69869258a5 (DEFAULT_TABLE table=default.Table_c73488a369ec4bc196196444fa9c3632 [id=4fdef59a83b241a785c3ed32b8eeb977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.840850 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6621592191408cb1eeaf69869258a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.841384 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 817a8a975fea4da9a994e78f86da961f (DEFAULT_TABLE table=default.Table_a3b73807076c4f0aabf9e6f82eca2bef [id=791960255cad40b1814de43ae15c9ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.841455 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a8a975fea4da9a994e78f86da961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.841526 3512 tablet_service.cc:1467] Processing CreateTablet for tablet cf859ca6a22947ba80f99872d6dc6600 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.841593 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf859ca6a22947ba80f99872d6dc6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.841792 3250 tablet_service.cc:1467] Processing CreateTablet for tablet f560f9e7e84d47faa147b33495e85055 (DEFAULT_TABLE table=default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.841861 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560f9e7e84d47faa147b33495e85055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.842291 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 8decec5964f14766b997192fbf4f7051 (DEFAULT_TABLE table=default.Table_7f11f45ebda04d1d934c330ec17ceccf [id=05d6c7181b804de9ac10c342612b7e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.842361 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decec5964f14766b997192fbf4f7051. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.842502 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (DEFAULT_TABLE table=default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.842569 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1465bcc80e40cdad4e0722eb0d74c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.842829 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (DEFAULT_TABLE table=default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.842903 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbd61aec79d479d9eea8d807cd5fb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.843273 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.844197 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 709a9b0953dd4b108825b663d703e609 (DEFAULT_TABLE table=default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.844281 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709a9b0953dd4b108825b663d703e609. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.844391 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 0e033d609eef46a792b1a568ec2936de (DEFAULT_TABLE table=default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.844460 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e033d609eef46a792b1a568ec2936de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.844817 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 8191b81bdad74a9b8aa049473325720b (DEFAULT_TABLE table=default.Table_f6a790f7709f440d98f1567067ed68a2 [id=47674ee5aac44634ba202fe90d14d49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.844885 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8191b81bdad74a9b8aa049473325720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.845865 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 (DEFAULT_TABLE table=default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.846068 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbb9cfc01df408eaae41b38e8c62c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.846426 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5403eb7ca3b74d6e8110f97c17e1aa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.847056 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6244234f7447debe9cdce30e4919b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.848855 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fac40fff8de4004858af6e2ae986d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.849915 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368df29ba175447ba4c009c7eb15a49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.850697 3511 tablet_service.cc:1467] Processing CreateTablet for tablet fcf567628009460dbb7bfa582f69b4f1 (DEFAULT_TABLE table=default.Table_1b401a0e880a4244a7a60cde99fe7a62 [id=b657ebccf5124395b20e91032a0f1cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.850801 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf567628009460dbb7bfa582f69b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.851112 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.851188 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d3800d79794d3bad6c50d2dc8e9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.851722 3258 tablet_service.cc:1467] Processing CreateTablet for tablet ad975dacafc94bc89c3996aa58a9b5a1 (DEFAULT_TABLE table=default.Table_7ed5666a03e441d8bd5b20eb88d5910a [id=81d22d650beb49f5827086b74342581e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.851722 3511 tablet_service.cc:1467] Processing CreateTablet for tablet d73af05d7fd349b083eb74352a62a1fe (DEFAULT_TABLE table=default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.851820 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad975dacafc94bc89c3996aa58a9b5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.851820 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73af05d7fd349b083eb74352a62a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.852157 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 26351bbe70044075a99982bb380d86a0 (DEFAULT_TABLE table=default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.852233 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26351bbe70044075a99982bb380d86a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.852715 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.852715 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 140bf4fc35274f2284c24534d3644695 (DEFAULT_TABLE table=default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.852795 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140bf4fc35274f2284c24534d3644695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.852795 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a83c4de3849498be5c6e4f9c8b00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.853183 3527 tablet_service.cc:1467] Processing CreateTablet for tablet e3dd43785e2541d8be54b6ca339a754d (DEFAULT_TABLE table=default.Table_ee808cbef43c429ba5a671726e74c5ac [id=2e12df36e70c48bdb039351c533e802a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.853272 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd43785e2541d8be54b6ca339a754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.853729 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 74a62d026bb94c0fb908b36b38aa0f7f (DEFAULT_TABLE table=default.Table_080e6f46b4a4430fbbe8ae52c0055a43 [id=1faa87a45ad24ea7a41e678ed5b4c8d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.853739 3511 tablet_service.cc:1467] Processing CreateTablet for tablet bb4d112daca24c82931daf050edbd846 (DEFAULT_TABLE table=default.Table_2deceee1167f46b8aea6e6f3fa075cf7 [id=093d224f08744cf38ab4f22d0c0b6e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.853811 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a62d026bb94c0fb908b36b38aa0f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.853824 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d112daca24c82931daf050edbd846. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.854053 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 8600883e5a5449c59a747a6ef2121c61 (DEFAULT_TABLE table=default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854108 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8600883e5a5449c59a747a6ef2121c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.854692 3527 tablet_service.cc:1467] Processing CreateTablet for tablet bfe0522e3e664012a00ec78a09c2816c (DEFAULT_TABLE table=default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854738 3258 tablet_service.cc:1467] Processing CreateTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 (DEFAULT_TABLE table=default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854738 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 3fecca0f91e04702b438c9639303fac2 (DEFAULT_TABLE table=default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854813 3514 tablet_service.cc:1467] Processing CreateTablet for tablet b1b423922cbb4a42bbdb4de025227118 (DEFAULT_TABLE table=default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854818 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae1ff74cce48ada0a373f9e65508a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.854988 3519 tablet_service.cc:1514] Processing DeleteTablet for tablet 5779ec7816cd499ebe46962e29092a70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.855059 3519 tablet_service.cc:1467] Processing CreateTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.855170 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e56c83017b54e65a066e8e377293b13 with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa81e05a22e46bf94b378605a889eee) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.855263 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 766ddeab54194401aeb942516e42dc84 (DEFAULT_TABLE table=default.Table_e762e9011d9f4fe1856dc4923700d779 [id=0ed50e4d34254318a993c3268808ce39]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.855432 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet d92890d082e242ccae8ad4e40d056c74 with delete_type TABLET_DATA_DELETED (replaced by tablet f0ae1ff74cce48ada0a373f9e65508a2) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.855490 3516 tablet_service.cc:1467] Processing CreateTablet for tablet d200e7e299214ab8aad3a42a4d513da5 (DEFAULT_TABLE table=default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.855607 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb (DEFAULT_TABLE table=default.Table_36a2b6b01e684edb9cd4c0f11317ea56 [id=7e11745e5dd243d69cb4463cc11edf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.855623 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet f889cc1201404c8691bf01256750e244 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.855914 3526 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db40559d7894bb8b80cf27b546c8f56 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fa5b108bd214a56840cea7583755db2) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.855942 3530 tablet_service.cc:1467] Processing CreateTablet for tablet cb8ecc0818304f5e9522bba63a4aca4d (DEFAULT_TABLE table=default.Table_dbaca6558a074caa8671547657908e94 [id=4c4374e6c65149d087e5507ced04d9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.856015 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 76499a085d9d4f74818684d3148a4866 (DEFAULT_TABLE table=default.Table_c1c600c53e0b472ea680a14709e39431 [id=a5a191eb03004d86863bb4390fad5543]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.854765 3524 tablet_service.cc:1467] Processing CreateTablet for tablet ded005e366d4460f9acbcbb7b75397ef (DEFAULT_TABLE table=default.Table_a883df24d37b447baa84acc5f6c62d45 [id=721c4375c79a45feb26f677535de05c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.856139 3525 tablet_service.cc:1514] Processing DeleteTablet for tablet e3a4b1b801c84cbcae634a965be09734 with delete_type TABLET_DATA_DELETED (replaced by tablet 85c5bcb8f4cf44fcb160e2200b1abb7d) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.856211 3525 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a (DEFAULT_TABLE table=default.Table_d59e20c98bd84db48c45d49171eff4fd [id=10b43b32ad174b12b4a2da8cceaaeac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.856242 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 509f854a424e497f8fa72b70d5f0f651 (DEFAULT_TABLE table=default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.856274 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9295765384410d9ee9380b4db88ed0 (DEFAULT_TABLE table=default.Table_ded364210b934ba3a4824b517b6db826 [id=268b8b77011f466abc17b7600aceadd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.856333 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f854a424e497f8fa72b70d5f0f651. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.856993 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.857213 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 6034c750d47744ff8eb4d62c7c135ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet 3552b8e936ad4aeba0eadc95577f5414) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.857316 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 9077d0eed1974bc898370b5d5554be71 (DEFAULT_TABLE table=default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.857417 3512 tablet_service.cc:1467] Processing CreateTablet for tablet b110fe6c13204cf295abb29839f3380b (DEFAULT_TABLE table=default.Table_7cc7f5b2700343b7b48aae25a2f75b37 [id=2d9f80bd6fda4b22af4bb90503c90a4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.857455 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 71c23863beb24d27b337fa039d7f04cd (DEFAULT_TABLE table=default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.857525 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c23863beb24d27b337fa039d7f04cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.858819 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 1e9c62a11d4744e199765f855fd0840b (DEFAULT_TABLE table=default.Table_1eacbd293bea443fa0780ba898123200 [id=3d13f917c9a04d4cb429be32533ec2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.858922 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c62a11d4744e199765f855fd0840b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.859946 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:02.860384 3254 tablet_service.cc:1467] Processing CreateTablet for tablet d0e3265da9be49518705bedf6daa27a1 (DEFAULT_TABLE table=default.Table_d63e50fd58fd4335ba0165af0f856032 [id=3bedd46181134cf7bdc3b443a5aff915]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.860502 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3265da9be49518705bedf6daa27a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.860890 3529 tablet_service.cc:1467] Processing CreateTablet for tablet f4cee0b04c6e4eb39dd22668aacb2801 (DEFAULT_TABLE table=default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.804215 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (DEFAULT_TABLE table=default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.861218 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.854743 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe0522e3e664012a00ec78a09c2816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.861454 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded005e366d4460f9acbcbb7b75397ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.861555 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76499a085d9d4f74818684d3148a4866. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.861661 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fecca0f91e04702b438c9639303fac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.862421 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 21d5a121a87648ecbb842f52bc361602 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.862514 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d5a121a87648ecbb842f52bc361602. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.862536 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077d0eed1974bc898370b5d5554be71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.862707 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c99788dae6421b8b2dd4f40e2b63b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.863021 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.863127 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7c1c0ac4d3487187907a49343381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.863226 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 6de4d57d53c648b491f66f257414394d (DEFAULT_TABLE table=default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.863306 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de4d57d53c648b491f66f257414394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.863619 3252 tablet_service.cc:1467] Processing CreateTablet for tablet bc3658cad19e46969abecacf490f43f1 (DEFAULT_TABLE table=default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.863714 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc3658cad19e46969abecacf490f43f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.864181 3525 tablet_service.cc:1467] Processing CreateTablet for tablet c68f61c8b72b4628bba5c52f8025a240 (DEFAULT_TABLE table=default.Table_5c52b5a64d154706af4220cc2f273a98 [id=75a3cabc6ab0415992e902b02ea54d47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.864261 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe929017262442094800c874183f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.864346 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68f61c8b72b4628bba5c52f8025a240. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.864374 3511 tablet_service.cc:1467] Processing CreateTablet for tablet ac8b3c397070467196b73dedcacf22de (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.864465 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8b3c397070467196b73dedcacf22de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.864796 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 62aee0b0490e44a3aa820781bc9e4072 (DEFAULT_TABLE table=default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 [id=86e6124c18724ba1bc7fc8c8772d1fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.864874 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aee0b0490e44a3aa820781bc9e4072. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.865309 3525 tablet_service.cc:1467] Processing CreateTablet for tablet cb9629071de44cf69621ae3b2fd4e762 (DEFAULT_TABLE table=default.Table_af49e808ad814664b3703d748315b8a4 [id=89304ed813b04d0682ad058ee2168202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.865406 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9629071de44cf69621ae3b2fd4e762. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.865469 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 14cea13b41bd47faafe774471c4163dc (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.804415 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0541097b0b4916b559c14e48e08540 (DEFAULT_TABLE table=default.Table_bc518eaf2d604c7e9ce859e76a6d72ac [id=ec98d4501a674ea1888c0b341153947c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.866034 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0541097b0b4916b559c14e48e08540. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.864181 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 (DEFAULT_TABLE table=default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.866734 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.865872 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b423922cbb4a42bbdb4de025227118. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.867224 3260 tablet_service.cc:1467] Processing CreateTablet for tablet e91450b4369844ea9ab09383b3dbc8ee (DEFAULT_TABLE table=default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.862560 3524 tablet_service.cc:1467] Processing CreateTablet for tablet ca2e043501b04096b648d179a13e8653 (DEFAULT_TABLE table=default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.866931 4557 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.867308 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91450b4369844ea9ab09383b3dbc8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.867542 4551 tablet_replica.cc:331] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:02.862557 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 2e55b7e2b95b4eb895da942829c4556f (DEFAULT_TABLE table=default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.865309 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 54d9aaaa37d540cab41de4a083b36917 (DEFAULT_TABLE table=default.Table_d0fcc51d02e64d42831f872a5b3b02ee [id=965a2b7a6e3241afac6499010b596aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.867615 4551 raft_consensus.cc:2238] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 3 LEADER]: Raft consensus shutting down.
I20250115 10:12:02.867749 4551 raft_consensus.cc:2267] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:02.867187 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9295765384410d9ee9380b4db88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.867894 4551 ts_tablet_manager.cc:1905] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:02.868642 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 77cd70765e54417fbf6234fe59480518 (DEFAULT_TABLE table=default.Table_d2c4a3b2009e4f548be4457d598fff95 [id=386128b91ada4ecca121f2d2053390a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.868731 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd70765e54417fbf6234fe59480518. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.869194 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbcd4787a734c5bba29f8a600abf874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.869849 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 8441d13c5b0c47bb9e16655c964ab58f (DEFAULT_TABLE table=default.Table_c0ff9042b1554e91a840ad8adde05cc9 [id=a02b68d5690c4d22bd6228e2cda045c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.869931 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8441d13c5b0c47bb9e16655c964ab58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.870574 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9aaaa37d540cab41de4a083b36917. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.871014 3260 tablet_service.cc:1467] Processing CreateTablet for tablet d368093a74ba4918b0efcc3a909c3a07 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.871094 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368093a74ba4918b0efcc3a909c3a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804488 3251 tablet_service.cc:1467] Processing CreateTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.872247 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b580a5dc6a9c4a0f8b65ad9a92804e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.873498 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 74ab86571c3a469da7a51cf6033c5b10 (DEFAULT_TABLE table=default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.873598 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab86571c3a469da7a51cf6033c5b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.873804 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766ddeab54194401aeb942516e42dc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.874704 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 6be683cdd24844eebaad0ed6a36be25f (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.874807 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be683cdd24844eebaad0ed6a36be25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804553 3257 tablet_service.cc:1467] Processing CreateTablet for tablet b573af4521064addb5bf2da9c70a79f0 (DEFAULT_TABLE table=default.Table_4f01791bcbd34a10bc736ecbd706f53d [id=eb7190820bc3484982ba925dfd67b9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.875802 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d200e7e299214ab8aad3a42a4d513da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.875902 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b573af4521064addb5bf2da9c70a79f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.877213 3257 tablet_service.cc:1467] Processing CreateTablet for tablet af48bf64e2ca4a3197805c75fb0a12a6 (DEFAULT_TABLE table=default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.877214 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e043501b04096b648d179a13e8653. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.877298 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af48bf64e2ca4a3197805c75fb0a12a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.877378 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b110fe6c13204cf295abb29839f3380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.877642 3327 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
I20250115 10:12:02.878343 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 29ed70f5db0e492eaf0c42e005736ad1 (DEFAULT_TABLE table=default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.878430 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ed70f5db0e492eaf0c42e005736ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.878685 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347621ded3fd4380b1502d1a8c5b0c4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.879076 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
W20250115 10:12:02.879134 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
W20250115 10:12:02.879155 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
W20250115 10:12:02.879194 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
W20250115 10:12:02.879217 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
W20250115 10:12:02.879237 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet d667834206fe4410a22b4944b3494462
W20250115 10:12:02.879256 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
W20250115 10:12:02.879279 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
W20250115 10:12:02.879303 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:02.879323 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
W20250115 10:12:02.879343 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
W20250115 10:12:02.879361 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:02.879356 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 8093f8487b9844718707e2fcdd3ae833 (DEFAULT_TABLE table=default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.879382 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
W20250115 10:12:02.879401 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 5779ec7816cd499ebe46962e29092a70
I20250115 10:12:02.879428 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8093f8487b9844718707e2fcdd3ae833. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.879436 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:12:02.879482 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4db40559d7894bb8b80cf27b546c8f56
W20250115 10:12:02.879506 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
W20250115 10:12:02.879525 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f889cc1201404c8691bf01256750e244
W20250115 10:12:02.879544 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:02.879563 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
W20250115 10:12:02.879590 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 6034c750d47744ff8eb4d62c7c135ed7
W20250115 10:12:02.879607 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
W20250115 10:12:02.879626 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
W20250115 10:12:02.879649 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
W20250115 10:12:02.879698 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:02.879828 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:02.879876 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:02.804657 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 75ab349b64b745ed97c3dae843b059aa (DEFAULT_TABLE table=default.Table_b854510e625043a7b89fa31b5d30acfb [id=eb27a3b7ec52442a882104e9ffaf008b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.879909 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:02.879937 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:02.879957 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ab349b64b745ed97c3dae843b059aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.879976 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]). Expected version 1 got 0
I20250115 10:12:02.880015 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:02.880050 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:02.880093 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:02.880120 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:02.880146 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:02.880175 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:02.880208 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
I20250115 10:12:02.880234 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cee0b04c6e4eb39dd22668aacb2801. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.880244 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]). Expected version 1 got 0
W20250115 10:12:02.880420 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet def9cfbc6f764499b1c6ac9b6845f5ed consensus state has no leader
W20250115 10:12:02.880472 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 509f854a424e497f8fa72b70d5f0f651 consensus state has no leader
W20250115 10:12:02.880513 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d], current schema version=5): Not found: failed to reset TS proxy: No leader found: Tablet 4cbd61aec79d479d9eea8d807cd5fb0e consensus state has no leader
W20250115 10:12:02.880551 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 21d5a121a87648ecbb842f52bc361602 consensus state has no leader
W20250115 10:12:02.880594 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 74ab86571c3a469da7a51cf6033c5b10 consensus state has no leader
W20250115 10:12:02.880642 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 71c23863beb24d27b337fa039d7f04cd consensus state has no leader
W20250115 10:12:02.880682 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e91450b4369844ea9ab09383b3dbc8ee consensus state has no leader
W20250115 10:12:02.880722 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f], current schema version=5): Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 consensus state has no leader
W20250115 10:12:02.880762 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 09db89ab7dd543559ae8a11e60c8a873 consensus state has no leader
W20250115 10:12:02.880805 4473 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 08b7630b6c8b40d89b9829ffc8fc4b2b consensus state has no leader
I20250115 10:12:02.881162 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 8a485231d2de4fab8b86b4900976c76c (DEFAULT_TABLE table=default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.881239 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a485231d2de4fab8b86b4900976c76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.882290 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0b60522b15489d9726af73a7bd1ee5 (DEFAULT_TABLE table=default.Table_d90a16759f704e54a0e7cdef7960d41a [id=33c05baa94c64e3d8139905db7e98f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.882362 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0b60522b15489d9726af73a7bd1ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.882654 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cea13b41bd47faafe774471c4163dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.883368 3247 tablet_service.cc:1467] Processing CreateTablet for tablet d21906d23acc4ab8b81eceb87ead049f (DEFAULT_TABLE table=default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.883453 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21906d23acc4ab8b81eceb87ead049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.883774 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e78a8b61e142199ba7bf73e3879b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804744 3246 tablet_service.cc:1467] Processing CreateTablet for tablet cfe7181347114ccfbf62109147d182b3 (DEFAULT_TABLE table=default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.883872 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7181347114ccfbf62109147d182b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.884253 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8ecc0818304f5e9522bba63a4aca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.884953 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 576e273ac51f4eb498faccab336c479d (DEFAULT_TABLE table=default.Table_c85f35b680824b1e82b624028c053124 [id=6d6c1ae6d0114e97bc24eaedecf1c904]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.885035 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576e273ac51f4eb498faccab336c479d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.885375 4557 tablet_bootstrap.cc:654] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.885728 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef601e6f3ef4ba387164c239c1139b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.886270 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.886351 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3ebf56500b4c97b7553644d62fe83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.887459 3246 tablet_service.cc:1467] Processing CreateTablet for tablet a7e2086241df4b4fac5e481c5e8295a9 (DEFAULT_TABLE table=default.Table_7b236b5787d24e138bfad3c30003b316 [id=0b1b8cdb67244dc19aed82671327d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.887537 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e2086241df4b4fac5e481c5e8295a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804824 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 6f33cd582313436ba2a8a71cb708384c (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.887876 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f33cd582313436ba2a8a71cb708384c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.888617 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e55b7e2b95b4eb895da942829c4556f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.889020 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616166bc9d5d4651999b1d2e0a1851bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.889163 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (DEFAULT_TABLE table=default.Table_2648dfb12d924eda9b18368da8df24a5 [id=0298d09bab6149af8c9c418b3d064b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.889250 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f81769b500149f7b2bf7cdf76f7ee27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.890383 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 497adb74fac84c1cb438ea6ba4adf211 (DEFAULT_TABLE table=default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.890465 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497adb74fac84c1cb438ea6ba4adf211. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.891600 3245 tablet_service.cc:1467] Processing CreateTablet for tablet aef601e6f3ef4ba387164c239c1139b0 (DEFAULT_TABLE table=default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.891682 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef601e6f3ef4ba387164c239c1139b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804879 3244 tablet_service.cc:1467] Processing CreateTablet for tablet b2462c50d3684176aa5ff5caf79f9644 (DEFAULT_TABLE table=default.Table_25066f18e8044d3a88bc2548ecabd41a [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.891819 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2462c50d3684176aa5ff5caf79f9644. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.891986 4557 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.892042 4557 ts_tablet_manager.cc:1397] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20250115 10:12:02.892203 4557 raft_consensus.cc:357] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.892264 4557 raft_consensus.cc:383] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.892284 4557 raft_consensus.cc:738] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.892338 4557 consensus_queue.cc:260] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.892454 4557 ts_tablet_manager.cc:1428] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:02.892519 4557 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.892927 4557 tablet_bootstrap.cc:654] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.892997 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 347621ded3fd4380b1502d1a8c5b0c4a (DEFAULT_TABLE table=default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.893071 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347621ded3fd4380b1502d1a8c5b0c4a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.893211 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4db40559d7894bb8b80cf27b546c8f56
I20250115 10:12:02.893270 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:02.893801 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:02.894264 3244 tablet_service.cc:1467] Processing CreateTablet for tablet ded005e366d4460f9acbcbb7b75397ef (DEFAULT_TABLE table=default.Table_a883df24d37b447baa84acc5f6c62d45 [id=721c4375c79a45feb26f677535de05c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.894346 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded005e366d4460f9acbcbb7b75397ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.895473 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 8c045349a48644eda41ea8965b16174d (DEFAULT_TABLE table=default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.895555 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c045349a48644eda41ea8965b16174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804948 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 28861e966ce645878983bec6476255bb (DEFAULT_TABLE table=default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.895855 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28861e966ce645878983bec6476255bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.896291 4551 ts_tablet_manager.cc:1918] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.4
I20250115 10:12:02.896369 4551 log.cc:1198] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d667834206fe4410a22b4944b3494462
I20250115 10:12:02.896744 4551 ts_tablet_manager.cc:1939] T d667834206fe4410a22b4944b3494462 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:02.897321 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6baabd5aba4363ae13e5da601a9de8 (DEFAULT_TABLE table=default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.897405 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6baabd5aba4363ae13e5da601a9de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.898551 3243 tablet_service.cc:1467] Processing CreateTablet for tablet c68f61c8b72b4628bba5c52f8025a240 (DEFAULT_TABLE table=default.Table_5c52b5a64d154706af4220cc2f273a98 [id=75a3cabc6ab0415992e902b02ea54d47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.898641 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68f61c8b72b4628bba5c52f8025a240. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.899242 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 9647ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:02.805259 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 3c66c13648b6478b8420778f48ba208a (DEFAULT_TABLE table=default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.899693 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66c13648b6478b8420778f48ba208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.900034 4557 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.900077 4557 ts_tablet_manager.cc:1397] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:02.900238 4557 raft_consensus.cc:357] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.900295 4557 raft_consensus.cc:383] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.900313 4557 raft_consensus.cc:738] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.900363 4557 consensus_queue.cc:260] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.900480 4557 ts_tablet_manager.cc:1428] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:02.900552 4557 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.900995 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 4c49b39058164387990c4f6dc170785e (DEFAULT_TABLE table=default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 [id=8d38c2511ddc4940b470805a54f8b1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.901079 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49b39058164387990c4f6dc170785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.901242 4557 tablet_bootstrap.cc:654] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.902024 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:02.902163 4557 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.902168 3242 tablet_service.cc:1467] Processing CreateTablet for tablet ac8b3c397070467196b73dedcacf22de (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.902204 4557 ts_tablet_manager.cc:1397] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:02.902240 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8b3c397070467196b73dedcacf22de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.902336 4557 raft_consensus.cc:357] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.902390 4557 raft_consensus.cc:383] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.902408 4557 raft_consensus.cc:738] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.902456 4557 consensus_queue.cc:260] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.902539 4557 ts_tablet_manager.cc:1428] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:02.902603 4557 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.903000 4557 tablet_bootstrap.cc:654] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.903298 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 98e5519e80144b7582d76b7f9d8d6ffa (DEFAULT_TABLE table=default.Table_b5612228d70d4480ad349647f31a97fc [id=7c32f09490d24567885955928d4e3d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.903370 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e5519e80144b7582d76b7f9d8d6ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.805359 3241 tablet_service.cc:1467] Processing CreateTablet for tablet cd8b9bf010d245be919f1e912b103770 (DEFAULT_TABLE table=default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.904186 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8b9bf010d245be919f1e912b103770. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.905591 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 (DEFAULT_TABLE table=default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.905691 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbcd4787a734c5bba29f8a600abf874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.906970 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 0e033d609eef46a792b1a568ec2936de (DEFAULT_TABLE table=default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.907052 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e033d609eef46a792b1a568ec2936de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.805568 3248 tablet_service.cc:1467] Processing CreateTablet for tablet ff89486cde3f49528e4007189911ce4e (DEFAULT_TABLE table=default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.907845 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff89486cde3f49528e4007189911ce4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.808023 3253 tablet_service.cc:1467] Processing CreateTablet for tablet d42535a811dc420b94527f7d81efdd13 (DEFAULT_TABLE table=default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.910493 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42535a811dc420b94527f7d81efdd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.804152 4569 tablet_bootstrap.cc:654] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.804279 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd6b39cd88247bfa120903465b676b2 (DEFAULT_TABLE table=default.Table_32ae9c8978b2495c93454b757401f5ff [id=eff900c27c8440e9a460c50fb125893f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.911645 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd6b39cd88247bfa120903465b676b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.911932 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 5461620a4b644906ad7d9694dfc80177 (DEFAULT_TABLE table=default.Table_3f969226dcf64b9e8d5d6e561088c83d [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.911983 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 1b251ef905b74375bd9b387cc8b057c0 (DEFAULT_TABLE table=default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.912043 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5461620a4b644906ad7d9694dfc80177. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.912093 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b251ef905b74375bd9b387cc8b057c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.912127 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 9bc7d63d8661445cb804762413eac194 (DEFAULT_TABLE table=default.Table_056453db36d0482f9828ea16ed3767c4 [id=f7cac8ff4a2f4f47961cfa687ac95f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.912209 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bc7d63d8661445cb804762413eac194. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.912389 3389 tablet_service.cc:1467] Processing CreateTablet for tablet ff89486cde3f49528e4007189911ce4e (DEFAULT_TABLE table=default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.912456 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff89486cde3f49528e4007189911ce4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.912714 3349 service_pool.cc:137] CreateTablet request on kudu.tserver.TabletServerAdminService from 127.0.0.1:46330 dropped due to backpressure: service queue is full with 50 items
I20250115 10:12:02.913478 3384 tablet_service.cc:1467] Processing CreateTablet for tablet d190044d103e441193e224c667108543 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913506 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 2836a492586e489daafc2da719455f39 (DEFAULT_TABLE table=default.Table_39ee61035d3b403086a48a76cb6370e4 [id=dfff9fb7e37e4beb8e5ed6c321814a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913547 3385 tablet_service.cc:1467] Processing CreateTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.804349 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 3b89df9f987e46ae98fe21df847cb311 (DEFAULT_TABLE table=default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913676 3382 tablet_service.cc:1467] Processing CreateTablet for tablet 75ab349b64b745ed97c3dae843b059aa (DEFAULT_TABLE table=default.Table_b854510e625043a7b89fa31b5d30acfb [id=eb27a3b7ec52442a882104e9ffaf008b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913736 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b89df9f987e46ae98fe21df847cb311. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.913820 3381 tablet_service.cc:1467] Processing CreateTablet for tablet cfe7181347114ccfbf62109147d182b3 (DEFAULT_TABLE table=default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913926 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 6f33cd582313436ba2a8a71cb708384c (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.914068 3379 tablet_service.cc:1467] Processing CreateTablet for tablet b2462c50d3684176aa5ff5caf79f9644 (DEFAULT_TABLE table=default.Table_25066f18e8044d3a88bc2548ecabd41a [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.914199 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 3c66c13648b6478b8420778f48ba208a (DEFAULT_TABLE table=default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.913554 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d190044d103e441193e224c667108543. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.914705 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2462c50d3684176aa5ff5caf79f9644. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.915522 3383 tablet_service.cc:1467] Processing CreateTablet for tablet cb9629071de44cf69621ae3b2fd4e762 (DEFAULT_TABLE table=default.Table_af49e808ad814664b3703d748315b8a4 [id=89304ed813b04d0682ad058ee2168202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.915522 3384 tablet_service.cc:1467] Processing CreateTablet for tablet a4af01517cb04be983456a98153f6146 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.915804 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 (DEFAULT_TABLE table=default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.915915 3391 tablet_service.cc:1467] Processing CreateTablet for tablet f9256780f6e94b7ebd1276df07baf19d (DEFAULT_TABLE table=default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916023 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (DEFAULT_TABLE table=default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916152 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 7cd6b39cd88247bfa120903465b676b2 (DEFAULT_TABLE table=default.Table_32ae9c8978b2495c93454b757401f5ff [id=eff900c27c8440e9a460c50fb125893f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916252 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 3b89df9f987e46ae98fe21df847cb311 (DEFAULT_TABLE table=default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916363 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 8c0541097b0b4916b559c14e48e08540 (DEFAULT_TABLE table=default.Table_bc518eaf2d604c7e9ce859e76a6d72ac [id=ec98d4501a674ea1888c0b341153947c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916440 3390 tablet_service.cc:1467] Processing CreateTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.915550 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff61c5261f44b12b0da4cd3b6e58ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.916522 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b580a5dc6a9c4a0f8b65ad9a92804e09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.916574 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4af01517cb04be983456a98153f6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.916612 3395 tablet_service.cc:1467] Processing CreateTablet for tablet b573af4521064addb5bf2da9c70a79f0 (DEFAULT_TABLE table=default.Table_4f01791bcbd34a10bc736ecbd706f53d [id=eb7190820bc3484982ba925dfd67b9f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916702 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b573af4521064addb5bf2da9c70a79f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.917157 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:02.917593 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f33cd582313436ba2a8a71cb708384c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.917696 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9629071de44cf69621ae3b2fd4e762. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.917797 3395 tablet_service.cc:1467] Processing CreateTablet for tablet c35ca809b19541479146f385e1d3cebe (DEFAULT_TABLE table=default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.917876 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35ca809b19541479146f385e1d3cebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.918041 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.918112 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a0bd78c1e7409bb41392fd8f9a0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.918661 3383 tablet_service.cc:1467] Processing CreateTablet for tablet fc6b5ec8e472414789f9619ae958fa34 (DEFAULT_TABLE table=default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.918725 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6b5ec8e472414789f9619ae958fa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.918748 3395 tablet_service.cc:1467] Processing CreateTablet for tablet ae2368e4ae294470995667b87ad701fe (DEFAULT_TABLE table=default.Table_c44d243878514ff19a0f78c47f415f6a [id=15c6ceedaafb48a4b75f0e3838295b0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.918802 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c66c13648b6478b8420778f48ba208a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.918887 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 28861e966ce645878983bec6476255bb (DEFAULT_TABLE table=default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.918951 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28861e966ce645878983bec6476255bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.919060 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 97bb29eb3de04d65aa91e7ae8c652170 (DEFAULT_TABLE table=default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.919152 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bb29eb3de04d65aa91e7ae8c652170. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.919628 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 0c6a04e982ee493d815322ec6b2f267e (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.919699 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6a04e982ee493d815322ec6b2f267e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.920015 3377 tablet_service.cc:1467] Processing CreateTablet for tablet f0d6e064ac3645a0a855d97262f6e9ed (DEFAULT_TABLE table=default.Table_1be7cbef30a848f9ae2ee97dcfe1f267 [id=5f8793d7d917468b822398f75b3c7b36]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.920091 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d6e064ac3645a0a855d97262f6e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.920217 3378 tablet_service.cc:1467] Processing CreateTablet for tablet def9cfbc6f764499b1c6ac9b6845f5ed (DEFAULT_TABLE table=default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.920275 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9cfbc6f764499b1c6ac9b6845f5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.920639 3383 tablet_service.cc:1467] Processing CreateTablet for tablet fb04f46a17134bc28719be34085f714f (DEFAULT_TABLE table=default.Table_fb9e5cb5a2d34fbeb099c737572cfd5f [id=ebcd9bd681dc4a5298c3599542ce206f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.920719 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb04f46a17134bc28719be34085f714f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.920734 3385 tablet_service.cc:1467] Processing CreateTablet for tablet bcd888d924fd43b590710613560f16d5 (DEFAULT_TABLE table=default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.920807 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd888d924fd43b590710613560f16d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.921087 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.921164 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09db89ab7dd543559ae8a11e60c8a873. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.921175 3378 tablet_service.cc:1467] Processing CreateTablet for tablet d5419822600e463a9efb81ad86a10292 (DEFAULT_TABLE table=default.Table_452d4e866cf043a290b01f92fea60597 [id=56ba6004943340809edbf23f7af8bf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.921250 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5419822600e463a9efb81ad86a10292. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.921597 3385 tablet_service.cc:1467] Processing CreateTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (DEFAULT_TABLE table=default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.921694 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fe9bedd4b74166a4f4c34ec0b87f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.922122 3378 tablet_service.cc:1467] Processing CreateTablet for tablet f560f9e7e84d47faa147b33495e85055 (DEFAULT_TABLE table=default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.922166 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7181347114ccfbf62109147d182b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.922230 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560f9e7e84d47faa147b33495e85055. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.922354 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ab349b64b745ed97c3dae843b059aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.922784 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 8191b81bdad74a9b8aa049473325720b (DEFAULT_TABLE table=default.Table_f6a790f7709f440d98f1567067ed68a2 [id=47674ee5aac44634ba202fe90d14d49d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.922868 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8191b81bdad74a9b8aa049473325720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.923274 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 (DEFAULT_TABLE table=default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.923347 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbb9cfc01df408eaae41b38e8c62c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.923547 3382 tablet_service.cc:1467] Processing CreateTablet for tablet ad975dacafc94bc89c3996aa58a9b5a1 (DEFAULT_TABLE table=default.Table_7ed5666a03e441d8bd5b20eb88d5910a [id=81d22d650beb49f5827086b74342581e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.923615 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad975dacafc94bc89c3996aa58a9b5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.923822 3376 tablet_service.cc:1467] Processing CreateTablet for tablet cd8b9bf010d245be919f1e912b103770 (DEFAULT_TABLE table=default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.923965 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8b9bf010d245be919f1e912b103770. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.924687 3382 tablet_service.cc:1467] Processing CreateTablet for tablet 140bf4fc35274f2284c24534d3644695 (DEFAULT_TABLE table=default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.924762 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140bf4fc35274f2284c24534d3644695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.925398 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 74a62d026bb94c0fb908b36b38aa0f7f (DEFAULT_TABLE table=default.Table_080e6f46b4a4430fbbe8ae52c0055a43 [id=1faa87a45ad24ea7a41e678ed5b4c8d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.925467 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a62d026bb94c0fb908b36b38aa0f7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.925735 3382 tablet_service.cc:1467] Processing CreateTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 (DEFAULT_TABLE table=default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.925833 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ae1ff74cce48ada0a373f9e65508a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.926458 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 509f854a424e497f8fa72b70d5f0f651 (DEFAULT_TABLE table=default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.926522 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 509f854a424e497f8fa72b70d5f0f651. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.927434 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 71c23863beb24d27b337fa039d7f04cd (DEFAULT_TABLE table=default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.927502 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71c23863beb24d27b337fa039d7f04cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.927702 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 1e9c62a11d4744e199765f855fd0840b (DEFAULT_TABLE table=default.Table_1eacbd293bea443fa0780ba898123200 [id=3d13f917c9a04d4cb429be32533ec2f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.927796 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9c62a11d4744e199765f855fd0840b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.928117 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b89df9f987e46ae98fe21df847cb311. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.928737 3381 tablet_service.cc:1467] Processing CreateTablet for tablet d0e3265da9be49518705bedf6daa27a1 (DEFAULT_TABLE table=default.Table_d63e50fd58fd4335ba0165af0f856032 [id=3bedd46181134cf7bdc3b443a5aff915]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.928813 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e3265da9be49518705bedf6daa27a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.929150 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 21d5a121a87648ecbb842f52bc361602 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.929232 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d5a121a87648ecbb842f52bc361602. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.929697 3381 tablet_service.cc:1467] Processing CreateTablet for tablet bc3658cad19e46969abecacf490f43f1 (DEFAULT_TABLE table=default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.929769 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc3658cad19e46969abecacf490f43f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.930172 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 62aee0b0490e44a3aa820781bc9e4072 (DEFAULT_TABLE table=default.Table_bf3a10f29ee148a58b0b2c6c981f5d05 [id=86e6124c18724ba1bc7fc8c8772d1fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.930248 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aee0b0490e44a3aa820781bc9e4072. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.930678 3381 tablet_service.cc:1467] Processing CreateTablet for tablet e91450b4369844ea9ab09383b3dbc8ee (DEFAULT_TABLE table=default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.930747 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e91450b4369844ea9ab09383b3dbc8ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.934818 4338 raft_consensus.cc:491] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:02.934909 4338 raft_consensus.cc:513] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.935078 4338 leader_election.cc:290] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:02.936832 4551 tablet_replica.cc:331] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:02.936915 4551 raft_consensus.cc:2238] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:02.936988 4551 raft_consensus.cc:2267] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:02.937042 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:02.937125 4551 ts_tablet_manager.cc:1905] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:02.938131 3485 leader_election.cc:343] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:02.931154 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 77cd70765e54417fbf6234fe59480518 (DEFAULT_TABLE table=default.Table_d2c4a3b2009e4f548be4457d598fff95 [id=386128b91ada4ecca121f2d2053390a8]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.938774 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:12:02.913514 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d42535a811dc420b94527f7d81efdd13 (DEFAULT_TABLE table=default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.918748 3380 tablet_service.cc:1467] Processing CreateTablet for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193 (DEFAULT_TABLE table=default.Table_3632a48440e242ac8a768d8757c6f577 [id=b0be58963f2a48e2be7e161f71298d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.916052 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (DEFAULT_TABLE table=default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.937794 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:02.931219 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0541097b0b4916b559c14e48e08540. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.940198 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42535a811dc420b94527f7d81efdd13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.941185 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 8441d13c5b0c47bb9e16655c964ab58f (DEFAULT_TABLE table=default.Table_c0ff9042b1554e91a840ad8adde05cc9 [id=a02b68d5690c4d22bd6228e2cda045c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.941237 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d368093a74ba4918b0efcc3a909c3a07 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.941258 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8441d13c5b0c47bb9e16655c964ab58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.941298 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d368093a74ba4918b0efcc3a909c3a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.941340 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cd6b39cd88247bfa120903465b676b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.941496 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2836a492586e489daafc2da719455f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.941661 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 166e6390660c485c99b2e115fd1b272f (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.941790 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166e6390660c485c99b2e115fd1b272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.942504 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 74ab86571c3a469da7a51cf6033c5b10 (DEFAULT_TABLE table=default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.942524 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 6be683cdd24844eebaad0ed6a36be25f (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.942582 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74ab86571c3a469da7a51cf6033c5b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.943149 3248 tablet_service.cc:1467] Processing CreateTablet for tablet a154d22681d34329b497747e84ce41cf (DEFAULT_TABLE table=default.Table_4c4f267ca02940d58bc4543ec80f03ce [id=0949f4256757430885ac07328c985705]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.943238 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154d22681d34329b497747e84ce41cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.943539 3386 tablet_service.cc:1467] Processing CreateTablet for tablet af48bf64e2ca4a3197805c75fb0a12a6 (DEFAULT_TABLE table=default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.943631 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af48bf64e2ca4a3197805c75fb0a12a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.943679 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9256780f6e94b7ebd1276df07baf19d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.943539 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 29ed70f5db0e492eaf0c42e005736ad1 (DEFAULT_TABLE table=default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.943915 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ed70f5db0e492eaf0c42e005736ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.944425 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8e47c05a4b46d9a032852ad67b29ae (DEFAULT_TABLE table=default.Table_16575f283a0b491da19099917b25019d [id=0c3701a4f04444b7bd4bd5e4e0fcd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.944504 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8e47c05a4b46d9a032852ad67b29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.944844 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.944877 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0b60522b15489d9726af73a7bd1ee5 (DEFAULT_TABLE table=default.Table_d90a16759f704e54a0e7cdef7960d41a [id=33c05baa94c64e3d8139905db7e98f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.944962 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0b60522b15489d9726af73a7bd1ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.945597 3255 tablet_service.cc:1467] Processing CreateTablet for tablet ba609491f7ed4686b374fd7c0a5e39f8 (DEFAULT_TABLE table=default.Table_81cbb970502040e38384e43cc9935f43 [id=0097f32bdaf5478bbdd7cb6e58c2e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.945672 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba609491f7ed4686b374fd7c0a5e39f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.945947 3388 tablet_service.cc:1467] Processing CreateTablet for tablet d21906d23acc4ab8b81eceb87ead049f (DEFAULT_TABLE table=default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.946009 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 576e273ac51f4eb498faccab336c479d (DEFAULT_TABLE table=default.Table_c85f35b680824b1e82b624028c053124 [id=6d6c1ae6d0114e97bc24eaedecf1c904]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:02.946172 3484 leader_election.cc:343] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:02.946223 3484 leader_election.cc:304] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:02.946319 4338 raft_consensus.cc:2743] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:02.944815 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 8093f8487b9844718707e2fcdd3ae833 (DEFAULT_TABLE table=default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.946020 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21906d23acc4ab8b81eceb87ead049f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.946839 3259 tablet_service.cc:1467] Processing CreateTablet for tablet f3cba581c6884fd98503d4883b09d4a6 (DEFAULT_TABLE table=default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.946841 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.946916 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cba581c6884fd98503d4883b09d4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.946956 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3ebf56500b4c97b7553644d62fe83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.947099 3382 tablet_service.cc:1467] Processing CreateTablet for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (DEFAULT_TABLE table=default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.947167 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.947486 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 47205800bd074a9585c4af0f50055a13 (DEFAULT_TABLE table=default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.947559 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47205800bd074a9585c4af0f50055a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.947805 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ed45d371a34a51a42fb04f4a450ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.948153 3259 tablet_service.cc:1467] Processing CreateTablet for tablet dc2b34be581f44028fed1514c78d1874 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.948233 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2b34be581f44028fed1514c78d1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.948256 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576e273ac51f4eb498faccab336c479d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.949015 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8093f8487b9844718707e2fcdd3ae833. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.949314 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 47205800bd074a9585c4af0f50055a13 (DEFAULT_TABLE table=default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.949391 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47205800bd074a9585c4af0f50055a13. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.950779 3255 tablet_service.cc:1467] Processing CreateTablet for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (DEFAULT_TABLE table=default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.950821 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e5a7a6cd0a4f09b5a66f1f817c6193. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.950865 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.951999 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be683cdd24844eebaad0ed6a36be25f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.952009 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 5185ff7621e742eb81fa8964ec9ff20b (DEFAULT_TABLE table=default.Table_7ce9a506439a41599372c73d37cf0b15 [id=147b41dfa10b45599d423ceac25e8094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.952095 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5185ff7621e742eb81fa8964ec9ff20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.953064 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.953264 3243 tablet_service.cc:1467] Processing CreateTablet for tablet c64affc7645145069d6197ede241585e (DEFAULT_TABLE table=default.Table_9557727fc0e5449ba95961d750b88bc4 [id=2b92b0f8a8574e8c810ce7062c65acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.953351 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64affc7645145069d6197ede241585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.954591 3248 tablet_service.cc:1467] Processing CreateTablet for tablet d07f6f091ee847e49d1c64bee583a7a4 (DEFAULT_TABLE table=default.Table_e7a4050314f54e7eb39966cb227cdbb1 [id=e3aea013614447c38bd1f620138574a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.954675 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07f6f091ee847e49d1c64bee583a7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.954959 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2368e4ae294470995667b87ad701fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.944815 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 8a485231d2de4fab8b86b4900976c76c (DEFAULT_TABLE table=default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.956147 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a485231d2de4fab8b86b4900976c76c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.956331 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:02.956434 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 5d841537abc2437c826e069cc0725ad1 (DEFAULT_TABLE table=default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.956530 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841537abc2437c826e069cc0725ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.957643 3252 tablet_service.cc:1467] Processing CreateTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 (DEFAULT_TABLE table=default.Table_82dccea1c581459d84b2c919ff1b789f [id=d232a42364804631b9e5f03417214a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.957744 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc423aad4e7a49eaacb21c73d5d8c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.958390 4575 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:02.958833 4575 tablet_bootstrap.cc:654] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.958842 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 41e2e034ea974448922f2cb0529bd196 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.958931 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2e034ea974448922f2cb0529bd196. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.917577 3384 tablet_service.cc:1467] Processing CreateTablet for tablet b3e3be71c4324a5589a397ae76198f27 (DEFAULT_TABLE table=default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.959796 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3be71c4324a5589a397ae76198f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.960068 3247 tablet_service.cc:1467] Processing CreateTablet for tablet cf859ca6a22947ba80f99872d6dc6600 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.960153 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf859ca6a22947ba80f99872d6dc6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.961007 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (DEFAULT_TABLE table=default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.961087 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6a615c0c5d4815b540d81ef3357eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.961194 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cd70765e54417fbf6234fe59480518. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.961781 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 (DEFAULT_TABLE table=default.Table_ee9e9053bc3f4441967dea174020753e [id=50e32bfecf514cb0972986f128ff095a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.961884 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.922122 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (DEFAULT_TABLE table=default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.962541 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cbd61aec79d479d9eea8d807cd5fb0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.962817 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 817a8a975fea4da9a994e78f86da961f (DEFAULT_TABLE table=default.Table_a3b73807076c4f0aabf9e6f82eca2bef [id=791960255cad40b1814de43ae15c9ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.962898 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a8a975fea4da9a994e78f86da961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.963600 3242 tablet_service.cc:1467] Processing CreateTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 (DEFAULT_TABLE table=default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.963680 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9acac6e5e8a486ea8e269359498c3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.964356 3260 tablet_service.cc:1467] Processing CreateTablet for tablet f55439e91f284175a59d35160668fa6c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.964430 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55439e91f284175a59d35160668fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.965833 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 2377c27855a64ac7bec95a6d6c5289af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:11:54 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:02.965970 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 8decec5964f14766b997192fbf4f7051 (DEFAULT_TABLE table=default.Table_7f11f45ebda04d1d934c330ec17ceccf [id=05d6c7181b804de9ac10c342612b7e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.966058 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decec5964f14766b997192fbf4f7051. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.921597 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 6b6621592191408cb1eeaf69869258a5 (DEFAULT_TABLE table=default.Table_c73488a369ec4bc196196444fa9c3632 [id=4fdef59a83b241a785c3ed32b8eeb977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.967428 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b6621592191408cb1eeaf69869258a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.967931 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (DEFAULT_TABLE table=default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.968147 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1465bcc80e40cdad4e0722eb0d74c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.970082 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
I20250115 10:12:02.970429 4557 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.970484 4557 ts_tablet_manager.cc:1397] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.000s
I20250115 10:12:02.970670 4557 raft_consensus.cc:357] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.970739 4557 raft_consensus.cc:383] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.970762 4557 raft_consensus.cc:738] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.970801 4557 consensus_queue.cc:260] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.970911 4557 ts_tablet_manager.cc:1428] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:02.970986 4557 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.971017 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (DEFAULT_TABLE table=default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.971112 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3402dc674ab0402f8e0bdd7b8db4b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.971454 4557 tablet_bootstrap.cc:654] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.973080 3259 tablet_service.cc:1467] Processing CreateTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.973166 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c99788dae6421b8b2dd4f40e2b63b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.974404 3259 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a (DEFAULT_TABLE table=default.Table_d59e20c98bd84db48c45d49171eff4fd [id=10b43b32ad174b12b4a2da8cceaaeac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.974478 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.974488 4338 raft_consensus.cc:491] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:02.974540 4338 raft_consensus.cc:513] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.974669 4338 leader_election.cc:290] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:02.974797 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:02.974814 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:02.974949 3484 leader_election.cc:343] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:02.974987 3485 leader_election.cc:343] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:02.975018 3485 leader_election.cc:304] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:02.975097 4338 raft_consensus.cc:2743] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:02.975574 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 76499a085d9d4f74818684d3148a4866 (DEFAULT_TABLE table=default.Table_c1c600c53e0b472ea680a14709e39431 [id=a5a191eb03004d86863bb4390fad5543]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.975656 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76499a085d9d4f74818684d3148a4866. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.976116 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 06c5994686054f51802fb9125beb85c4 (DEFAULT_TABLE table=default.Table_1c5f565cf47e469aa8fda3d4022e032f [id=cca7bb92e53a40b793e4e8f5033401fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.976209 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c5994686054f51802fb9125beb85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.976891 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 707f0e47915e4a8998a97a8680394e5d (DEFAULT_TABLE table=default.Table_5b1fd5cfd1424151839bc16fb5c88670 [id=05b392915cd34cf9af16ae61741e53f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.977027 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707f0e47915e4a8998a97a8680394e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.977361 3255 tablet_service.cc:1467] Processing CreateTablet for tablet b1b423922cbb4a42bbdb4de025227118 (DEFAULT_TABLE table=default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.977515 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b423922cbb4a42bbdb4de025227118. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.978749 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 766ddeab54194401aeb942516e42dc84 (DEFAULT_TABLE table=default.Table_e762e9011d9f4fe1856dc4923700d779 [id=0ed50e4d34254318a993c3268808ce39]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.978857 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766ddeab54194401aeb942516e42dc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.979197 4557 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.979249 4557 ts_tablet_manager.cc:1397] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:02.979681 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 (DEFAULT_TABLE table=default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.979676 4557 raft_consensus.cc:357] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.979771 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4f2e19e4443b38430cdb95bd82f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.979761 4557 raft_consensus.cc:383] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.979794 4557 raft_consensus.cc:738] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.979840 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 0e23a070a8454f3b8bd1620ac4535a12 (DEFAULT_TABLE table=default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 [id=25897e7460ce44ab84a870fcae962481]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.979840 4557 consensus_queue.cc:260] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.979907 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e23a070a8454f3b8bd1620ac4535a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.979944 4557 ts_tablet_manager.cc:1428] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:02.980012 4557 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.980439 4557 tablet_bootstrap.cc:654] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.980696 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 63980fabd5634bf39c41215740cd4d72 (DEFAULT_TABLE table=default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.980763 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63980fabd5634bf39c41215740cd4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.980937 3251 tablet_service.cc:1467] Processing CreateTablet for tablet a76df2d8b00c46949afac48a55d8200f (DEFAULT_TABLE table=default.Table_37e85cc42de44c9ea1e9d33a94d70be8 [id=1a36a0dbf9eb490ba53332a260571b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.981001 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76df2d8b00c46949afac48a55d8200f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.981709 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.981774 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d3800d79794d3bad6c50d2dc8e9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.981966 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9295765384410d9ee9380b4db88ed0 (DEFAULT_TABLE table=default.Table_ded364210b934ba3a4824b517b6db826 [id=268b8b77011f466abc17b7600aceadd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.982028 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9295765384410d9ee9380b4db88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.982693 3249 tablet_service.cc:1467] Processing CreateTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 (DEFAULT_TABLE table=default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.982767 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3326a9a37a64e9a9485e5abadc2e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.983760 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 77b422773c3346199383ca64330719c6 (DEFAULT_TABLE table=default.Table_f04269f5ae13474e959f42bee487f199 [id=195139f257d2494791df1002a43aee3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.983862 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b422773c3346199383ca64330719c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.983897 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:02.984047 4557 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.984088 4557 ts_tablet_manager.cc:1397] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:02.984165 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab (DEFAULT_TABLE table=default.Table_1069ce4193974a938cb848fe3f45dfd0 [id=ee5989ff607243e38ee167a4d318eaaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.984237 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b19ae7373c4de688ae30eb7e1d9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.984229 4557 raft_consensus.cc:357] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.984299 4557 raft_consensus.cc:383] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.984328 4557 raft_consensus.cc:738] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.984364 4557 consensus_queue.cc:260] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.984476 4557 ts_tablet_manager.cc:1428] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:02.984545 4557 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.984690 3249 tablet_service.cc:1467] Processing CreateTablet for tablet cb8ecc0818304f5e9522bba63a4aca4d (DEFAULT_TABLE table=default.Table_dbaca6558a074caa8671547657908e94 [id=4c4374e6c65149d087e5507ced04d9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.984763 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8ecc0818304f5e9522bba63a4aca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.984968 4557 tablet_bootstrap.cc:654] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.985244 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 8600883e5a5449c59a747a6ef2121c61 (DEFAULT_TABLE table=default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.985332 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8600883e5a5449c59a747a6ef2121c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.985677 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb (DEFAULT_TABLE table=default.Table_36a2b6b01e684edb9cd4c0f11317ea56 [id=7e11745e5dd243d69cb4463cc11edf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.985749 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616166bc9d5d4651999b1d2e0a1851bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.986166 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:02.986267 3253 tablet_service.cc:1467] Processing CreateTablet for tablet ce8455d282d34bbe9822a00a28d4c3ec (DEFAULT_TABLE table=default.Table_659f850eaa924b75a860677bd9ea33f7 [id=2e0b0b4cbc9f4f678d7db889c9be970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.986338 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8455d282d34bbe9822a00a28d4c3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.986688 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 6435fd1953d440c8b4d9745a5dcd15f6 (DEFAULT_TABLE table=default.Table_79af526c42b24e2f8ae1da15d106cbe9 [id=22fbb91517214bfeb4c6d732904ac18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.986769 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6435fd1953d440c8b4d9745a5dcd15f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.987355 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 14f3aea0cf684f749027f817eb3b13b7 (DEFAULT_TABLE table=default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.987422 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f3aea0cf684f749027f817eb3b13b7. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:02.987552 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:02.987663 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 3fecca0f91e04702b438c9639303fac2 (DEFAULT_TABLE table=default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.988066 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:02.988168 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 1385fb81dff24e709d5d45fb9d616369 (DEFAULT_TABLE table=default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf [id=23c0981b39e2410196a18d8842f329b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.988261 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1385fb81dff24e709d5d45fb9d616369. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.988914 4557 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:02.988958 4557 ts_tablet_manager.cc:1397] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:02.989125 4557 raft_consensus.cc:357] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.989192 4557 raft_consensus.cc:383] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:02.989215 4557 raft_consensus.cc:738] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:02.989249 4557 consensus_queue.cc:260] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:02.989338 4557 ts_tablet_manager.cc:1428] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:02.989405 4557 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:02.989486 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 12379200d11e4ed3800f609d34a54ea7 (DEFAULT_TABLE table=default.Table_c09214a5f550425b928dcb0caf8ab823 [id=694250c24a29434a8486d3679391c59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.989583 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12379200d11e4ed3800f609d34a54ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.989835 4557 tablet_bootstrap.cc:654] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:02.990785 3243 tablet_service.cc:1467] Processing CreateTablet for tablet d200e7e299214ab8aad3a42a4d513da5 (DEFAULT_TABLE table=default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.990839 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
I20250115 10:12:02.990870 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d200e7e299214ab8aad3a42a4d513da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.992880 3253 tablet_service.cc:1467] Processing CreateTablet for tablet bfe0522e3e664012a00ec78a09c2816c (DEFAULT_TABLE table=default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.992986 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5 (DEFAULT_TABLE table=default.Table_37c905a6d3fe455882ef028a290d6588 [id=7f25a9ec0c1d4d2ab8e54772756694be]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.993580 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.994760 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 9305b7ac82cd4393b28017831a0687ff (DEFAULT_TABLE table=default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.994848 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9305b7ac82cd4393b28017831a0687ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.996012 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5da557a18648719980469579c3979f (DEFAULT_TABLE table=default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.996096 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5da557a18648719980469579c3979f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.997176 3241 tablet_service.cc:1467] Processing CreateTablet for tablet b110fe6c13204cf295abb29839f3380b (DEFAULT_TABLE table=default.Table_7cc7f5b2700343b7b48aae25a2f75b37 [id=2d9f80bd6fda4b22af4bb90503c90a4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.997251 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b110fe6c13204cf295abb29839f3380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.998273 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 0922008e726c4e53b00b287261a2f0a3 (DEFAULT_TABLE table=default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.998358 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0922008e726c4e53b00b287261a2f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.993039 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.999104 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a83c4de3849498be5c6e4f9c8b00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.999953 4557 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.000016 4557 ts_tablet_manager.cc:1397] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:03.000237 4557 raft_consensus.cc:357] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.000310 4557 raft_consensus.cc:383] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.000334 4557 raft_consensus.cc:738] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.000381 4557 consensus_queue.cc:260] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.000468 3248 tablet_service.cc:1467] Processing CreateTablet for tablet a076172bba8e4878978c318d441577bd (DEFAULT_TABLE table=default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.000507 4557 ts_tablet_manager.cc:1428] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:03.000555 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a076172bba8e4878978c318d441577bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.000586 4557 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.001053 4557 tablet_bootstrap.cc:654] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.002017 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 5f37b29ba1cb4a0289268ba1241527b8 (DEFAULT_TABLE table=default.Table_f448ab1cfae2403393f3884d0a50fd61 [id=2cd4c5e9ab1f4e018b47117186f14066]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.002149 4557 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.002156 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f37b29ba1cb4a0289268ba1241527b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.002193 4557 ts_tablet_manager.cc:1397] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:02.993104 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 6f611ee9e87048ca8bddaa6525bbd054 (DEFAULT_TABLE table=default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.002821 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f611ee9e87048ca8bddaa6525bbd054. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.003448 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:03.004158 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 14a9663596174aa1b72ce71e49183a2b (DEFAULT_TABLE table=default.Table_202be7fd65b14cb88442d558eb06fed9 [id=ca363805a72c4ed6af847c3a1b61803e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.004273 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a9663596174aa1b72ce71e49183a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.004419 4557 raft_consensus.cc:357] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.004504 4557 raft_consensus.cc:383] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.004536 4557 raft_consensus.cc:738] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.004594 4557 consensus_queue.cc:260] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.004700 4557 ts_tablet_manager.cc:1428] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.004771 4557 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.005240 4557 tablet_bootstrap.cc:654] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.005699 3244 tablet_service.cc:1467] Processing CreateTablet for tablet fcf567628009460dbb7bfa582f69b4f1 (DEFAULT_TABLE table=default.Table_1b401a0e880a4244a7a60cde99fe7a62 [id=b657ebccf5124395b20e91032a0f1cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.005833 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf567628009460dbb7bfa582f69b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.006513 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:02.993175 3247 tablet_service.cc:1467] Processing CreateTablet for tablet d02e33022c3840c28623200adb56e3bc (DEFAULT_TABLE table=default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 [id=aeff809e211042a1b0bf7a57d8c754e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.006667 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02e33022c3840c28623200adb56e3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.007869 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:03.008085 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e (DEFAULT_TABLE table=default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.008221 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4283a096b18b4be69e1f57e60c3efd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.009339 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 8dde69ff2f574d838d81bea5a53700f5 (DEFAULT_TABLE table=default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.009450 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dde69ff2f574d838d81bea5a53700f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.010720 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 9077d0eed1974bc898370b5d5554be71 (DEFAULT_TABLE table=default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.993314 3242 tablet_service.cc:1467] Processing CreateTablet for tablet d73af05d7fd349b083eb74352a62a1fe (DEFAULT_TABLE table=default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.010906 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73af05d7fd349b083eb74352a62a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.012190 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.012315 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7c1c0ac4d3487187907a49343381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.013477 3242 tablet_service.cc:1467] Processing CreateTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.013605 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7e96ba921d4fbb96afbbf8c5f354f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:02.993361 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 26351bbe70044075a99982bb380d86a0 (DEFAULT_TABLE table=default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.014369 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26351bbe70044075a99982bb380d86a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.015125 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 9647ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:02.993423 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 87d8167b34064888be6e4df4dfde0b31 (DEFAULT_TABLE table=default.Table_196ff2f45dc94ec58c60a08545468524 [id=588ca457130b479db3f999ed2f492120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.015722 3252 tablet_service.cc:1467] Processing CreateTablet for tablet b7a6ec9020494019a32cfb428554bd07 (DEFAULT_TABLE table=default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.993484 3246 tablet_service.cc:1467] Processing CreateTablet for tablet e3dd43785e2541d8be54b6ca339a754d (DEFAULT_TABLE table=default.Table_ee808cbef43c429ba5a671726e74c5ac [id=2e12df36e70c48bdb039351c533e802a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.015964 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d8167b34064888be6e4df4dfde0b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.016032 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd43785e2541d8be54b6ca339a754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.016412 3383 tablet_service.cc:1467] Processing CreateTablet for tablet afe405846f924decb1786b338a306f62 (DEFAULT_TABLE table=default.Table_0d43a0379fa042929ffb70c09407e4f2 [id=3094f0694b4b4f308b40e4ffe25cfbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:02.993233 3245 tablet_service.cc:1467] Processing CreateTablet for tablet bb4d112daca24c82931daf050edbd846 (DEFAULT_TABLE table=default.Table_2deceee1167f46b8aea6e6f3fa075cf7 [id=093d224f08744cf38ab4f22d0c0b6e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.016536 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe405846f924decb1786b338a306f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.016620 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d112daca24c82931daf050edbd846. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.016736 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec3c400b50a4c8b9c490158732582f5 (DEFAULT_TABLE table=default.Table_be6f200b0d3f4f46a97001d4956b8e8f [id=bd2ea93d44e4471fbef2e817ef124c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.018134 3383 tablet_service.cc:1467] Processing CreateTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 (DEFAULT_TABLE table=default.Table_0c75970bf5ff4311a8bacd12c3ec98d7 [id=03162de587a24aef8dc6cfcb976fb9b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.018150 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec3c400b50a4c8b9c490158732582f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.018334 3257 tablet_service.cc:1467] Processing CreateTablet for tablet bf882dcd84be4b38af533b64dfb4fd95 (DEFAULT_TABLE table=default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 [id=0041976377904d41939a1ea9a5fcc07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.018384 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 7629a309511c4251b1e9ce231ef0fcf0 (DEFAULT_TABLE table=default.Table_b7f5565de66f4ea5884b8c57e72d6613 [id=39e850f5f01a452fba3674612dbc6548]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.018456 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7629a309511c4251b1e9ce231ef0fcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.018554 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf882dcd84be4b38af533b64dfb4fd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.019342 4557 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.019400 4557 ts_tablet_manager.cc:1397] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250115 10:12:03.019567 4557 raft_consensus.cc:357] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.019634 4557 raft_consensus.cc:383] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.019656 4557 raft_consensus.cc:738] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.019701 4557 consensus_queue.cc:260] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.019779 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35847dc829b4b3d94c0fb68ec6c2b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.019862 4557 ts_tablet_manager.cc:1428] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.019944 4557 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.020376 4557 tablet_bootstrap.cc:654] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.020395 3257 tablet_service.cc:1467] Processing CreateTablet for tablet f682c7942a454d86a5df19eeac533361 (DEFAULT_TABLE table=default.Table_083c387389e741fa8d1c07011d4e7f5d [id=940ec8ab0c8a48be99dbb34e0ef6d263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.020632 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f682c7942a454d86a5df19eeac533361. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.021183 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fecca0f91e04702b438c9639303fac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.021816 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 82c66363913e47399c4e1e8533bdadd0 (DEFAULT_TABLE table=default.Table_f1faf951819049d9aac897e67c029beb [id=86cef7da77da456089b46d9647ee7e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.021905 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c66363913e47399c4e1e8533bdadd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.022423 3249 tablet_service.cc:1467] Processing CreateTablet for tablet c77afc007fac49848786aaecd4d1e214 (DEFAULT_TABLE table=default.Table_780d6792486f4d65bb71098c78eec010 [id=65d6de2c925e407094df78186e79ddf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.022504 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77afc007fac49848786aaecd4d1e214. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.023276 3260 tablet_service.cc:1467] Processing CreateTablet for tablet ca2e043501b04096b648d179a13e8653 (DEFAULT_TABLE table=default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.023362 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e043501b04096b648d179a13e8653. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.023561 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac231c1b8e04e8788f7bc368a87acdb (DEFAULT_TABLE table=default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.023656 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac231c1b8e04e8788f7bc368a87acdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.024602 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 368df29ba175447ba4c009c7eb15a49d (DEFAULT_TABLE table=default.Table_746d39dd624c4988b0521a7a6af0e896 [id=5e846a21e7a54dcda298097ce402c196]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.024618 3376 tablet_service.cc:1467] Processing CreateTablet for tablet b33c7ecdd251412eaeed45e378e5cc75 (DEFAULT_TABLE table=default.Table_93ee920c32874d4888ddf9c25fbdff06 [id=7be4cd372cf148b6ad10b57523e826ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.024685 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368df29ba175447ba4c009c7eb15a49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.024701 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c7ecdd251412eaeed45e378e5cc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.024694 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 7144ec81e9244eb49715450aeda5f82f (DEFAULT_TABLE table=default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.024793 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144ec81e9244eb49715450aeda5f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.025796 3260 tablet_service.cc:1467] Processing CreateTablet for tablet f4cee0b04c6e4eb39dd22668aacb2801 (DEFAULT_TABLE table=default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.025836 3376 tablet_service.cc:1467] Processing CreateTablet for tablet cf859ca6a22947ba80f99872d6dc6600 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.025902 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cee0b04c6e4eb39dd22668aacb2801. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.025939 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf859ca6a22947ba80f99872d6dc6600. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.026849 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 709a9b0953dd4b108825b663d703e609 (DEFAULT_TABLE table=default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.026939 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709a9b0953dd4b108825b663d703e609. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.027096 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 8decec5964f14766b997192fbf4f7051 (DEFAULT_TABLE table=default.Table_7f11f45ebda04d1d934c330ec17ceccf [id=05d6c7181b804de9ac10c342612b7e2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.027173 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8decec5964f14766b997192fbf4f7051. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.027523 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:03.027794 3393 tablet_service.cc:1467] Processing CreateTablet for tablet f55439e91f284175a59d35160668fa6c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.027901 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55439e91f284175a59d35160668fa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.028532 3251 tablet_service.cc:1467] Processing CreateTablet for tablet 0496864e655e40dfac38619adbf4fd87 (DEFAULT_TABLE table=default.Table_00c57a31372740fe9620a054ec21d16e [id=5da2380bb07b43758f04bbd828525b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.028625 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496864e655e40dfac38619adbf4fd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.028600 3384 tablet_service.cc:1467] Processing CreateTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 (DEFAULT_TABLE table=default.Table_82dccea1c581459d84b2c919ff1b789f [id=d232a42364804631b9e5f03417214a3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.028699 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc423aad4e7a49eaacb21c73d5d8c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.029402 3388 tablet_service.cc:1467] Processing CreateTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 (DEFAULT_TABLE table=default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.029481 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9acac6e5e8a486ea8e269359498c3a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.029850 4551 ts_tablet_manager.cc:1918] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:03.029898 4551 log.cc:1198] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/5779ec7816cd499ebe46962e29092a70
I20250115 10:12:03.030128 4551 ts_tablet_manager.cc:1939] T 5779ec7816cd499ebe46962e29092a70 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.030125 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 5d841537abc2437c826e069cc0725ad1 (DEFAULT_TABLE table=default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.030228 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d841537abc2437c826e069cc0725ad1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.030360 4551 tablet_replica.cc:331] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.030409 4551 raft_consensus.cc:2238] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.030441 4551 raft_consensus.cc:2267] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.030561 4551 ts_tablet_manager.cc:1905] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.031004 3395 tablet_service.cc:1467] Processing CreateTablet for tablet 166e6390660c485c99b2e115fd1b272f (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.031100 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166e6390660c485c99b2e115fd1b272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.031849 3379 tablet_service.cc:1467] Processing CreateTablet for tablet a154d22681d34329b497747e84ce41cf (DEFAULT_TABLE table=default.Table_4c4f267ca02940d58bc4543ec80f03ce [id=0949f4256757430885ac07328c985705]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.031919 3255 tablet_service.cc:1467] Processing CreateTablet for tablet 50d2f7ec7d44422ebc35e29797bfd456 (DEFAULT_TABLE table=default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.031983 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a154d22681d34329b497747e84ce41cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.032054 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d2f7ec7d44422ebc35e29797bfd456. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.032711 3387 tablet_service.cc:1467] Processing CreateTablet for tablet d07f6f091ee847e49d1c64bee583a7a4 (DEFAULT_TABLE table=default.Table_e7a4050314f54e7eb39966cb227cdbb1 [id=e3aea013614447c38bd1f620138574a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.032801 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07f6f091ee847e49d1c64bee583a7a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.033443 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (DEFAULT_TABLE table=default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.033524 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6a615c0c5d4815b540d81ef3357eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.034211 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 41e2e034ea974448922f2cb0529bd196 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.034303 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2e034ea974448922f2cb0529bd196. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.034938 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 (DEFAULT_TABLE table=default.Table_ee9e9053bc3f4441967dea174020753e [id=50e32bfecf514cb0972986f128ff095a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.035024 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.035796 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 6d8e47c05a4b46d9a032852ad67b29ae (DEFAULT_TABLE table=default.Table_16575f283a0b491da19099917b25019d [id=0c3701a4f04444b7bd4bd5e4e0fcd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.035899 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8e47c05a4b46d9a032852ad67b29ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.036664 3389 tablet_service.cc:1467] Processing CreateTablet for tablet ba609491f7ed4686b374fd7c0a5e39f8 (DEFAULT_TABLE table=default.Table_81cbb970502040e38384e43cc9935f43 [id=0097f32bdaf5478bbdd7cb6e58c2e223]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.036757 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba609491f7ed4686b374fd7c0a5e39f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.036839 4463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.217.188:38283, user_credentials={real_user=slave}} blocked reactor thread for 95346.7us
I20250115 10:12:03.037483 3392 tablet_service.cc:1467] Processing CreateTablet for tablet f3cba581c6884fd98503d4883b09d4a6 (DEFAULT_TABLE table=default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.037564 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3cba581c6884fd98503d4883b09d4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.037657 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d667834206fe4410a22b4944b3494462 (table default.Table_2aac3f8e33724b08aef2d33299a13414 [id=ab569ac74bbb44f1913506709002a4c4]) successfully deleted
W20250115 10:12:03.037756 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet fc423aad4e7a49eaacb21c73d5d8c341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc423aad4e7a49eaacb21c73d5d8c341 already in progress: creating tablet
W20250115 10:12:03.037806 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f9256780f6e94b7ebd1276df07baf19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9256780f6e94b7ebd1276df07baf19d already in progress: creating tablet
W20250115 10:12:03.037846 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet d35847dc829b4b3d94c0fb68ec6c2b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35847dc829b4b3d94c0fb68ec6c2b31 already in progress: creating tablet
W20250115 10:12:03.037880 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet c64affc7645145069d6197ede241585e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c64affc7645145069d6197ede241585e already in progress: creating tablet
W20250115 10:12:03.037916 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 already in progress: creating tablet
I20250115 10:12:03.037950 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 5779ec7816cd499ebe46962e29092a70 (table default.Table_70caeb4fbfda4cfa8cc306d6aac1f734 [id=1d766421e2be4d92b84d436c65506229]) successfully deleted
I20250115 10:12:03.038211 3525 tablet_service.cc:1467] Processing CreateTablet for tablet 63980fabd5634bf39c41215740cd4d72 (DEFAULT_TABLE table=default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038291 3386 tablet_service.cc:1467] Processing CreateTablet for tablet dc2b34be581f44028fed1514c78d1874 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038312 3511 tablet_service.cc:1467] Processing CreateTablet for tablet 12379200d11e4ed3800f609d34a54ea7 (DEFAULT_TABLE table=default.Table_c09214a5f550425b928dcb0caf8ab823 [id=694250c24a29434a8486d3679391c59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038383 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2b34be581f44028fed1514c78d1874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.038407 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 0922008e726c4e53b00b287261a2f0a3 (DEFAULT_TABLE table=default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038481 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (DEFAULT_TABLE table=default.Table_681746e4aa1447c2a068ff6e85d9b022 [id=59ace488897c42a3a28b6118667f6403]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038539 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 0d5cf0e380d348f1ae2f05db1a010a19 (DEFAULT_TABLE table=default.Table_b3d35645a38345699f01877647f097be [id=7ffb156709624e9bace6cb13a4d83007]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038595 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 4c49b39058164387990c4f6dc170785e (DEFAULT_TABLE table=default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 [id=8d38c2511ddc4940b470805a54f8b1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038651 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 8dde69ff2f574d838d81bea5a53700f5 (DEFAULT_TABLE table=default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038935 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (DEFAULT_TABLE table=default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.038970 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f01ac3f0973a4af1be9dbb48e5f7af90" } new_table_name: "default.Table_8166964273cd466883c47516ef68ef46" modify_external_catalogs: true
I20250115 10:12:03.039050 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5 (DEFAULT_TABLE table=default.Table_37c905a6d3fe455882ef028a290d6588 [id=7f25a9ec0c1d4d2ab8e54772756694be]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039088 3382 tablet_service.cc:1467] Processing CreateTablet for tablet c64affc7645145069d6197ede241585e (DEFAULT_TABLE table=default.Table_9557727fc0e5449ba95961d750b88bc4 [id=2b92b0f8a8574e8c810ce7062c65acae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039119 3519 tablet_service.cc:1467] Processing CreateTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab (DEFAULT_TABLE table=default.Table_1069ce4193974a938cb848fe3f45dfd0 [id=ee5989ff607243e38ee167a4d318eaaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039180 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64affc7645145069d6197ede241585e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.039204 3528 tablet_service.cc:1467] Processing CreateTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039264 3530 tablet_service.cc:1467] Processing CreateTablet for tablet ce8455d282d34bbe9822a00a28d4c3ec (DEFAULT_TABLE table=default.Table_659f850eaa924b75a860677bd9ea33f7 [id=2e0b0b4cbc9f4f678d7db889c9be970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039327 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (DEFAULT_TABLE table=default.Table_2648dfb12d924eda9b18368da8df24a5 [id=0298d09bab6149af8c9c418b3d064b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039397 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 5f37b29ba1cb4a0289268ba1241527b8 (DEFAULT_TABLE table=default.Table_f448ab1cfae2403393f3884d0a50fd61 [id=2cd4c5e9ab1f4e018b47117186f14066]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039414 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 21d5a121a87648ecbb842f52bc361602 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.039479 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 4a0811cad8454c2e871aad2101224f34 (DEFAULT_TABLE table=default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039559 3520 tablet_service.cc:1467] Processing CreateTablet for tablet a577ace8245744d1a42938ddd99ce89b (DEFAULT_TABLE table=default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039623 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 50d2f7ec7d44422ebc35e29797bfd456 (DEFAULT_TABLE table=default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.039755 4476 master_service.cc:946] ReplaceTablet: received request to replace tablet 8a3ebf56500b4c97b7553644d62fe83a from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.039826 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_681746e4aa1447c2a068ff6e85d9b022" } new_table_name: "default.Table_d8204dbea13e49cc85f44f199f3004f3" modify_external_catalogs: true
I20250115 10:12:03.039881 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 65a0bd78c1e7409bb41392fd8f9a0862 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.040038 4470 master_service.cc:946] ReplaceTablet: received request to replace tablet 6be683cdd24844eebaad0ed6a36be25f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.039695 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 6f611ee9e87048ca8bddaa6525bbd054 (DEFAULT_TABLE table=default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.040081 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 5185ff7621e742eb81fa8964ec9ff20b (DEFAULT_TABLE table=default.Table_7ce9a506439a41599372c73d37cf0b15 [id=147b41dfa10b45599d423ceac25e8094]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.040174 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5185ff7621e742eb81fa8964ec9ff20b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.039784 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 0e23a070a8454f3b8bd1620ac4535a12 (DEFAULT_TABLE table=default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 [id=25897e7460ce44ab84a870fcae962481]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.040236 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2bf4b207818b4981b8c9f52f2cc5ace8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.040346 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bf4b207818b4981b8c9f52f2cc5ace8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.040522 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_37e85cc42de44c9ea1e9d33a94d70be8" } new_table_name: "default.Table_1de5428c45384daea1c3cf0c936fd367" modify_external_catalogs: true
I20250115 10:12:03.042387 4520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:03.042531 4520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:12:03.039631 4469 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b056ece1636f4b1bb6bd53bf85e607a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.042824 4469 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b056ece1636f4b1bb6bd53bf85e607a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.042953 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet d190044d103e441193e224c667108543 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.042980 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe0522e3e664012a00ec78a09c2816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.044463 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 3c778d7be748405285068f36650902b0 (DEFAULT_TABLE table=default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.044572 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c778d7be748405285068f36650902b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.045662 3258 tablet_service.cc:1467] Processing CreateTablet for tablet afe405846f924decb1786b338a306f62 (DEFAULT_TABLE table=default.Table_0d43a0379fa042929ffb70c09407e4f2 [id=3094f0694b4b4f308b40e4ffe25cfbf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.045775 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe405846f924decb1786b338a306f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.045830 4536 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:03.045919 4536 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:03.045830 4560 mvcc.cc:204] Tried to move back new op lower bound from 7114489539525881856 to 7114489539408736256. Current Snapshot: MvccSnapshot[applied={T|T < 7114489539525881856}]
I20250115 10:12:03.046900 3242 tablet_service.cc:1467] Processing CreateTablet for tablet b33c7ecdd251412eaeed45e378e5cc75 (DEFAULT_TABLE table=default.Table_93ee920c32874d4888ddf9c25fbdff06 [id=7be4cd372cf148b6ad10b57523e826ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.046978 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33c7ecdd251412eaeed45e378e5cc75. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.048041 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077d0eed1974bc898370b5d5554be71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.049162 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 7629a309511c4251b1e9ce231ef0fcf0 (DEFAULT_TABLE table=default.Table_b7f5565de66f4ea5884b8c57e72d6613 [id=39e850f5f01a452fba3674612dbc6548]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.049309 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7629a309511c4251b1e9ce231ef0fcf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.050556 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec3c400b50a4c8b9c490158732582f5 (DEFAULT_TABLE table=default.Table_be6f200b0d3f4f46a97001d4956b8e8f [id=bd2ea93d44e4471fbef2e817ef124c60]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.050704 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ec3c400b50a4c8b9c490158732582f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.051823 3253 tablet_service.cc:1467] Processing CreateTablet for tablet ce84190f55b14902ab678a98e622dc4f (DEFAULT_TABLE table=default.Table_6cc1bb874cf24449a25401e70c030f9e [id=0161accf9e4545e688d747883ea0114d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.051975 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84190f55b14902ab678a98e622dc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.054636 4569 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.054682 4569 ts_tablet_manager.cc:1397] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.251s user 0.001s sys 0.000s
I20250115 10:12:03.054862 4569 raft_consensus.cc:357] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.054922 4569 raft_consensus.cc:383] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.054944 4569 raft_consensus.cc:738] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.054983 4569 consensus_queue.cc:260] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.055105 4569 ts_tablet_manager.cc:1428] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.055192 4569 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.055697 4569 tablet_bootstrap.cc:654] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.056782 3377 tablet_service.cc:1467] Processing CreateTablet for tablet ce84190f55b14902ab678a98e622dc4f (DEFAULT_TABLE table=default.Table_6cc1bb874cf24449a25401e70c030f9e [id=0161accf9e4545e688d747883ea0114d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.056902 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84190f55b14902ab678a98e622dc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.057826 4569 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.057878 4569 ts_tablet_manager.cc:1397] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.058023 4569 raft_consensus.cc:357] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.058100 4569 raft_consensus.cc:383] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.058137 4569 raft_consensus.cc:738] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.058178 4569 consensus_queue.cc:260] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.058283 4569 ts_tablet_manager.cc:1428] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.058341 4569 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.058745 4569 tablet_bootstrap.cc:654] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.060498 4569 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.060549 4569 ts_tablet_manager.cc:1397] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.060698 4569 raft_consensus.cc:357] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.060761 4569 raft_consensus.cc:383] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.060782 4569 raft_consensus.cc:738] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.060824 4569 consensus_queue.cc:260] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.060926 4569 ts_tablet_manager.cc:1428] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.060989 4569 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.061707 4569 tablet_bootstrap.cc:654] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.061769 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c94cb50778e44890bd8c4bdc868673e3 consensus state has no leader
W20250115 10:12:03.061956 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f889cc1201404c8691bf01256750e244
I20250115 10:12:03.062122 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.062211 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9cb4c818781b40d58f604ee6907db77b" } new_table_name: "default.Table_f1f5edc3a940475c9c4190d008aa7eff" modify_external_catalogs: true
I20250115 10:12:03.062439 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 21d5a121a87648ecbb842f52bc361602
I20250115 10:12:03.062500 4472 catalog_manager.cc:6596] ReplaceTablet: tablet 21d5a121a87648ecbb842f52bc361602 deleted and replaced by tablet 900475e1e900423c9b9205540f67e5de
I20250115 10:12:03.062568 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_afec1e69165e46f4a401075412905128"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.062695 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afec1e69165e46f4a401075412905128 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.062855 4476 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:03.062906 4476 catalog_manager.cc:6596] ReplaceTablet: tablet 8a3ebf56500b4c97b7553644d62fe83a deleted and replaced by tablet 29d9a01abd314d0e9f60df4f6736985b
W20250115 10:12:03.063046 4476 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:12:03.063390 4575 tablet_bootstrap.cc:492] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.063441 4575 ts_tablet_manager.cc:1397] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.105s user 0.001s sys 0.000s
I20250115 10:12:03.063622 4575 raft_consensus.cc:357] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.063686 4575 raft_consensus.cc:383] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.063745 4575 raft_consensus.cc:738] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.063796 4575 consensus_queue.cc:260] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.063689 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 3c778d7be748405285068f36650902b0 (DEFAULT_TABLE table=default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.063951 4575 ts_tablet_manager.cc:1428] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:03.064006 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c778d7be748405285068f36650902b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.064051 4575 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.064450 4575 tablet_bootstrap.cc:654] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.066007 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (DEFAULT_TABLE table=default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.066164 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1465bcc80e40cdad4e0722eb0d74c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.066494 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.066778 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.066782 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 82c66363913e47399c4e1e8533bdadd0 (DEFAULT_TABLE table=default.Table_f1faf951819049d9aac897e67c029beb [id=86cef7da77da456089b46d9647ee7e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.066867 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c66363913e47399c4e1e8533bdadd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.066969 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.067142 4569 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.067179 4569 ts_tablet_manager.cc:1397] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20250115 10:12:03.067303 4569 raft_consensus.cc:357] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.067358 4569 raft_consensus.cc:383] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.067377 4569 raft_consensus.cc:738] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.067420 4569 consensus_queue.cc:260] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.067518 4569 ts_tablet_manager.cc:1428] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.067567 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (DEFAULT_TABLE table=default.Table_2648dfb12d924eda9b18368da8df24a5 [id=0298d09bab6149af8c9c418b3d064b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.067597 4569 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.067644 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f81769b500149f7b2bf7cdf76f7ee27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.068008 4569 tablet_bootstrap.cc:654] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.068485 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 497adb74fac84c1cb438ea6ba4adf211 (DEFAULT_TABLE table=default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.068565 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497adb74fac84c1cb438ea6ba4adf211. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.068661 3380 tablet_service.cc:1467] Processing CreateTablet for tablet bf882dcd84be4b38af533b64dfb4fd95 (DEFAULT_TABLE table=default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 [id=0041976377904d41939a1ea9a5fcc07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.068727 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf882dcd84be4b38af533b64dfb4fd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.069571 3380 tablet_service.cc:1467] Processing CreateTablet for tablet d73af05d7fd349b083eb74352a62a1fe (DEFAULT_TABLE table=default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.069635 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73af05d7fd349b083eb74352a62a1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.069679 3392 tablet_service.cc:1467] Processing CreateTablet for tablet bb4d112daca24c82931daf050edbd846 (DEFAULT_TABLE table=default.Table_2deceee1167f46b8aea6e6f3fa075cf7 [id=093d224f08744cf38ab4f22d0c0b6e97]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.069761 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4d112daca24c82931daf050edbd846. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.070503 3260 tablet_service.cc:1467] Processing CreateTablet for tablet afebbabd8d914cd0804a0c64830ef84e (DEFAULT_TABLE table=default.Table_41584cc62411410fbfa50fc897fa446a [id=6f19ad27a4ef4fe4b447cb2eea68d043]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.070562 3380 tablet_service.cc:1467] Processing CreateTablet for tablet e3dd43785e2541d8be54b6ca339a754d (DEFAULT_TABLE table=default.Table_ee808cbef43c429ba5a671726e74c5ac [id=2e12df36e70c48bdb039351c533e802a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.070611 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afebbabd8d914cd0804a0c64830ef84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.070647 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd43785e2541d8be54b6ca339a754d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.070943 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 6f611ee9e87048ca8bddaa6525bbd054 (DEFAULT_TABLE table=default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.071038 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f611ee9e87048ca8bddaa6525bbd054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.071599 3380 tablet_service.cc:1467] Processing CreateTablet for tablet d02e33022c3840c28623200adb56e3bc (DEFAULT_TABLE table=default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 [id=aeff809e211042a1b0bf7a57d8c754e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.071673 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02e33022c3840c28623200adb56e3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.071923 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 367694b5edf143ef81e99e348543659a (DEFAULT_TABLE table=default.Table_058d5ec95f2a468ab9d1edf25995bdd8 [id=a4e90033d1204cb8b8fbcf057528391c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.072005 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367694b5edf143ef81e99e348543659a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.072433 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 87d8167b34064888be6e4df4dfde0b31 (DEFAULT_TABLE table=default.Table_196ff2f45dc94ec58c60a08545468524 [id=588ca457130b479db3f999ed2f492120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.072515 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d8167b34064888be6e4df4dfde0b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.073253 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 98993cb75de34c0babb894a5d17d6d12 (DEFAULT_TABLE table=default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.073338 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98993cb75de34c0babb894a5d17d6d12. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.073606 3484 consensus_peers.cc:487] T 7352b551832b40039715e5bf18a31ffb P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7352b551832b40039715e5bf18a31ffb. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.073717 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 26351bbe70044075a99982bb380d86a0 (DEFAULT_TABLE table=default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.073799 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26351bbe70044075a99982bb380d86a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.074200 3770 raft_consensus.cc:491] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.074252 3770 raft_consensus.cc:513] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.074385 3770 leader_election.cc:290] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.074604 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.074692 3549 raft_consensus.cc:2463] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.074684 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.074738 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5 (DEFAULT_TABLE table=default.Table_37c905a6d3fe455882ef028a290d6588 [id=7f25a9ec0c1d4d2ab8e54772756694be]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.074769 3260 tablet_service.cc:1467] Processing CreateTablet for tablet cb9629071de44cf69621ae3b2fd4e762 (DEFAULT_TABLE table=default.Table_af49e808ad814664b3703d748315b8a4 [id=89304ed813b04d0682ad058ee2168202]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.074827 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.074839 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb9629071de44cf69621ae3b2fd4e762. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.074860 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.074870 3215 leader_election.cc:304] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.074934 3770 raft_consensus.cc:2798] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.074944 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d9a83c4de3849498be5c6e4f9c8b00c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.074961 3770 raft_consensus.cc:491] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.074983 3770 raft_consensus.cc:3054] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.075660 3770 raft_consensus.cc:513] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.075794 3770 leader_election.cc:290] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.075810 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 1385fb81dff24e709d5d45fb9d616369 (DEFAULT_TABLE table=default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf [id=23c0981b39e2410196a18d8842f329b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.075894 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1385fb81dff24e709d5d45fb9d616369. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.075953 3260 tablet_service.cc:1467] Processing CreateTablet for tablet f2230f6de9a54e98aa83435d37f68807 (DEFAULT_TABLE table=default.Table_ae474575b4144851ad889119f33259bd [id=da4f430e2a734e3a94a2b2517f52e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.076061 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.076114 3549 raft_consensus.cc:3054] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.076128 3214 leader_election.cc:343] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.076318 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:03.076471 3214 leader_election.cc:343] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.076586 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 0e23a070a8454f3b8bd1620ac4535a12 (DEFAULT_TABLE table=default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55 [id=25897e7460ce44ab84a870fcae962481]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.076690 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e23a070a8454f3b8bd1620ac4535a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.076939 3549 raft_consensus.cc:2463] T 2836a492586e489daafc2da719455f39 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.077098 3215 leader_election.cc:304] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.077183 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2230f6de9a54e98aa83435d37f68807. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.077248 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 06c5994686054f51802fb9125beb85c4 (DEFAULT_TABLE table=default.Table_1c5f565cf47e469aa8fda3d4022e032f [id=cca7bb92e53a40b793e4e8f5033401fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.077266 3770 raft_consensus.cc:2798] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.077314 3770 raft_consensus.cc:695] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.077334 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c5994686054f51802fb9125beb85c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.077354 3770 consensus_queue.cc:237] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.078696 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9 (DEFAULT_TABLE table=default.Table_2c791d1c1e86451a8080674fe68d383a [id=abfc4758ddad43c7aef0fd67d1ff5bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.078783 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (DEFAULT_TABLE table=default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.078783 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 63b83ca446824b88978e3dc3269d43a3 (DEFAULT_TABLE table=default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.078840 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.078872 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3402dc674ab0402f8e0bdd7b8db4b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.078909 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b83ca446824b88978e3dc3269d43a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.079618 3382 tablet_service.cc:1467] Processing CreateTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.079727 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8c99788dae6421b8b2dd4f40e2b63b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.079883 3385 tablet_service.cc:1467] Processing CreateTablet for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a (DEFAULT_TABLE table=default.Table_d59e20c98bd84db48c45d49171eff4fd [id=10b43b32ad174b12b4a2da8cceaaeac1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.079958 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bf4d0bb3c847d5bf0b0697f8334e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.080209 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.080350 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 359eb3a976bd409b8e2d4b72f0b2348c (DEFAULT_TABLE table=default.Table_f469479d54a445cc94bea2d511828e08 [id=83adf17cb14849c7839e7682093de0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.080428 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359eb3a976bd409b8e2d4b72f0b2348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.080711 3382 tablet_service.cc:1467] Processing CreateTablet for tablet 76499a085d9d4f74818684d3148a4866 (DEFAULT_TABLE table=default.Table_c1c600c53e0b472ea680a14709e39431 [id=a5a191eb03004d86863bb4390fad5543]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.080789 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76499a085d9d4f74818684d3148a4866. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.080914 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 707f0e47915e4a8998a97a8680394e5d (DEFAULT_TABLE table=default.Table_5b1fd5cfd1424151839bc16fb5c88670 [id=05b392915cd34cf9af16ae61741e53f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.080987 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707f0e47915e4a8998a97a8680394e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.081641 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 8a357badf1cd43e384d2de92e3413898 (DEFAULT_TABLE table=default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.081717 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a357badf1cd43e384d2de92e3413898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.081933 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 766ddeab54194401aeb942516e42dc84 (DEFAULT_TABLE table=default.Table_e762e9011d9f4fe1856dc4923700d779 [id=0ed50e4d34254318a993c3268808ce39]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.082023 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 766ddeab54194401aeb942516e42dc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.082401 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 (DEFAULT_TABLE table=default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.082485 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4f2e19e4443b38430cdb95bd82f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.083223 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 50d2f7ec7d44422ebc35e29797bfd456 (DEFAULT_TABLE table=default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.083304 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d2f7ec7d44422ebc35e29797bfd456. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.083704 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 63980fabd5634bf39c41215740cd4d72 (DEFAULT_TABLE table=default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.083837 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63980fabd5634bf39c41215740cd4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.083936 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6be683cdd24844eebaad0ed6a36be25f
I20250115 10:12:03.084025 4470 catalog_manager.cc:6596] ReplaceTablet: tablet 6be683cdd24844eebaad0ed6a36be25f deleted and replaced by tablet eb2fb9983c4f45f98291c411ba9ab748
I20250115 10:12:03.084125 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
W20250115 10:12:03.084291 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:03.084364 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c2d66bce975b44c4960bef247ac2c745"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.084456 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2d66bce975b44c4960bef247ac2c745 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.084633 4477 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_083c387389e741fa8d1c07011d4e7f5d" } modify_external_catalogs: true
I20250115 10:12:03.084681 4477 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_083c387389e741fa8d1c07011d4e7f5d" } modify_external_catalogs: true
I20250115 10:12:03.084867 3386 tablet_service.cc:1467] Processing CreateTablet for tablet a76df2d8b00c46949afac48a55d8200f (DEFAULT_TABLE table=default.Table_37e85cc42de44c9ea1e9d33a94d70be8 [id=1a36a0dbf9eb490ba53332a260571b48]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.084939 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a76df2d8b00c46949afac48a55d8200f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.084935 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a76df2d8b00c46949afac48a55d8200f consensus state has no leader
I20250115 10:12:03.085022 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4e44e0cd2af54f0585de9211108521c0" } modify_external_catalogs: true
I20250115 10:12:03.085078 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4e44e0cd2af54f0585de9211108521c0" } modify_external_catalogs: true
W20250115 10:12:03.085232 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4732608c02834f5891a70d4ec91b9e4b has no consensus state
I20250115 10:12:03.085287 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6051563ff45d4e82b8c874f88c8cdaa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.085354 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6051563ff45d4e82b8c874f88c8cdaa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.085510 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d17d3bf6b75c4f399d0d2532e8366ff1" } new_table_name: "default.Table_da72eec03bd048bab9fe6aefe065145c" modify_external_catalogs: true
I20250115 10:12:03.085774 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.085858 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57d3800d79794d3bad6c50d2dc8e9258. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.085865 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:03.085932 4473 catalog_manager.cc:6596] ReplaceTablet: tablet 65a0bd78c1e7409bb41392fd8f9a0862 deleted and replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d
I20250115 10:12:03.085997 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 3f9295765384410d9ee9380b4db88ed0 (DEFAULT_TABLE table=default.Table_ded364210b934ba3a4824b517b6db826 [id=268b8b77011f466abc17b7600aceadd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.085985 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f718abe0d8434e698daeb535c0be93c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.086067 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9295765384410d9ee9380b4db88ed0. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.086076 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f718abe0d8434e698daeb535c0be93c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:03.086213 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 353b2e8e545e44768ec77f0cd0caa6e6 consensus state has no leader
I20250115 10:12:03.086272 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_7dc37da2eb7d41798faead893c7953b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.086344 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7dc37da2eb7d41798faead893c7953b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.086742 4469 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7568c1ece38940aca3b40c2fc57908ee" } modify_external_catalogs: true
I20250115 10:12:03.086793 4469 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7568c1ece38940aca3b40c2fc57908ee" } modify_external_catalogs: true
I20250115 10:12:03.086925 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d190044d103e441193e224c667108543
I20250115 10:12:03.086967 4475 catalog_manager.cc:6596] ReplaceTablet: tablet d190044d103e441193e224c667108543 deleted and replaced by tablet 6a285009787f4acb810a1829ca37a845
I20250115 10:12:03.087002 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b" } modify_external_catalogs: true
I20250115 10:12:03.087039 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b" } modify_external_catalogs: true
I20250115 10:12:03.087016 3379 tablet_service.cc:1467] Processing CreateTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 (DEFAULT_TABLE table=default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.087103 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3326a9a37a64e9a9485e5abadc2e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.087189 4476 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a20c21609d3f41ec98698a4bc198dcf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.087244 4476 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a20c21609d3f41ec98698a4bc198dcf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.087905 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 77b422773c3346199383ca64330719c6 (DEFAULT_TABLE table=default.Table_f04269f5ae13474e959f42bee487f199 [id=195139f257d2494791df1002a43aee3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.088078 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b422773c3346199383ca64330719c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.088145 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 3067eaaa090b4ffb95b2e741453113ed (DEFAULT_TABLE table=default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.088263 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3067eaaa090b4ffb95b2e741453113ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.066047 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 709a9b0953dd4b108825b663d703e609 (DEFAULT_TABLE table=default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.088914 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709a9b0953dd4b108825b663d703e609. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.089547 3259 tablet_service.cc:1467] Processing CreateTablet for tablet cd8c55fd071d42b880becb81e6f70f27 (DEFAULT_TABLE table=default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb [id=8afca2ed08bc4ea392257397837f8db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.089666 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8c55fd071d42b880becb81e6f70f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.090057 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 0496864e655e40dfac38619adbf4fd87 (DEFAULT_TABLE table=default.Table_00c57a31372740fe9620a054ec21d16e [id=5da2380bb07b43758f04bbd828525b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.090143 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496864e655e40dfac38619adbf4fd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.090893 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.091046 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e78a8b61e142199ba7bf73e3879b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.091238 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab (DEFAULT_TABLE table=default.Table_1069ce4193974a938cb848fe3f45dfd0 [id=ee5989ff607243e38ee167a4d318eaaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.091336 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b19ae7373c4de688ae30eb7e1d9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.091850 4433 raft_consensus.cc:491] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.091905 4433 raft_consensus.cc:513] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.092025 4433 leader_election.cc:290] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.092185 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4af01517cb04be983456a98153f6146" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.092259 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:03.092331 3484 leader_election.cc:343] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.092461 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.092526 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4af01517cb04be983456a98153f6146" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.092756 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.092877 3388 tablet_service.cc:1467] Processing CreateTablet for tablet cb8ecc0818304f5e9522bba63a4aca4d (DEFAULT_TABLE table=default.Table_dbaca6558a074caa8671547657908e94 [id=4c4374e6c65149d087e5507ced04d9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.092998 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8ecc0818304f5e9522bba63a4aca4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.093024 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet d190044d103e441193e224c667108543 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a285009787f4acb810a1829ca37a845) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:03.093088 3485 leader_election.cc:343] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.093122 3485 leader_election.cc:304] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.093200 4433 raft_consensus.cc:2743] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.093765 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 8600883e5a5449c59a747a6ef2121c61 (DEFAULT_TABLE table=default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.093966 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb (DEFAULT_TABLE table=default.Table_36a2b6b01e684edb9cd4c0f11317ea56 [id=7e11745e5dd243d69cb4463cc11edf26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.094312 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616166bc9d5d4651999b1d2e0a1851bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.094432 3386 tablet_service.cc:1467] Processing CreateTablet for tablet ce8455d282d34bbe9822a00a28d4c3ec (DEFAULT_TABLE table=default.Table_659f850eaa924b75a860677bd9ea33f7 [id=2e0b0b4cbc9f4f678d7db889c9be970c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.094502 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8600883e5a5449c59a747a6ef2121c61. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.094691 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9d422fdac347ff85eca778c29858e8 (DEFAULT_TABLE table=default.Table_25fd90e569f543a08c37804c5c95dd31 [id=93f0f05ce5b44db1949a47c0d0bab532]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.094760 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9d422fdac347ff85eca778c29858e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.095131 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 6435fd1953d440c8b4d9745a5dcd15f6 (DEFAULT_TABLE table=default.Table_79af526c42b24e2f8ae1da15d106cbe9 [id=22fbb91517214bfeb4c6d732904ac18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.095225 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6435fd1953d440c8b4d9745a5dcd15f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.096033 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 0d5cf0e380d348f1ae2f05db1a010a19 (DEFAULT_TABLE table=default.Table_b3d35645a38345699f01877647f097be [id=7ffb156709624e9bace6cb13a4d83007]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.096112 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5cf0e380d348f1ae2f05db1a010a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.096378 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 14f3aea0cf684f749027f817eb3b13b7 (DEFAULT_TABLE table=default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.096441 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f3aea0cf684f749027f817eb3b13b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.096607 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 3fecca0f91e04702b438c9639303fac2 (DEFAULT_TABLE table=default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.096750 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fecca0f91e04702b438c9639303fac2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.097359 3260 tablet_service.cc:1467] Processing CreateTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.097404 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 12379200d11e4ed3800f609d34a54ea7 (DEFAULT_TABLE table=default.Table_c09214a5f550425b928dcb0caf8ab823 [id=694250c24a29434a8486d3679391c59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.097434 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc395ae76a494a8eb682b7ef34dcb169. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.097468 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12379200d11e4ed3800f609d34a54ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.098623 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 424956b90563455d8140a49fcaa05206 (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.081918 3382 tablet_service.cc:1467] Processing CreateTablet for tablet b1b423922cbb4a42bbdb4de025227118 (DEFAULT_TABLE table=default.Table_d17d3bf6b75c4f399d0d2532e8366ff1 [id=1877c975a9fb4a2db7df19a0938f7070]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.098834 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6244234f7447debe9cdce30e4919b6 (DEFAULT_TABLE table=default.Table_917623c2758441459e6b366741de339e [id=b46be727cbca46aab34220b80239d39a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.099273 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6244234f7447debe9cdce30e4919b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.098986 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 46b8efd1622a4efcb009f999cb915dfc (DEFAULT_TABLE table=default.Table_4e44e0cd2af54f0585de9211108521c0 [id=4a0764b4a46f4278973b2c7b7a1cf35f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.099838 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b8efd1622a4efcb009f999cb915dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.100941 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 8dde69ff2f574d838d81bea5a53700f5 (DEFAULT_TABLE table=default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.101107 3379 tablet_service.cc:1467] Processing CreateTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.099159 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 14cea13b41bd47faafe774471c4163dc (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.101541 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cea13b41bd47faafe774471c4163dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.101836 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 0922008e726c4e53b00b287261a2f0a3 (DEFAULT_TABLE table=default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.102208 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 368df29ba175447ba4c009c7eb15a49d (DEFAULT_TABLE table=default.Table_746d39dd624c4988b0521a7a6af0e896 [id=5e846a21e7a54dcda298097ce402c196]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.102660 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac231c1b8e04e8788f7bc368a87acdb (DEFAULT_TABLE table=default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.102937 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2 (DEFAULT_TABLE table=default.Table_79f48757c279457faeca60d711a7d129 [id=96c9813386964880ad745a3cd4d857e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.103026 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.103277 3395 tablet_service.cc:1467] Processing CreateTablet for tablet 4c49b39058164387990c4f6dc170785e (DEFAULT_TABLE table=default.Table_8e300c7e8c904d15beed4cf90ef8fdc1 [id=8d38c2511ddc4940b470805a54f8b1c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.103543 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.104081 3381 tablet_service.cc:1467] Processing CreateTablet for tablet a076172bba8e4878978c318d441577bd (DEFAULT_TABLE table=default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.104099 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424956b90563455d8140a49fcaa05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.104635 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 14a9663596174aa1b72ce71e49183a2b (DEFAULT_TABLE table=default.Table_202be7fd65b14cb88442d558eb06fed9 [id=ca363805a72c4ed6af847c3a1b61803e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.105067 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8455d282d34bbe9822a00a28d4c3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.105162 3253 tablet_service.cc:1467] Processing CreateTablet for tablet b114b291fd734797bd6622d89e309925 (DEFAULT_TABLE table=default.Table_f98e93dc1edf457d8b10bd2882677285 [id=a49d7416b0c84365bc92418b8d448a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.105261 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114b291fd734797bd6622d89e309925. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.106127 3386 tablet_service.cc:1467] Processing CreateTablet for tablet ca2e043501b04096b648d179a13e8653 (DEFAULT_TABLE table=default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.106217 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2e043501b04096b648d179a13e8653. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.106320 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 60cc9a1b2c4348ada0d8dab958aded09 (DEFAULT_TABLE table=default.Table_547a65dbda1749c082cfb2aa9f2a2285 [id=f93e7218dc4947b5bc778789c1be1480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.106405 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cc9a1b2c4348ada0d8dab958aded09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.107182 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 98e5519e80144b7582d76b7f9d8d6ffa (DEFAULT_TABLE table=default.Table_b5612228d70d4480ad349647f31a97fc [id=7c32f09490d24567885955928d4e3d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.107275 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e5519e80144b7582d76b7f9d8d6ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.107436 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.107522 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff85958d3c46069b1dd9bf5cb75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.108572 3253 tablet_service.cc:1467] Processing CreateTablet for tablet ef7f182c4bde468d919523c44fdf3ea4 (DEFAULT_TABLE table=default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.108747 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f182c4bde468d919523c44fdf3ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.109925 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 4a0811cad8454c2e871aad2101224f34 (DEFAULT_TABLE table=default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.110074 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0811cad8454c2e871aad2101224f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.111122 3260 tablet_service.cc:1467] Processing CreateTablet for tablet c85d63cc502f418b91aec39245c707b9 (DEFAULT_TABLE table=default.Table_837ed67810f741a2bfe30f928f9d978c [id=94b2e5bbafba4dd986b674d0041216e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.111245 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d63cc502f418b91aec39245c707b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.111313 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 817a8a975fea4da9a994e78f86da961f (DEFAULT_TABLE table=default.Table_a3b73807076c4f0aabf9e6f82eca2bef [id=791960255cad40b1814de43ae15c9ee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.111392 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817a8a975fea4da9a994e78f86da961f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.112318 3376 tablet_service.cc:1467] Processing CreateTablet for tablet a7e2086241df4b4fac5e481c5e8295a9 (DEFAULT_TABLE table=default.Table_7b236b5787d24e138bfad3c30003b316 [id=0b1b8cdb67244dc19aed82671327d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.112402 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e2086241df4b4fac5e481c5e8295a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.112568 3260 tablet_service.cc:1467] Processing CreateTablet for tablet c94cb50778e44890bd8c4bdc868673e3 (DEFAULT_TABLE table=default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 [id=988e12ca3c094601a1189d8558614dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.112707 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94cb50778e44890bd8c4bdc868673e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.113459 3376 tablet_service.cc:1467] Processing CreateTablet for tablet fcf567628009460dbb7bfa582f69b4f1 (DEFAULT_TABLE table=default.Table_1b401a0e880a4244a7a60cde99fe7a62 [id=b657ebccf5124395b20e91032a0f1cd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.113548 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf567628009460dbb7bfa582f69b4f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.113930 3260 tablet_service.cc:1467] Processing CreateTablet for tablet a577ace8245744d1a42938ddd99ce89b (DEFAULT_TABLE table=default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.114145 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a577ace8245744d1a42938ddd99ce89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.114547 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 5778f29ace314ea18b42afd0b7c1642b (DEFAULT_TABLE table=default.Table_403c08da944445838245a588777ef636 [id=833c3f479c5b49b4978b5d508bb1d101]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.114635 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5778f29ace314ea18b42afd0b7c1642b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.115460 3260 tablet_service.cc:1467] Processing CreateTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 (DEFAULT_TABLE table=default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.115595 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6cdec27e9941ed9b485228f93b4d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.116676 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet c64affc7645145069d6197ede241585e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.116856 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 54d9aaaa37d540cab41de4a083b36917 (DEFAULT_TABLE table=default.Table_d0fcc51d02e64d42831f872a5b3b02ee [id=965a2b7a6e3241afac6499010b596aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.116967 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9aaaa37d540cab41de4a083b36917. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.117894 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (DEFAULT_TABLE table=default.Table_681746e4aa1447c2a068ff6e85d9b022 [id=59ace488897c42a3a28b6118667f6403]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.118042 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353b2e8e545e44768ec77f0cd0caa6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.119659 3389 tablet_service.cc:1467] Processing CreateTablet for tablet afebbabd8d914cd0804a0c64830ef84e (DEFAULT_TABLE table=default.Table_41584cc62411410fbfa50fc897fa446a [id=6f19ad27a4ef4fe4b447cb2eea68d043]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.120402 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 497adb74fac84c1cb438ea6ba4adf211 (DEFAULT_TABLE table=default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.020958 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 6de4d57d53c648b491f66f257414394d (DEFAULT_TABLE table=default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.120630 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de4d57d53c648b491f66f257414394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.121104 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.121294 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 2d30f49da63241a2a794a7a18e026473 (DEFAULT_TABLE table=default.Table_3aae7f2489e6423f8c2da3c5ae753cdf [id=a5da5f258250489a9d39ce2b87fc1a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.121405 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d30f49da63241a2a794a7a18e026473. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.122445 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 5fac40fff8de4004858af6e2ae986d46 (DEFAULT_TABLE table=default.Table_0bfecbf8f6db434c853e2fc9024e5c2d [id=69843267a5254af281348136b8df9daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.122592 3386 tablet_service.cc:1467] Processing CreateTablet for tablet aef601e6f3ef4ba387164c239c1139b0 (DEFAULT_TABLE table=default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.122825 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 2e55b7e2b95b4eb895da942829c4556f (DEFAULT_TABLE table=default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.123674 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 347621ded3fd4380b1502d1a8c5b0c4a (DEFAULT_TABLE table=default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.020406 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 2e55b7e2b95b4eb895da942829c4556f (DEFAULT_TABLE table=default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.122669 3241 tablet_service.cc:1467] Processing CreateTablet for tablet fd76846bc164480d9b77aa3d096260cb (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.123842 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0922008e726c4e53b00b287261a2f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124011 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac231c1b8e04e8788f7bc368a87acdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.122964 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6ec9020494019a32cfb428554bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124132 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a076172bba8e4878978c318d441577bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.123863 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6baabd5aba4363ae13e5da601a9de8 (DEFAULT_TABLE table=default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.124228 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd76846bc164480d9b77aa3d096260cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124228 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7c1c0ac4d3487187907a49343381c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124342 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7e96ba921d4fbb96afbbf8c5f354f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124444 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49b39058164387990c4f6dc170785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124531 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368df29ba175447ba4c009c7eb15a49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124619 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dde69ff2f574d838d81bea5a53700f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124697 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b423922cbb4a42bbdb4de025227118. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.124786 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a9663596174aa1b72ce71e49183a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.125037 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afebbabd8d914cd0804a0c64830ef84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.125218 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef601e6f3ef4ba387164c239c1139b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.125305 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e55b7e2b95b4eb895da942829c4556f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.125591 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e55b7e2b95b4eb895da942829c4556f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.126405 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 8c045349a48644eda41ea8965b16174d (DEFAULT_TABLE table=default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.126510 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c045349a48644eda41ea8965b16174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.126782 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 0e033d609eef46a792b1a568ec2936de (DEFAULT_TABLE table=default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.126870 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e033d609eef46a792b1a568ec2936de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.127668 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 6de4d57d53c648b491f66f257414394d (DEFAULT_TABLE table=default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.128506 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fac40fff8de4004858af6e2ae986d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.128666 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de4d57d53c648b491f66f257414394d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.128860 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 359eb3a976bd409b8e2d4b72f0b2348c (DEFAULT_TABLE table=default.Table_f469479d54a445cc94bea2d511828e08 [id=83adf17cb14849c7839e7682093de0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.128947 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359eb3a976bd409b8e2d4b72f0b2348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.129750 3390 tablet_service.cc:1467] Processing CreateTablet for tablet f8114f64577245c2b3ce70e4399de0c8 (DEFAULT_TABLE table=default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.129841 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8114f64577245c2b3ce70e4399de0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.129767 4470 catalog_manager.cc:5526] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.129868 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (DEFAULT_TABLE table=default.Table_681746e4aa1447c2a068ff6e85d9b022 [id=59ace488897c42a3a28b6118667f6403]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.129936 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353b2e8e545e44768ec77f0cd0caa6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.130064 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f682c7942a454d86a5df19eeac533361
W20250115 10:12:03.130210 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:12:03.130275 4477 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f04269f5ae13474e959f42bee487f199" } modify_external_catalogs: true
I20250115 10:12:03.130318 4477 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f04269f5ae13474e959f42bee487f199" } modify_external_catalogs: true
I20250115 10:12:03.130494 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 46b8efd1622a4efcb009f999cb915dfc
I20250115 10:12:03.130573 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_096e55501304403f8fa1bf3e935b33a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.130654 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_096e55501304403f8fa1bf3e935b33a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.130817 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a6400bf1de024af4b73446837abbe6c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.130841 3390 tablet_service.cc:1467] Processing CreateTablet for tablet f4cee0b04c6e4eb39dd22668aacb2801 (DEFAULT_TABLE table=default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:03.130897 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6400bf1de024af4b73446837abbe6c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.130970 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4cee0b04c6e4eb39dd22668aacb2801. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.131028 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b1b423922cbb4a42bbdb4de025227118 consensus state has no leader
I20250115 10:12:03.131189 4469 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3b89df9f987e46ae98fe21df847cb311
I20250115 10:12:03.131266 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 8c045349a48644eda41ea8965b16174d
I20250115 10:12:03.131439 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6baabd5aba4363ae13e5da601a9de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.128451 3388 tablet_service.cc:1467] Processing CreateTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 (DEFAULT_TABLE table=default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:03.131932 4476 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:12:03.132215 3385 tablet_service.cc:1467] Processing CreateTablet for tablet b110fe6c13204cf295abb29839f3380b (DEFAULT_TABLE table=default.Table_7cc7f5b2700343b7b48aae25a2f75b37 [id=2d9f80bd6fda4b22af4bb90503c90a4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.133316 3253 tablet_service.cc:1467] Processing CreateTablet for tablet 5778f29ace314ea18b42afd0b7c1642b (DEFAULT_TABLE table=default.Table_403c08da944445838245a588777ef636 [id=833c3f479c5b49b4978b5d508bb1d101]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.133316 3394 tablet_service.cc:1467] Processing CreateTablet for tablet ded005e366d4460f9acbcbb7b75397ef (DEFAULT_TABLE table=default.Table_a883df24d37b447baa84acc5f6c62d45 [id=721c4375c79a45feb26f677535de05c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.133405 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ded005e366d4460f9acbcbb7b75397ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.133505 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5778f29ace314ea18b42afd0b7c1642b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.134362 3394 tablet_service.cc:1467] Processing CreateTablet for tablet a577ace8245744d1a42938ddd99ce89b (DEFAULT_TABLE table=default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.134449 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a577ace8245744d1a42938ddd99ce89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.135396 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 9077d0eed1974bc898370b5d5554be71 (DEFAULT_TABLE table=default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.135387 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 5403eb7ca3b74d6e8110f97c17e1aa67 (DEFAULT_TABLE table=default.Table_fa2f46d367594fc2b0076ad6db01dee7 [id=af57231131444910ada6130cbbfdada5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.135478 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077d0eed1974bc898370b5d5554be71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.135609 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5403eb7ca3b74d6e8110f97c17e1aa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.136786 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 0d5cf0e380d348f1ae2f05db1a010a19 (DEFAULT_TABLE table=default.Table_b3d35645a38345699f01877647f097be [id=7ffb156709624e9bace6cb13a4d83007]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.136873 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5cf0e380d348f1ae2f05db1a010a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.136963 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 1650bac5bd96467fb3d586b23ebd77be (DEFAULT_TABLE table=default.Table_ca7bc6e893be4465b1582ee64173500c [id=a1b3933dfb524284b565d94d1e849821]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.137089 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650bac5bd96467fb3d586b23ebd77be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.137904 3392 tablet_service.cc:1467] Processing CreateTablet for tablet ac8b3c397070467196b73dedcacf22de (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.137995 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8b3c397070467196b73dedcacf22de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.138175 3246 tablet_service.cc:1467] Processing CreateTablet for tablet f8114f64577245c2b3ce70e4399de0c8 (DEFAULT_TABLE table=default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.138315 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8114f64577245c2b3ce70e4399de0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.138984 3392 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9d422fdac347ff85eca778c29858e8 (DEFAULT_TABLE table=default.Table_25fd90e569f543a08c37804c5c95dd31 [id=93f0f05ce5b44db1949a47c0d0bab532]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.139086 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9d422fdac347ff85eca778c29858e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.139860 3241 tablet_service.cc:1467] Processing CreateTablet for tablet cb353ea066dc474cac07e3adcfa6574d (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.139984 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb353ea066dc474cac07e3adcfa6574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.140830 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e (DEFAULT_TABLE table=default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.140919 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4283a096b18b4be69e1f57e60c3efd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.141206 3241 tablet_service.cc:1467] Processing CreateTablet for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (DEFAULT_TABLE table=default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.141330 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36e39d9f1c4cecbd0f6679b0397e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.141906 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 5f37b29ba1cb4a0289268ba1241527b8 (DEFAULT_TABLE table=default.Table_f448ab1cfae2403393f3884d0a50fd61 [id=2cd4c5e9ab1f4e018b47117186f14066]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.141997 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f37b29ba1cb4a0289268ba1241527b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.142648 3241 tablet_service.cc:1467] Processing CreateTablet for tablet f96f4c52a2124c05b0e124a89eacaa71 (DEFAULT_TABLE table=default.Table_583dc203fd4940dfb099846022f31e33 [id=c4035a1a23384ac9b0e51f8642f497de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.142784 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96f4c52a2124c05b0e124a89eacaa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.142984 3381 tablet_service.cc:1467] Processing CreateTablet for tablet b9c28bb9d70940a59449ad5afb4a6313 (DEFAULT_TABLE table=default.Table_109864ef03f142b0be396620ae7e15b2 [id=70979ea2e90c4564947e7bfcf4d59e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.143074 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c28bb9d70940a59449ad5afb4a6313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.144359 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 3552b8e936ad4aeba0eadc95577f5414 (DEFAULT_TABLE table=default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.144497 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552b8e936ad4aeba0eadc95577f5414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.144949 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 5403eb7ca3b74d6e8110f97c17e1aa67 (DEFAULT_TABLE table=default.Table_fa2f46d367594fc2b0076ad6db01dee7 [id=af57231131444910ada6130cbbfdada5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.145041 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5403eb7ca3b74d6e8110f97c17e1aa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.145869 3244 tablet_service.cc:1467] Processing CreateTablet for tablet ee6597804e5c41618870133c9d4ad1b3 (DEFAULT_TABLE table=default.Table_8b2bd680dfb44952a854b89bf65a2aa9 [id=c7b15c3adc96499b9b60ad4bd58cc3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.145958 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6597804e5c41618870133c9d4ad1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.146099 3383 tablet_service.cc:1467] Processing CreateTablet for tablet c68f61c8b72b4628bba5c52f8025a240 (DEFAULT_TABLE table=default.Table_5c52b5a64d154706af4220cc2f273a98 [id=75a3cabc6ab0415992e902b02ea54d47]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.146165 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c68f61c8b72b4628bba5c52f8025a240. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.147042 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 424956b90563455d8140a49fcaa05206 (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.147123 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424956b90563455d8140a49fcaa05206. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.147425 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe929017262442094800c874183f5de (DEFAULT_TABLE table=default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.147516 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe929017262442094800c874183f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.148707 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 0a612decf0634bd588f45c8953c6b201 (DEFAULT_TABLE table=default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.148792 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a612decf0634bd588f45c8953c6b201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.148926 3379 tablet_service.cc:1467] Processing CreateTablet for tablet c94cb50778e44890bd8c4bdc868673e3 (DEFAULT_TABLE table=default.Table_f01ac3f0973a4af1be9dbb48e5f7af90 [id=988e12ca3c094601a1189d8558614dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.148998 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94cb50778e44890bd8c4bdc868673e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.149977 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 4d31f180a3fc499fbd505c986593a7f5 (DEFAULT_TABLE table=default.Table_eb4ead8621074161aaa1f06e5ed31482 [id=270edc3310cd4a09aaa6f46e4f889188]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.150070 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d31f180a3fc499fbd505c986593a7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.150091 3379 tablet_service.cc:1467] Processing CreateTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 (DEFAULT_TABLE table=default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.150157 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6cdec27e9941ed9b485228f93b4d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.151031 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 5fac40fff8de4004858af6e2ae986d46 (DEFAULT_TABLE table=default.Table_0bfecbf8f6db434c853e2fc9024e5c2d [id=69843267a5254af281348136b8df9daa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.151120 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fac40fff8de4004858af6e2ae986d46. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.151276 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 17837499b096462394d993f39efce677 (DEFAULT_TABLE table=default.Table_5cde3d62bc8248f3be5fa8764025bbe0 [id=9871ed3c25464e07acb51a093f7c15d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.151398 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17837499b096462394d993f39efce677. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.152514 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 (DEFAULT_TABLE table=default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.152635 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f1a39f8a54c4cb21cd17d562c0542. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.152987 3395 tablet_service.cc:1467] Processing CreateTablet for tablet 0a612decf0634bd588f45c8953c6b201 (DEFAULT_TABLE table=default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.153074 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a612decf0634bd588f45c8953c6b201. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.153862 3252 tablet_service.cc:1467] Processing CreateTablet for tablet b9c28bb9d70940a59449ad5afb4a6313 (DEFAULT_TABLE table=default.Table_109864ef03f142b0be396620ae7e15b2 [id=70979ea2e90c4564947e7bfcf4d59e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.153995 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c28bb9d70940a59449ad5afb4a6313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.154331 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 14cea13b41bd47faafe774471c4163dc (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.154419 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14cea13b41bd47faafe774471c4163dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.155376 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a (DEFAULT_TABLE table=default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.155469 3384 tablet_service.cc:1467] Processing CreateTablet for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (DEFAULT_TABLE table=default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.155551 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa36e39d9f1c4cecbd0f6679b0397e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.156229 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab498e7789d4ae18a9f62be2fa2514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.156800 3395 tablet_service.cc:1467] Processing CreateTablet for tablet 46b8efd1622a4efcb009f999cb915dfc (DEFAULT_TABLE table=default.Table_4e44e0cd2af54f0585de9211108521c0 [id=4a0764b4a46f4278973b2c7b7a1cf35f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.156896 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b8efd1622a4efcb009f999cb915dfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.156129 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet f682c7942a454d86a5df19eeac533361 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.157914 3395 tablet_service.cc:1467] Processing CreateTablet for tablet ee6597804e5c41618870133c9d4ad1b3 (DEFAULT_TABLE table=default.Table_8b2bd680dfb44952a854b89bf65a2aa9 [id=c7b15c3adc96499b9b60ad4bd58cc3b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.158005 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee6597804e5c41618870133c9d4ad1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.157938 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b8efd1622a4efcb009f999cb915dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.158391 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.158695 3253 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c045349a48644eda41ea8965b16174d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.159072 3395 tablet_service.cc:1467] Processing CreateTablet for tablet b7a6ec9020494019a32cfb428554bd07 (DEFAULT_TABLE table=default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.159150 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6ec9020494019a32cfb428554bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.160611 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 98993cb75de34c0babb894a5d17d6d12 (DEFAULT_TABLE table=default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.160704 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98993cb75de34c0babb894a5d17d6d12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.161732 3384 tablet_service.cc:1467] Processing CreateTablet for tablet cd8c55fd071d42b880becb81e6f70f27 (DEFAULT_TABLE table=default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb [id=8afca2ed08bc4ea392257397837f8db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.161816 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8c55fd071d42b880becb81e6f70f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.162771 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:03.162796 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.162868 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00e78a8b61e142199ba7bf73e3879b98. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.163790 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
I20250115 10:12:03.164356 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b422773c3346199383ca64330719c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.164507 3246 tablet_service.cc:1467] Processing CreateTablet for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e (DEFAULT_TABLE table=default.Table_5c001d1a075b4563ad22475f486ee7a2 [id=b6eea97a6c9c486098f3e23f4a342cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.164636 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.164901 3377 tablet_service.cc:1467] Processing CreateTablet for tablet f682c7942a454d86a5df19eeac533361 (DEFAULT_TABLE table=default.Table_083c387389e741fa8d1c07011d4e7f5d [id=940ec8ab0c8a48be99dbb34e0ef6d263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.165035 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f682c7942a454d86a5df19eeac533361. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.165048 3382 tablet_service.cc:1467] Processing CreateTablet for tablet 2d30f49da63241a2a794a7a18e026473 (DEFAULT_TABLE table=default.Table_3aae7f2489e6423f8c2da3c5ae753cdf [id=a5da5f258250489a9d39ce2b87fc1a86]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.165267 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d30f49da63241a2a794a7a18e026473. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.166253 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 8a357badf1cd43e384d2de92e3413898 (DEFAULT_TABLE table=default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.166337 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a357badf1cd43e384d2de92e3413898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.166431 3382 tablet_service.cc:1467] Processing CreateTablet for tablet cb353ea066dc474cac07e3adcfa6574d (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.166533 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb353ea066dc474cac07e3adcfa6574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.166906 3252 tablet_service.cc:1467] Processing CreateTablet for tablet e178610c1a394217b152082dfd6bb8d0 (DEFAULT_TABLE table=default.Table_d526916fb923487d905f4408bfac2c6c [id=b4307531291f4c738bd60ef5de92874a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.166996 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e178610c1a394217b152082dfd6bb8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.167356 3377 tablet_service.cc:1467] Processing CreateTablet for tablet b114b291fd734797bd6622d89e309925 (DEFAULT_TABLE table=default.Table_f98e93dc1edf457d8b10bd2882677285 [id=a49d7416b0c84365bc92418b8d448a65]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.167433 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114b291fd734797bd6622d89e309925. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.167697 3382 tablet_service.cc:1467] Processing CreateTablet for tablet c77afc007fac49848786aaecd4d1e214 (DEFAULT_TABLE table=default.Table_780d6792486f4d65bb71098c78eec010 [id=65d6de2c925e407094df78186e79ddf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.169512 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77afc007fac49848786aaecd4d1e214. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.169546 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:12:03.169546 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 3067eaaa090b4ffb95b2e741453113ed (DEFAULT_TABLE table=default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.170217 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3067eaaa090b4ffb95b2e741453113ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.168236 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 3552b8e936ad4aeba0eadc95577f5414 (DEFAULT_TABLE table=default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.170670 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3552b8e936ad4aeba0eadc95577f5414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.171411 3383 tablet_service.cc:1467] Processing CreateTablet for tablet e178610c1a394217b152082dfd6bb8d0 (DEFAULT_TABLE table=default.Table_d526916fb923487d905f4408bfac2c6c [id=b4307531291f4c738bd60ef5de92874a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.171537 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e178610c1a394217b152082dfd6bb8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.168996 3392 tablet_service.cc:1467] Processing CreateTablet for tablet c85d63cc502f418b91aec39245c707b9 (DEFAULT_TABLE table=default.Table_837ed67810f741a2bfe30f928f9d978c [id=94b2e5bbafba4dd986b674d0041216e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.169095 3393 tablet_service.cc:1467] Processing CreateTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.171955 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c85d63cc502f418b91aec39245c707b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.172116 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc395ae76a494a8eb682b7ef34dcb169. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.173095 3392 tablet_service.cc:1467] Processing CreateTablet for tablet f2230f6de9a54e98aa83435d37f68807 (DEFAULT_TABLE table=default.Table_ae474575b4144851ad889119f33259bd [id=da4f430e2a734e3a94a2b2517f52e805]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.173230 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 347621ded3fd4380b1502d1a8c5b0c4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.174362 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.174458 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cff85958d3c46069b1dd9bf5cb75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.174957 3214 consensus_peers.cc:487] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af. This is attempt 6: this message will repeat every 5th retry.
I20250115 10:12:03.175228 3393 tablet_service.cc:1467] Processing CreateTablet for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e (DEFAULT_TABLE table=default.Table_5c001d1a075b4563ad22475f486ee7a2 [id=b6eea97a6c9c486098f3e23f4a342cd5]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:03.175580 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:03.175837 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.176486 3382 tablet_service.cc:1514] Processing DeleteTablet for tablet f682c7942a454d86a5df19eeac533361 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.176925 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.177026 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.177000 3382 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b8efd1622a4efcb009f999cb915dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.177302 3382 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c045349a48644eda41ea8965b16174d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.180578 3382 tablet_service.cc:1467] Processing CreateTablet for tablet d200e7e299214ab8aad3a42a4d513da5 (DEFAULT_TABLE table=default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.180676 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d200e7e299214ab8aad3a42a4d513da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.181694 3382 tablet_service.cc:1467] Processing CreateTablet for tablet fd76846bc164480d9b77aa3d096260cb (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.181787 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd76846bc164480d9b77aa3d096260cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.182804 3382 tablet_service.cc:1467] Processing CreateTablet for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9 (DEFAULT_TABLE table=default.Table_2c791d1c1e86451a8080674fe68d383a [id=abfc4758ddad43c7aef0fd67d1ff5bbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.182898 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967b15f8b6a4587bd56a2dfd68b9fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.183858 3379 tablet_service.cc:1467] Processing CreateTablet for tablet bfe0522e3e664012a00ec78a09c2816c (DEFAULT_TABLE table=default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.183952 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfe0522e3e664012a00ec78a09c2816c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.184947 3379 tablet_service.cc:1467] Processing CreateTablet for tablet ef7f182c4bde468d919523c44fdf3ea4 (DEFAULT_TABLE table=default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.185068 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7f182c4bde468d919523c44fdf3ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.186167 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 63b83ca446824b88978e3dc3269d43a3 (DEFAULT_TABLE table=default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.186295 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b83ca446824b88978e3dc3269d43a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.187394 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2 (DEFAULT_TABLE table=default.Table_79f48757c279457faeca60d711a7d129 [id=96c9813386964880ad745a3cd4d857e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.187531 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ec19ae50a374ef3a5e7b00cfcadeee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.188834 3379 tablet_service.cc:1467] Processing CreateTablet for tablet 7f6244234f7447debe9cdce30e4919b6 (DEFAULT_TABLE table=default.Table_917623c2758441459e6b366741de339e [id=b46be727cbca46aab34220b80239d39a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.189848 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 (DEFAULT_TABLE table=default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.192230 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f1a39f8a54c4cb21cd17d562c0542. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.193372 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 60cc9a1b2c4348ada0d8dab958aded09 (DEFAULT_TABLE table=default.Table_547a65dbda1749c082cfb2aa9f2a2285 [id=f93e7218dc4947b5bc778789c1be1480]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.193488 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60cc9a1b2c4348ada0d8dab958aded09. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.194537 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe929017262442094800c874183f5de (DEFAULT_TABLE table=default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.194666 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fe929017262442094800c874183f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.195673 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 54d9aaaa37d540cab41de4a083b36917 (DEFAULT_TABLE table=default.Table_d0fcc51d02e64d42831f872a5b3b02ee [id=965a2b7a6e3241afac6499010b596aa5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.189950 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b422773c3346199383ca64330719c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.196038 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 4d31f180a3fc499fbd505c986593a7f5 (DEFAULT_TABLE table=default.Table_eb4ead8621074161aaa1f06e5ed31482 [id=270edc3310cd4a09aaa6f46e4f889188]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.196230 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d31f180a3fc499fbd505c986593a7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.197453 3381 tablet_service.cc:1467] Processing CreateTablet for tablet f96f4c52a2124c05b0e124a89eacaa71 (DEFAULT_TABLE table=default.Table_583dc203fd4940dfb099846022f31e33 [id=c4035a1a23384ac9b0e51f8642f497de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.197571 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96f4c52a2124c05b0e124a89eacaa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.198565 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.198675 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet d190044d103e441193e224c667108543 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a285009787f4acb810a1829ca37a845) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.198751 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.198835 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.198918 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.198982 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.199054 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.177115 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.199908 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 367694b5edf143ef81e99e348543659a (DEFAULT_TABLE table=default.Table_058d5ec95f2a468ab9d1edf25995bdd8 [id=a4e90033d1204cb8b8fbcf057528391c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.200045 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 367694b5edf143ef81e99e348543659a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.201395 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4a0811cad8454c2e871aad2101224f34 (DEFAULT_TABLE table=default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.201511 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0811cad8454c2e871aad2101224f34. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.202874 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
I20250115 10:12:03.190874 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 1650bac5bd96467fb3d586b23ebd77be (DEFAULT_TABLE table=default.Table_ca7bc6e893be4465b1582ee64173500c [id=a1b3933dfb524284b565d94d1e849821]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.203560 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1650bac5bd96467fb3d586b23ebd77be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.190930 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 9305b7ac82cd4393b28017831a0687ff (DEFAULT_TABLE table=default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.204828 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9305b7ac82cd4393b28017831a0687ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.191701 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a (DEFAULT_TABLE table=default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.206256 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab498e7789d4ae18a9f62be2fa2514a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.189911 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5da557a18648719980469579c3979f (DEFAULT_TABLE table=default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.207480 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5da557a18648719980469579c3979f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.208727 3395 tablet_service.cc:1514] Processing DeleteTablet for tablet c64affc7645145069d6197ede241585e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.208942 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fbcd4787a734c5bba29f8a600abf874. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.209872 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2230f6de9a54e98aa83435d37f68807. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.210022 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b110fe6c13204cf295abb29839f3380b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.130838 3380 tablet_service.cc:1467] Processing CreateTablet for tablet 7144ec81e9244eb49715450aeda5f82f (DEFAULT_TABLE table=default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.211880 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144ec81e9244eb49715450aeda5f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.215517 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 17837499b096462394d993f39efce677 (DEFAULT_TABLE table=default.Table_5cde3d62bc8248f3be5fa8764025bbe0 [id=9871ed3c25464e07acb51a093f7c15d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.215607 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17837499b096462394d993f39efce677. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.216836 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d9aaaa37d540cab41de4a083b36917. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.217868 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f6244234f7447debe9cdce30e4919b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219146 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353b2e8e545e44768ec77f0cd0caa6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219208 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c49b39058164387990c4f6dc170785e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219316 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dde69ff2f574d838d81bea5a53700f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219405 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3402dc674ab0402f8e0bdd7b8db4b88d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219483 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4831e3d84c4d4f08bc5e6fa145a3c1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219560 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b19ae7373c4de688ae30eb7e1d9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219653 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc7e96ba921d4fbb96afbbf8c5f354f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219749 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8455d282d34bbe9822a00a28d4c3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219833 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f81769b500149f7b2bf7cdf76f7ee27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219913 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f37b29ba1cb4a0289268ba1241527b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.219995 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0811cad8454c2e871aad2101224f34. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220053 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a577ace8245744d1a42938ddd99ce89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220134 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d2f7ec7d44422ebc35e29797bfd456. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220211 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f611ee9e87048ca8bddaa6525bbd054. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220295 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e23a070a8454f3b8bd1620ac4535a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220357 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0922008e726c4e53b00b287261a2f0a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220420 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d5cf0e380d348f1ae2f05db1a010a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220486 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12379200d11e4ed3800f609d34a54ea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.220536 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63980fabd5634bf39c41215740cd4d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.221760 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 87d8167b34064888be6e4df4dfde0b31 (DEFAULT_TABLE table=default.Table_196ff2f45dc94ec58c60a08545468524 [id=588ca457130b479db3f999ed2f492120]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.221843 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d8167b34064888be6e4df4dfde0b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.222882 3512 tablet_service.cc:1467] Processing CreateTablet for tablet d02e33022c3840c28623200adb56e3bc (DEFAULT_TABLE table=default.Table_37a1bb8e70ed42b0a26b1f88d34c43b4 [id=aeff809e211042a1b0bf7a57d8c754e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.222962 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02e33022c3840c28623200adb56e3bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.224717 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 1385fb81dff24e709d5d45fb9d616369 (DEFAULT_TABLE table=default.Table_afe0a2e732c54c4fb26be3d8fc0fcecf [id=23c0981b39e2410196a18d8842f329b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.224817 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1385fb81dff24e709d5d45fb9d616369. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.225850 3517 tablet_service.cc:1467] Processing CreateTablet for tablet bf882dcd84be4b38af533b64dfb4fd95 (DEFAULT_TABLE table=default.Table_fe2f3ce38a07444b9849a4cb636ec7c4 [id=0041976377904d41939a1ea9a5fcc07e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.225934 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf882dcd84be4b38af533b64dfb4fd95. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.226949 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 82c66363913e47399c4e1e8533bdadd0 (DEFAULT_TABLE table=default.Table_f1faf951819049d9aac897e67c029beb [id=86cef7da77da456089b46d9647ee7e3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.227035 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82c66363913e47399c4e1e8533bdadd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.229125 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 14f3aea0cf684f749027f817eb3b13b7 (DEFAULT_TABLE table=default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.229203 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14f3aea0cf684f749027f817eb3b13b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.230206 3513 tablet_service.cc:1467] Processing CreateTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 (DEFAULT_TABLE table=default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.230281 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3326a9a37a64e9a9485e5abadc2e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.231184 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 77b422773c3346199383ca64330719c6 (DEFAULT_TABLE table=default.Table_f04269f5ae13474e959f42bee487f199 [id=195139f257d2494791df1002a43aee3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.231261 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77b422773c3346199383ca64330719c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.232846 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 6435fd1953d440c8b4d9745a5dcd15f6 (DEFAULT_TABLE table=default.Table_79af526c42b24e2f8ae1da15d106cbe9 [id=22fbb91517214bfeb4c6d732904ac18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.232915 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6435fd1953d440c8b4d9745a5dcd15f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.233888 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 (DEFAULT_TABLE table=default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.233963 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ae4f2e19e4443b38430cdb95bd82f91. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.234894 3529 tablet_service.cc:1467] Processing CreateTablet for tablet 707f0e47915e4a8998a97a8680394e5d (DEFAULT_TABLE table=default.Table_5b1fd5cfd1424151839bc16fb5c88670 [id=05b392915cd34cf9af16ae61741e53f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.234964 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707f0e47915e4a8998a97a8680394e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.236934 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 9305b7ac82cd4393b28017831a0687ff (DEFAULT_TABLE table=default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.237011 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9305b7ac82cd4393b28017831a0687ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.237996 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 0496864e655e40dfac38619adbf4fd87 (DEFAULT_TABLE table=default.Table_00c57a31372740fe9620a054ec21d16e [id=5da2380bb07b43758f04bbd828525b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.238075 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0496864e655e40dfac38619adbf4fd87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.239033 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5da557a18648719980469579c3979f (DEFAULT_TABLE table=default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.240746 3528 tablet_service.cc:1467] Processing CreateTablet for tablet a076172bba8e4878978c318d441577bd (DEFAULT_TABLE table=default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.240815 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a076172bba8e4878978c318d441577bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.241776 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 14a9663596174aa1b72ce71e49183a2b (DEFAULT_TABLE table=default.Table_202be7fd65b14cb88442d558eb06fed9 [id=ca363805a72c4ed6af847c3a1b61803e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.241851 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a9663596174aa1b72ce71e49183a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.242803 3528 tablet_service.cc:1467] Processing CreateTablet for tablet b7a6ec9020494019a32cfb428554bd07 (DEFAULT_TABLE table=default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.242879 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a6ec9020494019a32cfb428554bd07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.244786 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e (DEFAULT_TABLE table=default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.244860 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4283a096b18b4be69e1f57e60c3efd3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.245887 3530 tablet_service.cc:1467] Processing CreateTablet for tablet a7e2086241df4b4fac5e481c5e8295a9 (DEFAULT_TABLE table=default.Table_7b236b5787d24e138bfad3c30003b316 [id=0b1b8cdb67244dc19aed82671327d212]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.245966 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e2086241df4b4fac5e481c5e8295a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.247040 3530 tablet_service.cc:1467] Processing CreateTablet for tablet f682c7942a454d86a5df19eeac533361 (DEFAULT_TABLE table=default.Table_083c387389e741fa8d1c07011d4e7f5d [id=940ec8ab0c8a48be99dbb34e0ef6d263]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.247138 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f682c7942a454d86a5df19eeac533361. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.248840 3524 tablet_service.cc:1467] Processing CreateTablet for tablet c77afc007fac49848786aaecd4d1e214 (DEFAULT_TABLE table=default.Table_780d6792486f4d65bb71098c78eec010 [id=65d6de2c925e407094df78186e79ddf7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.248919 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77afc007fac49848786aaecd4d1e214. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.249893 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 7144ec81e9244eb49715450aeda5f82f (DEFAULT_TABLE table=default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.249967 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144ec81e9244eb49715450aeda5f82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.250866 3524 tablet_service.cc:1467] Processing CreateTablet for tablet afebbabd8d914cd0804a0c64830ef84e (DEFAULT_TABLE table=default.Table_41584cc62411410fbfa50fc897fa446a [id=6f19ad27a4ef4fe4b447cb2eea68d043]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.250952 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afebbabd8d914cd0804a0c64830ef84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.251693 4338 raft_consensus.cc:491] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.251761 4338 raft_consensus.cc:513] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.251888 4338 leader_election.cc:290] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.252151 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.252171 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.252370 3484 leader_election.cc:343] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.252498 3485 leader_election.cc:343] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.252538 3485 leader_election.cc:304] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.252607 4338 raft_consensus.cc:2743] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.252818 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 5ac231c1b8e04e8788f7bc368a87acdb (DEFAULT_TABLE table=default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.252892 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ac231c1b8e04e8788f7bc368a87acdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.253868 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 4f6baabd5aba4363ae13e5da601a9de8 (DEFAULT_TABLE table=default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.253937 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f6baabd5aba4363ae13e5da601a9de8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.254387 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
W20250115 10:12:03.254683 3214 consensus_peers.cc:487] T f9825097e391481da01ad9111c836ec9 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9825097e391481da01ad9111c836ec9. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.254855 3516 tablet_service.cc:1467] Processing CreateTablet for tablet b9c28bb9d70940a59449ad5afb4a6313 (DEFAULT_TABLE table=default.Table_109864ef03f142b0be396620ae7e15b2 [id=70979ea2e90c4564947e7bfcf4d59e72]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.254931 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9c28bb9d70940a59449ad5afb4a6313. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.256562 4338 raft_consensus.cc:491] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.256603 4338 raft_consensus.cc:513] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.256712 4338 leader_election.cc:290] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.256832 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 7a9d422fdac347ff85eca778c29858e8 (DEFAULT_TABLE table=default.Table_25fd90e569f543a08c37804c5c95dd31 [id=93f0f05ce5b44db1949a47c0d0bab532]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.256898 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a9d422fdac347ff85eca778c29858e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.257141 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.257202 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.257413 3485 leader_election.cc:343] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.257489 3484 leader_election.cc:343] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.257515 3484 leader_election.cc:304] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.257640 4338 raft_consensus.cc:2743] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.257881 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 359eb3a976bd409b8e2d4b72f0b2348c (DEFAULT_TABLE table=default.Table_f469479d54a445cc94bea2d511828e08 [id=83adf17cb14849c7839e7682093de0c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.257970 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 359eb3a976bd409b8e2d4b72f0b2348c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.258946 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 98e5519e80144b7582d76b7f9d8d6ffa (DEFAULT_TABLE table=default.Table_b5612228d70d4480ad349647f31a97fc [id=7c32f09490d24567885955928d4e3d75]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.259025 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e5519e80144b7582d76b7f9d8d6ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.260908 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 5778f29ace314ea18b42afd0b7c1642b (DEFAULT_TABLE table=default.Table_403c08da944445838245a588777ef636 [id=833c3f479c5b49b4978b5d508bb1d101]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.260986 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5778f29ace314ea18b42afd0b7c1642b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.261149 3214 consensus_peers.cc:487] T 86d086cd94664d40a653d64d06438bda P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86d086cd94664d40a653d64d06438bda. This is attempt 11: this message will repeat every 5th retry.
W20250115 10:12:03.261409 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:03.261932 3520 tablet_service.cc:1467] Processing CreateTablet for tablet f8114f64577245c2b3ce70e4399de0c8 (DEFAULT_TABLE table=default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.262006 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8114f64577245c2b3ce70e4399de0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.262933 3520 tablet_service.cc:1467] Processing CreateTablet for tablet 8c045349a48644eda41ea8965b16174d (DEFAULT_TABLE table=default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.262998 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c045349a48644eda41ea8965b16174d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.264757 3514 tablet_service.cc:1467] Processing CreateTablet for tablet cd8c55fd071d42b880becb81e6f70f27 (DEFAULT_TABLE table=default.Table_b0fc010b7ee04aeeb92e5ea4e2896beb [id=8afca2ed08bc4ea392257397837f8db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.264837 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd8c55fd071d42b880becb81e6f70f27. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.265856 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e (DEFAULT_TABLE table=default.Table_5c001d1a075b4563ad22475f486ee7a2 [id=b6eea97a6c9c486098f3e23f4a342cd5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.265934 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d16a22c6f2be4f8c83c3ef073ee6ff7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.266870 3514 tablet_service.cc:1467] Processing CreateTablet for tablet f96f4c52a2124c05b0e124a89eacaa71 (DEFAULT_TABLE table=default.Table_583dc203fd4940dfb099846022f31e33 [id=c4035a1a23384ac9b0e51f8642f497de]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.266934 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96f4c52a2124c05b0e124a89eacaa71. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.267556 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 63b83ca446824b88978e3dc3269d43a3 (DEFAULT_TABLE table=default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.267621 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b83ca446824b88978e3dc3269d43a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.268625 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268671 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268695 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268718 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268741 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet d190044d103e441193e224c667108543 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a285009787f4acb810a1829ca37a845) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268764 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet f682c7942a454d86a5df19eeac533361 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268790 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b8efd1622a4efcb009f999cb915dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268810 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268843 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c045349a48644eda41ea8965b16174d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268867 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b422773c3346199383ca64330719c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.268826 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3f969226dcf64b9e8d5d6e561088c83d" } new_table_name: "default.Table_4a1fbe71ee7f439eaf78d450b0501d1c" modify_external_catalogs: true
I20250115 10:12:03.271283 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d5da557a18648719980469579c3979f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.272004 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:03.272089 4477 master_service.cc:946] ReplaceTablet: received request to replace tablet 6d9a83c4de3849498be5c6e4f9c8b00c from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:03.273747 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5461620a4b644906ad7d9694dfc80177 consensus state has no leader
W20250115 10:12:03.274009 3215 consensus_peers.cc:487] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.275133 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:03.275228 4477 catalog_manager.cc:6596] ReplaceTablet: tablet 6d9a83c4de3849498be5c6e4f9c8b00c deleted and replaced by tablet cb8da7533f8041768533184ef0a33d3f
I20250115 10:12:03.275527 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c with delete_type TABLET_DATA_DELETED (replaced by tablet cb8da7533f8041768533184ef0a33d3f) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.277307 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c with delete_type TABLET_DATA_DELETED (replaced by tablet cb8da7533f8041768533184ef0a33d3f) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.277372 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497adb74fac84c1cb438ea6ba4adf211. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.278530 4551 ts_tablet_manager.cc:1918] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.278579 4551 log.cc:1198] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6e56c83017b54e65a066e8e377293b13
I20250115 10:12:03.278678 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c with delete_type TABLET_DATA_DELETED (replaced by tablet cb8da7533f8041768533184ef0a33d3f) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.278786 4551 ts_tablet_manager.cc:1939] T 6e56c83017b54e65a066e8e377293b13 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.278990 4551 tablet_replica.cc:331] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.279047 4551 raft_consensus.cc:2238] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.279084 4551 raft_consensus.cc:2267] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.279191 4551 ts_tablet_manager.cc:1905] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.280520 4551 ts_tablet_manager.cc:1918] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.280586 4551 log.cc:1198] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d92890d082e242ccae8ad4e40d056c74
W20250115 10:12:03.280591 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f682c7942a454d86a5df19eeac533361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f682c7942a454d86a5df19eeac533361 already in progress: creating tablet
W20250115 10:12:03.280658 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 65a0bd78c1e7409bb41392fd8f9a0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65a0bd78c1e7409bb41392fd8f9a0862 already in progress: creating tablet
W20250115 10:12:03.280692 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8a3ebf56500b4c97b7553644d62fe83a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3ebf56500b4c97b7553644d62fe83a already in progress: creating tablet
W20250115 10:12:03.280725 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 46b8efd1622a4efcb009f999cb915dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46b8efd1622a4efcb009f999cb915dfc already in progress: creating tablet
W20250115 10:12:03.280762 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8c045349a48644eda41ea8965b16174d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c045349a48644eda41ea8965b16174d already in progress: creating tablet
W20250115 10:12:03.280805 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 77b422773c3346199383ca64330719c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77b422773c3346199383ca64330719c6 already in progress: creating tablet
I20250115 10:12:03.280804 4551 ts_tablet_manager.cc:1939] T d92890d082e242ccae8ad4e40d056c74 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:03.280838 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet fc423aad4e7a49eaacb21c73d5d8c341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc423aad4e7a49eaacb21c73d5d8c341 already in progress: creating tablet
W20250115 10:12:03.280885 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d190044d103e441193e224c667108543 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d190044d103e441193e224c667108543 already in progress: creating tablet
W20250115 10:12:03.280917 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 21d5a121a87648ecbb842f52bc361602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d5a121a87648ecbb842f52bc361602 already in progress: creating tablet
W20250115 10:12:03.280942 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f9256780f6e94b7ebd1276df07baf19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9256780f6e94b7ebd1276df07baf19d already in progress: creating tablet
W20250115 10:12:03.280969 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 already in progress: creating tablet
W20250115 10:12:03.280997 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6be683cdd24844eebaad0ed6a36be25f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6be683cdd24844eebaad0ed6a36be25f already in progress: creating tablet
I20250115 10:12:03.281009 4551 tablet_replica.cc:331] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:03.281033 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d35847dc829b4b3d94c0fb68ec6c2b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35847dc829b4b3d94c0fb68ec6c2b31 already in progress: creating tablet
I20250115 10:12:03.281054 4551 raft_consensus.cc:2238] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
W20250115 10:12:03.281059 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3b89df9f987e46ae98fe21df847cb311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b89df9f987e46ae98fe21df847cb311 already in progress: creating tablet
W20250115 10:12:03.281093 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet c64affc7645145069d6197ede241585e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c64affc7645145069d6197ede241585e already in progress: creating tablet
I20250115 10:12:03.281128 4551 raft_consensus.cc:2267] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.281143 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6d9a83c4de3849498be5c6e4f9c8b00c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a83c4de3849498be5c6e4f9c8b00c already in progress: creating tablet
I20250115 10:12:03.281239 4551 ts_tablet_manager.cc:1905] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.281632 3462 heartbeater.cc:501] Master 127.2.217.190:46859 was elected leader, sending a full tablet report...
I20250115 10:12:03.282527 4589 tablet_replica.cc:331] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.282581 4589 raft_consensus.cc:2238] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.282630 4589 raft_consensus.cc:2267] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.282783 4551 ts_tablet_manager.cc:1918] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.282820 4551 log.cc:1198] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f889cc1201404c8691bf01256750e244
I20250115 10:12:03.282884 4589 ts_tablet_manager.cc:1905] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.283164 4551 ts_tablet_manager.cc:1939] T f889cc1201404c8691bf01256750e244 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.283353 4551 tablet_replica.cc:331] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.283600 4551 raft_consensus.cc:2238] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:03.283697 4551 raft_consensus.cc:2267] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.283836 4551 ts_tablet_manager.cc:1905] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.283880 4557 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.283918 4557 ts_tablet_manager.cc:1397] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.264s user 0.000s sys 0.001s
I20250115 10:12:03.284085 4557 raft_consensus.cc:357] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.284157 4557 raft_consensus.cc:383] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.284181 4557 raft_consensus.cc:738] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.284221 4557 consensus_queue.cc:260] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.284305 4557 ts_tablet_manager.cc:1428] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.284379 4557 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.284780 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 1 got 0
I20250115 10:12:03.284840 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4283a096b18b4be69e1f57e60c3efd3e (table default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe]). Expected version 2 got 0
I20250115 10:12:03.284873 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]). Expected version 1 got 0
I20250115 10:12:03.284876 4557 tablet_bootstrap.cc:654] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.284910 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_8166964273cd466883c47516ef68ef46 [id=988e12ca3c094601a1189d8558614dae]). Expected version 1 got 0
I20250115 10:12:03.284947 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:03.284976 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.285012 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:03.285043 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:03.285075 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]). Expected version 1 got 0
I20250115 10:12:03.285099 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4ab498e7789d4ae18a9f62be2fa2514a (table default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]). Expected version 1 got 0
I20250115 10:12:03.285132 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]). Expected version 1 got 0
I20250115 10:12:03.285207 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:03.285251 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:03.285312 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.285343 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.285369 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:03.285404 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
I20250115 10:12:03.285437 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]). Expected version 1 got 0
I20250115 10:12:03.285487 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 1 got 0
I20250115 10:12:03.285526 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:03.285552 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:03.285514 4551 ts_tablet_manager.cc:1918] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.285594 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f3cba581c6884fd98503d4883b09d4a6 (table default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406]). Expected version 3 got 0
I20250115 10:12:03.285625 4551 log.cc:1198] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/4db40559d7894bb8b80cf27b546c8f56
I20250115 10:12:03.285626 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]). Expected version 1 got 0
I20250115 10:12:03.285660 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:03.285691 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b7a6ec9020494019a32cfb428554bd07 (table default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e]). Expected version 1 got 0
I20250115 10:12:03.285727 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]). Expected version 1 got 0
I20250115 10:12:03.285756 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:03.285789 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]). Expected version 1 got 0
I20250115 10:12:03.285815 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 2d5da557a18648719980469579c3979f (table default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43]). Expected version 2 got 0
I20250115 10:12:03.285849 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e]). Expected version 1 got 0
I20250115 10:12:03.285883 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:03.285916 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]). Expected version 1 got 0
I20250115 10:12:03.285832 4551 ts_tablet_manager.cc:1939] T 4db40559d7894bb8b80cf27b546c8f56 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.285948 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 1 got 0
I20250115 10:12:03.285985 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]). Expected version 1 got 0
I20250115 10:12:03.286022 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:03.286052 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4f6baabd5aba4363ae13e5da601a9de8 (table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]). Expected version 1 got 0
I20250115 10:12:03.286079 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_d8204dbea13e49cc85f44f199f3004f3 [id=59ace488897c42a3a28b6118667f6403]). Expected version 2 got 0
I20250115 10:12:03.286118 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:03.286144 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4a0811cad8454c2e871aad2101224f34 (table default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819]). Expected version 2 got 0
I20250115 10:12:03.286137 4551 tablet_replica.cc:331] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.286190 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 1 got 0
I20250115 10:12:03.286198 4551 raft_consensus.cc:2238] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.286229 4551 raft_consensus.cc:2267] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.286227 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]). Expected version 1 got 0
I20250115 10:12:03.286268 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]). Expected version 1 got 0
I20250115 10:12:03.286294 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 7144ec81e9244eb49715450aeda5f82f (table default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]). Expected version 1 got 0
I20250115 10:12:03.286315 4551 ts_tablet_manager.cc:1905] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.286319 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.286347 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 60cc9a1b2c4348ada0d8dab958aded09 (table default.Table_547a65dbda1749c082cfb2aa9f2a2285 [id=f93e7218dc4947b5bc778789c1be1480]). Expected version 1 got 0
I20250115 10:12:03.286382 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:03.286413 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 575f1a39f8a54c4cb21cd17d562c0542 (table default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]). Expected version 1 got 0
I20250115 10:12:03.286460 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890]). Expected version 2 got 0
I20250115 10:12:03.286484 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 9077d0eed1974bc898370b5d5554be71 (table default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]). Expected version 1 got 0
I20250115 10:12:03.286516 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98]). Expected version 1 got 0
I20250115 10:12:03.286540 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.286571 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 166e6390660c485c99b2e115fd1b272f (table default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]). Expected version 1 got 0
I20250115 10:12:03.286593 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:03.286617 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]). Expected version 1 got 0
I20250115 10:12:03.286675 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]). Expected version 1 got 0
I20250115 10:12:03.286703 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 4 got 0
I20250115 10:12:03.286731 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:03.286764 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]). Expected version 1 got 0
I20250115 10:12:03.286792 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:03.286813 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:03.286849 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:03.286880 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.286908 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 1 got 0
I20250115 10:12:03.286940 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6de4d57d53c648b491f66f257414394d (table default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf]). Expected version 1 got 0
I20250115 10:12:03.286967 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:03.286990 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:03.287019 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:03.287039 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.287058 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
I20250115 10:12:03.287086 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]). Expected version 1 got 0
I20250115 10:12:03.287103 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f8114f64577245c2b3ce70e4399de0c8 (table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]). Expected version 2 got 0
I20250115 10:12:03.287127 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.287168 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:03.287186 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:03.287206 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:03.287499 4589 ts_tablet_manager.cc:1918] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.287551 4589 log.cc:1198] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d190044d103e441193e224c667108543
I20250115 10:12:03.287580 4575 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.287632 4575 ts_tablet_manager.cc:1397] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.224s user 0.001s sys 0.000s
I20250115 10:12:03.287707 4589 ts_tablet_manager.cc:1939] T d190044d103e441193e224c667108543 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.287866 4575 raft_consensus.cc:357] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.287938 4575 raft_consensus.cc:383] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.287961 4575 raft_consensus.cc:738] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.288012 4575 consensus_queue.cc:260] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.288116 4575 ts_tablet_manager.cc:1428] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.288195 4575 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.288599 4575 tablet_bootstrap.cc:654] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.289144 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]). Expected version 1 got 0
I20250115 10:12:03.290052 4557 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.290096 4557 ts_tablet_manager.cc:1397] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.290231 4557 raft_consensus.cc:357] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.290282 4557 raft_consensus.cc:383] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.290302 4557 raft_consensus.cc:738] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.290343 4557 consensus_queue.cc:260] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.290417 4557 ts_tablet_manager.cc:1428] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:03.290302 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_b3fbd549a43142f0934459f981bbe3e1 [id=6637d1f036c34aeeae9d1cc84697d2f6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet ef7f182c4bde468d919523c44fdf3ea4 consensus state has no leader
I20250115 10:12:03.290488 4557 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:03.290485 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 4283a096b18b4be69e1f57e60c3efd3e (table default.Table_eb6dbc05842d4cf1b1930201f8cecc7a [id=a179eb95164c4087a5f666d51a843dbe], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 4283a096b18b4be69e1f57e60c3efd3e consensus state has no leader
I20250115 10:12:03.290524 4569 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
W20250115 10:12:03.290542 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5ac231c1b8e04e8788f7bc368a87acdb consensus state has no leader
I20250115 10:12:03.290562 4569 ts_tablet_manager.cc:1397] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.223s user 0.000s sys 0.001s
I20250115 10:12:03.290707 4569 raft_consensus.cc:357] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.290743 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet ca2e043501b04096b648d179a13e8653 consensus state has no leader
I20250115 10:12:03.290776 4569 raft_consensus.cc:383] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.290798 4569 raft_consensus.cc:738] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
W20250115 10:12:03.290802 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8093f8487b9844718707e2fcdd3ae833 consensus state has no leader
I20250115 10:12:03.290841 4569 consensus_queue.cc:260] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.290886 4557 tablet_bootstrap.cc:654] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.290874 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet f55439e91f284175a59d35160668fa6c consensus state has no leader
I20250115 10:12:03.290946 4569 ts_tablet_manager.cc:1428] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.291018 4569 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:03.290968 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d3326a9a37a64e9a9485e5abadc2e493 consensus state has no leader
W20250115 10:12:03.291280 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 4ab498e7789d4ae18a9f62be2fa2514a (table default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4ab498e7789d4ae18a9f62be2fa2514a consensus state has no leader
W20250115 10:12:03.291319 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 50d2f7ec7d44422ebc35e29797bfd456 consensus state has no leader
W20250115 10:12:03.291414 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3c778d7be748405285068f36650902b0 consensus state has no leader
I20250115 10:12:03.291445 4569 tablet_bootstrap.cc:654] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.291512 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet cfe7181347114ccfbf62109147d182b3 consensus state has no leader
W20250115 10:12:03.291567 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet d368093a74ba4918b0efcc3a909c3a07 consensus state has no leader
W20250115 10:12:03.291644 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8a485231d2de4fab8b86b4900976c76c consensus state has no leader
W20250115 10:12:03.291694 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3552b8e936ad4aeba0eadc95577f5414 consensus state has no leader
W20250115 10:12:03.291759 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_ebe6e92e27e34c1e8a0e162800b38f8f [id=0e1a322d63c049d6878a7a7a7a80de57], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 1b6a615c0c5d4815b540d81ef3357eb4 consensus state has no leader
W20250115 10:12:03.291836 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet a076172bba8e4878978c318d441577bd consensus state has no leader
W20250115 10:12:03.291900 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet f3cba581c6884fd98503d4883b09d4a6 (table default.Table_19e945af3350495ca3abc6261a945770 [id=0898c761fc714d498d52cd9f91f01406], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet f3cba581c6884fd98503d4883b09d4a6 consensus state has no leader
W20250115 10:12:03.291988 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0a612decf0634bd588f45c8953c6b201 consensus state has no leader
W20250115 10:12:03.292088 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet b7a6ec9020494019a32cfb428554bd07 (table default.Table_4ef75ebcfb674a44bb6ba3feaa65423d [id=42959d520ede4abd9e2abd01f98e112e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b7a6ec9020494019a32cfb428554bd07 consensus state has no leader
W20250115 10:12:03.292187 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 3067eaaa090b4ffb95b2e741453113ed consensus state has no leader
W20250115 10:12:03.292259 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bdc4e4d12dbc4e5aa240d9daab4afb1b consensus state has no leader
W20250115 10:12:03.292348 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f0ae1ff74cce48ada0a373f9e65508a2 consensus state has no leader
W20250115 10:12:03.292439 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 2d5da557a18648719980469579c3979f (table default.Table_83d11d1609a44b49857dd3fd6489c4f6 [id=05a4145d590f48448b42be36cd362a43], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 2d5da557a18648719980469579c3979f consensus state has no leader
I20250115 10:12:03.292482 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
W20250115 10:12:03.292578 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_0d603960b0604f3ebe288c27daa21c6f [id=3078581f1b544badaeded5f2ab32f05e], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 9305b7ac82cd4393b28017831a0687ff consensus state has no leader
W20250115 10:12:03.292697 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e8c99788dae6421b8b2dd4f40e2b63b2 consensus state has no leader
I20250115 10:12:03.292732 4551 ts_tablet_manager.cc:1918] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.3
I20250115 10:12:03.292776 4551 log.cc:1198] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/e3a4b1b801c84cbcae634a965be09734
W20250115 10:12:03.293807 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6fe929017262442094800c874183f5de consensus state has no leader
I20250115 10:12:03.293455 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
W20250115 10:12:03.293906 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 63980fabd5634bf39c41215740cd4d72 consensus state has no leader
W20250115 10:12:03.294147 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6f611ee9e87048ca8bddaa6525bbd054 consensus state has no leader
W20250115 10:12:03.294301 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 4f6baabd5aba4363ae13e5da601a9de8 (table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 4f6baabd5aba4363ae13e5da601a9de8 consensus state has no leader
W20250115 10:12:03.294384 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 4a0811cad8454c2e871aad2101224f34 (table default.Table_c2adaa84739b46ce89b6276f774c9c01 [id=b332484ec53c4627b37217d4c4476819], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 4a0811cad8454c2e871aad2101224f34 consensus state has no leader
W20250115 10:12:03.294476 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_4543989449c243fcad6ffbbd87796a81 [id=3c5ff02ab44a4c96a39bdc88f43b1883], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d21906d23acc4ab8b81eceb87ead049f consensus state has no leader
W20250115 10:12:03.294540 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_fec7184706584f6ba7fe4a6fc4596962 [id=1e8d95b292ea4c6fb2f9a0c64fe9f985], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8dde69ff2f574d838d81bea5a53700f5 consensus state has no leader
W20250115 10:12:03.294607 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet aef601e6f3ef4ba387164c239c1139b0 consensus state has no leader
W20250115 10:12:03.294755 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 5d841537abc2437c826e069cc0725ad1 consensus state has no leader
W20250115 10:12:03.294858 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 575f1a39f8a54c4cb21cd17d562c0542 (table default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 575f1a39f8a54c4cb21cd17d562c0542 consensus state has no leader
W20250115 10:12:03.294921 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f7f004c0e61c486b82180c7317e3b2cd [id=c07c3cfb82be473395736827fc642890], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet a577ace8245744d1a42938ddd99ce89b consensus state has no leader
W20250115 10:12:03.294986 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_5a9b7a75ae964db6a818d54d77e2ced1 [id=a917e062f0334d9ab4cd3ee08ba2ce98], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8a357badf1cd43e384d2de92e3413898 consensus state has no leader
W20250115 10:12:03.295078 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 166e6390660c485c99b2e115fd1b272f (table default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 166e6390660c485c99b2e115fd1b272f consensus state has no leader
W20250115 10:12:03.295145 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 47205800bd074a9585c4af0f50055a13 consensus state has no leader
W20250115 10:12:03.295223 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet bfe0522e3e664012a00ec78a09c2816c consensus state has no leader
W20250115 10:12:03.295337 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 347621ded3fd4380b1502d1a8c5b0c4a consensus state has no leader
W20250115 10:12:03.295403 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d], current schema version=4): Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 consensus state has no leader
I20250115 10:12:03.295394 3392 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.295485 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 98993cb75de34c0babb894a5d17d6d12 consensus state has no leader
I20250115 10:12:03.295495 3388 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.295543 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 46b8efd1622a4efcb009f999cb915dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.295603 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet fc423aad4e7a49eaacb21c73d5d8c341 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.295610 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet af48bf64e2ca4a3197805c75fb0a12a6 consensus state has no leader
I20250115 10:12:03.292979 4551 ts_tablet_manager.cc:1939] T e3a4b1b801c84cbcae634a965be09734 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:03.295928 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_74abe75013584ccbb2acb8aa9426c527 [id=a4e2127fb8624f16afed55f89d949842], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 8600883e5a5449c59a747a6ef2121c61 consensus state has no leader
W20250115 10:12:03.295993 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 6de4d57d53c648b491f66f257414394d (table default.Table_a8431f0582fa439e99b774778d8281ac [id=6d75cdb171ff492b97b90cf593fc5ddf], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6de4d57d53c648b491f66f257414394d consensus state has no leader
W20250115 10:12:03.296120 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 29ed70f5db0e492eaf0c42e005736ad1 consensus state has no leader
I20250115 10:12:03.296175 3376 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.296257 4551 tablet_replica.cc:331] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:03.296280 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet f8114f64577245c2b3ce70e4399de0c8 (table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet f8114f64577245c2b3ce70e4399de0c8 consensus state has no leader
I20250115 10:12:03.296331 4551 raft_consensus.cc:2238] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
W20250115 10:12:03.296341 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 already in progress: creating tablet
I20250115 10:12:03.296404 4551 raft_consensus.cc:2267] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.296420 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6be683cdd24844eebaad0ed6a36be25f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6be683cdd24844eebaad0ed6a36be25f already in progress: creating tablet
I20250115 10:12:03.296471 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.296509 4551 ts_tablet_manager.cc:1905] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.296518 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.296548 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c045349a48644eda41ea8965b16174d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.296751 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]). Expected version 1 got 0
I20250115 10:12:03.296766 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.296864 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 26351bbe70044075a99982bb380d86a0 consensus state has no leader
I20250115 10:12:03.296551 3376 tablet_service.cc:1514] Processing DeleteTablet for tablet d190044d103e441193e224c667108543 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a285009787f4acb810a1829ca37a845) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.296991 4477 catalog_manager.cc:5718] Failed to send AlterTable RPC for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 3402dc674ab0402f8e0bdd7b8db4b88d consensus state has no leader
I20250115 10:12:03.297528 4551 ts_tablet_manager.cc:1918] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20250115 10:12:03.297791 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet fc423aad4e7a49eaacb21c73d5d8c341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc423aad4e7a49eaacb21c73d5d8c341 already in progress: creating tablet
W20250115 10:12:03.297923 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 21d5a121a87648ecbb842f52bc361602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d5a121a87648ecbb842f52bc361602 already in progress: creating tablet
W20250115 10:12:03.298015 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 8a3ebf56500b4c97b7553644d62fe83a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3ebf56500b4c97b7553644d62fe83a already in progress: creating tablet
W20250115 10:12:03.298133 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52c44b485fd84ea8a954c1eb5b8ff5b5 already in progress: creating tablet
W20250115 10:12:03.298214 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f9256780f6e94b7ebd1276df07baf19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9256780f6e94b7ebd1276df07baf19d already in progress: creating tablet
W20250115 10:12:03.298295 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 6be683cdd24844eebaad0ed6a36be25f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6be683cdd24844eebaad0ed6a36be25f already in progress: creating tablet
W20250115 10:12:03.298390 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 65a0bd78c1e7409bb41392fd8f9a0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65a0bd78c1e7409bb41392fd8f9a0862 already in progress: creating tablet
I20250115 10:12:03.298470 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d190044d103e441193e224c667108543 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]) successfully deleted
W20250115 10:12:03.298555 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet c64affc7645145069d6197ede241585e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c64affc7645145069d6197ede241585e already in progress: creating tablet
W20250115 10:12:03.298671 4463 catalog_manager.cc:4839] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet d35847dc829b4b3d94c0fb68ec6c2b31 because the tablet was not found. No further retry: Not found: Tablet not found: d35847dc829b4b3d94c0fb68ec6c2b31
W20250115 10:12:03.298745 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f682c7942a454d86a5df19eeac533361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f682c7942a454d86a5df19eeac533361 already in progress: creating tablet
W20250115 10:12:03.298823 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 46b8efd1622a4efcb009f999cb915dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46b8efd1622a4efcb009f999cb915dfc already in progress: creating tablet
W20250115 10:12:03.298903 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3b89df9f987e46ae98fe21df847cb311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b89df9f987e46ae98fe21df847cb311 already in progress: creating tablet
I20250115 10:12:03.298904 3770 raft_consensus.cc:491] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.298950 3770 raft_consensus.cc:513] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:03.298983 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 8c045349a48644eda41ea8965b16174d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c045349a48644eda41ea8965b16174d already in progress: creating tablet
I20250115 10:12:03.299054 3770 leader_election.cc:290] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.299207 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 77b422773c3346199383ca64330719c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77b422773c3346199383ca64330719c6 already in progress: creating tablet
I20250115 10:12:03.299197 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5461620a4b644906ad7d9694dfc80177" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.299340 3214 leader_election.cc:343] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.299348 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 6d9a83c4de3849498be5c6e4f9c8b00c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a83c4de3849498be5c6e4f9c8b00c already in progress: creating tablet
I20250115 10:12:03.299597 3376 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d9a83c4de3849498be5c6e4f9c8b00c with delete_type TABLET_DATA_DELETED (replaced by tablet cb8da7533f8041768533184ef0a33d3f) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.299651 3378 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.300382 4569 tablet_bootstrap.cc:492] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.300433 4569 ts_tablet_manager.cc:1397] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:03.300491 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6e56c83017b54e65a066e8e377293b13 (table default.Table_2b51019f4b394c6c9c3c13ecf8a75f9a [id=97e1085cf3bc494c8a0a05662b4c2701]) successfully deleted
I20250115 10:12:03.300585 4569 raft_consensus.cc:357] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.300617 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d92890d082e242ccae8ad4e40d056c74 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]) successfully deleted
I20250115 10:12:03.300630 4551 log.cc:1198] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:12:03.300648 4569 raft_consensus.cc:383] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.300671 4569 raft_consensus.cc:738] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.300705 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f889cc1201404c8691bf01256750e244 (table default.Table_e5550426b49241a48cac19af16d12519 [id=1ac3f51295024b83b64f69df31a970d2]) successfully deleted
I20250115 10:12:03.300714 4569 consensus_queue.cc:260] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.300763 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 4db40559d7894bb8b80cf27b546c8f56 (table default.Table_9bef498958184c8595bc50e15f924293 [id=db9639c2422847d29930bd7ce722f244]) successfully deleted
I20250115 10:12:03.300827 4551 ts_tablet_manager.cc:1939] T 6034c750d47744ff8eb4d62c7c135ed7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.300834 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet e3a4b1b801c84cbcae634a965be09734 (table default.Table_abc8b1a96d6a41f2815b44361e6282e3 [id=dc0b1482ff3849cebb7afb525dc04264]) successfully deleted
I20250115 10:12:03.300829 4569 ts_tablet_manager.cc:1428] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.300899 4569 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.301014 4551 tablet_replica.cc:331] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.301059 4551 raft_consensus.cc:2238] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.301086 4551 raft_consensus.cc:2267] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f [term 3 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.299487 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5461620a4b644906ad7d9694dfc80177" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.301165 3549 raft_consensus.cc:2463] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.301189 4551 ts_tablet_manager.cc:1905] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.301220 4477 master_service.cc:946] ReplaceTablet: received request to replace tablet fd76846bc164480d9b77aa3d096260cb from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.301288 4569 tablet_bootstrap.cc:654] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.301311 3215 leader_election.cc:304] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.301417 3952 raft_consensus.cc:2798] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.301446 3952 raft_consensus.cc:491] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.301468 3952 raft_consensus.cc:3054] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.300076 4557 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.301854 4557 ts_tablet_manager.cc:1397] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.302004 4557 raft_consensus.cc:357] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.302055 4557 raft_consensus.cc:383] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.302075 4557 raft_consensus.cc:738] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.302117 4557 consensus_queue.cc:260] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.302198 4557 ts_tablet_manager.cc:1428] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.302163 3952 raft_consensus.cc:513] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.302235 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6034c750d47744ff8eb4d62c7c135ed7 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]) successfully deleted
I20250115 10:12:03.302270 4557 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.302284 3952 leader_election.cc:290] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.302352 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7ce9a506439a41599372c73d37cf0b15" } new_table_name: "default.Table_7c4a2c54e77f4b99aafa437a104a0a58" modify_external_catalogs: true
I20250115 10:12:03.302531 4470 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_25066f18e8044d3a88bc2548ecabd41a" } new_table_name: "default.Table_12159c20ed474c57a3d7b3c74a92cb3d" modify_external_catalogs: true
I20250115 10:12:03.302630 4569 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.302665 4557 tablet_bootstrap.cc:654] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.302670 4569 ts_tablet_manager.cc:1397] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.302702 4476 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9f0ac088111e458cbfa9f307456bba2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.302798 4476 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f0ac088111e458cbfa9f307456bba2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.302829 4569 raft_consensus.cc:357] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.302887 4569 raft_consensus.cc:383] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.302909 4569 raft_consensus.cc:738] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.302940 4569 consensus_queue.cc:260] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.302949 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ebe6e92e27e34c1e8a0e162800b38f8f" } new_table_name: "default.Table_5e5e262748054ec6851819b936dc6fbd" modify_external_catalogs: true
I20250115 10:12:03.303046 4569 ts_tablet_manager.cc:1428] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.303095 4569 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.303097 4469 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_5b3caceeab0d45b6a773279c45eafe33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.303174 4469 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b3caceeab0d45b6a773279c45eafe33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.303314 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 5461620a4b644906ad7d9694dfc80177 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.303472 4551 ts_tablet_manager.cc:1918] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.4
I20250115 10:12:03.303483 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 166e6390660c485c99b2e115fd1b272f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.303531 4551 log.cc:1198] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:03.303756 4551 ts_tablet_manager.cc:1939] T 2377c27855a64ac7bec95a6d6c5289af P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.304076 4551 tablet_replica.cc:331] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.304147 4551 raft_consensus.cc:2238] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.304143 4569 tablet_bootstrap.cc:654] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.304193 4551 raft_consensus.cc:2267] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.304471 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 10112ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:03.304517 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5461620a4b644906ad7d9694dfc80177" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:03.304663 3214 leader_election.cc:343] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.305034 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5461620a4b644906ad7d9694dfc80177" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.305096 3549 raft_consensus.cc:3054] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.305125 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_72f4c7bfce6548c1b69d560a2a7ce10e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.305225 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72f4c7bfce6548c1b69d560a2a7ce10e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.305523 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.305752 3549 raft_consensus.cc:2463] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.306339 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 2377c27855a64ac7bec95a6d6c5289af (table default.Table_e9af26dd72da4494af187d8d6378ae0a [id=64196da99b1440f191bef7bd69aaaff0]) successfully deleted
W20250115 10:12:03.306473 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 21d5a121a87648ecbb842f52bc361602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d5a121a87648ecbb842f52bc361602 already in progress: creating tablet
W20250115 10:12:03.306509 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 8a3ebf56500b4c97b7553644d62fe83a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3ebf56500b4c97b7553644d62fe83a already in progress: creating tablet
W20250115 10:12:03.306558 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6be683cdd24844eebaad0ed6a36be25f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6be683cdd24844eebaad0ed6a36be25f already in progress: creating tablet
W20250115 10:12:03.306609 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 65a0bd78c1e7409bb41392fd8f9a0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65a0bd78c1e7409bb41392fd8f9a0862 already in progress: creating tablet
I20250115 10:12:03.307111 3380 tablet_service.cc:1514] Processing DeleteTablet for tablet f682c7942a454d86a5df19eeac533361 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.307572 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet d35847dc829b4b3d94c0fb68ec6c2b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.307634 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet c64affc7645145069d6197ede241585e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.307924 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 46b8efd1622a4efcb009f999cb915dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46b8efd1622a4efcb009f999cb915dfc already in progress: creating tablet
I20250115 10:12:03.307971 3215 leader_election.cc:304] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:03.307988 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet fc423aad4e7a49eaacb21c73d5d8c341 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc423aad4e7a49eaacb21c73d5d8c341 already in progress: creating tablet
W20250115 10:12:03.308045 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 65a0bd78c1e7409bb41392fd8f9a0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65a0bd78c1e7409bb41392fd8f9a0862 already in progress: creating tablet
W20250115 10:12:03.308091 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f9256780f6e94b7ebd1276df07baf19d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9256780f6e94b7ebd1276df07baf19d already in progress: creating tablet
W20250115 10:12:03.308122 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3b89df9f987e46ae98fe21df847cb311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b89df9f987e46ae98fe21df847cb311 already in progress: creating tablet
W20250115 10:12:03.308166 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8c045349a48644eda41ea8965b16174d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c045349a48644eda41ea8965b16174d already in progress: creating tablet
W20250115 10:12:03.308208 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 21d5a121a87648ecbb842f52bc361602 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21d5a121a87648ecbb842f52bc361602 already in progress: creating tablet
I20250115 10:12:03.308219 3952 raft_consensus.cc:2798] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.308264 3952 raft_consensus.cc:695] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.308300 3952 consensus_queue.cc:237] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:03.308394 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d190044d103e441193e224c667108543 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d190044d103e441193e224c667108543 already in progress: creating tablet
W20250115 10:12:03.308434 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6d9a83c4de3849498be5c6e4f9c8b00c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a83c4de3849498be5c6e4f9c8b00c already in progress: creating tablet
W20250115 10:12:03.308465 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8a3ebf56500b4c97b7553644d62fe83a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8a3ebf56500b4c97b7553644d62fe83a already in progress: creating tablet
W20250115 10:12:03.308494 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f682c7942a454d86a5df19eeac533361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f682c7942a454d86a5df19eeac533361 already in progress: creating tablet
W20250115 10:12:03.308524 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d35847dc829b4b3d94c0fb68ec6c2b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d35847dc829b4b3d94c0fb68ec6c2b31 already in progress: creating tablet
W20250115 10:12:03.308569 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet c64affc7645145069d6197ede241585e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c64affc7645145069d6197ede241585e already in progress: creating tablet
I20250115 10:12:03.308584 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 77b422773c3346199383ca64330719c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.308722 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 77b422773c3346199383ca64330719c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77b422773c3346199383ca64330719c6 already in progress: creating tablet
I20250115 10:12:03.309079 4551 ts_tablet_manager.cc:1905] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.309172 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet fd76846bc164480d9b77aa3d096260cb
I20250115 10:12:03.309373 4557 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.309419 4557 ts_tablet_manager.cc:1397] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:03.309389 4477 catalog_manager.cc:6596] ReplaceTablet: tablet fd76846bc164480d9b77aa3d096260cb deleted and replaced by tablet 9c21c9b21c7c4aed981029846b28aee5
I20250115 10:12:03.309566 4557 raft_consensus.cc:357] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.309618 4557 raft_consensus.cc:383] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.309641 4557 raft_consensus.cc:738] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.309689 4557 consensus_queue.cc:260] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.309801 4557 ts_tablet_manager.cc:1428] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.309876 4557 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.309996 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet fd76846bc164480d9b77aa3d096260cb with delete_type TABLET_DATA_DELETED (replaced by tablet 9c21c9b21c7c4aed981029846b28aee5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.310231 4557 tablet_bootstrap.cc:654] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.310636 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet fd76846bc164480d9b77aa3d096260cb with delete_type TABLET_DATA_DELETED (replaced by tablet 9c21c9b21c7c4aed981029846b28aee5) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.310854 4477 master_service.cc:946] ReplaceTablet: received request to replace tablet 57d3800d79794d3bad6c50d2dc8e9258 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:03.311336 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet fd76846bc164480d9b77aa3d096260cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd76846bc164480d9b77aa3d096260cb already in progress: creating tablet
I20250115 10:12:03.311741 4551 ts_tablet_manager.cc:1918] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250115 10:12:03.312040 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5185ff7621e742eb81fa8964ec9ff20b consensus state has no leader
W20250115 10:12:03.312229 4470 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2462c50d3684176aa5ff5caf79f9644 consensus state has no leader
W20250115 10:12:03.312345 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1b6a615c0c5d4815b540d81ef3357eb4 consensus state has no leader
I20250115 10:12:03.312434 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 5461620a4b644906ad7d9694dfc80177
I20250115 10:12:03.312500 4474 catalog_manager.cc:6596] ReplaceTablet: tablet 5461620a4b644906ad7d9694dfc80177 deleted and replaced by tablet 31964c90876c4d289d68b6be6ebb8c12
I20250115 10:12:03.312548 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 166e6390660c485c99b2e115fd1b272f
I20250115 10:12:03.312600 4473 catalog_manager.cc:6596] ReplaceTablet: tablet 166e6390660c485c99b2e115fd1b272f deleted and replaced by tablet 13cfdf73dea14543aff0e564c5fa51b6
I20250115 10:12:03.312603 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 5461620a4b644906ad7d9694dfc80177 with delete_type TABLET_DATA_DELETED (replaced by tablet 31964c90876c4d289d68b6be6ebb8c12) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.313591 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 5461620a4b644906ad7d9694dfc80177 with delete_type TABLET_DATA_DELETED (replaced by tablet 31964c90876c4d289d68b6be6ebb8c12) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.313494 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 5461620a4b644906ad7d9694dfc80177 with delete_type TABLET_DATA_DELETED (replaced by tablet 31964c90876c4d289d68b6be6ebb8c12) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.313784 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e6390660c485c99b2e115fd1b272f with delete_type TABLET_DATA_DELETED (replaced by tablet 13cfdf73dea14543aff0e564c5fa51b6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.313665 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e6390660c485c99b2e115fd1b272f with delete_type TABLET_DATA_DELETED (replaced by tablet 13cfdf73dea14543aff0e564c5fa51b6) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.313846 4551 log.cc:1198] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d190044d103e441193e224c667108543
I20250115 10:12:03.313884 4575 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.313884 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet fd76846bc164480d9b77aa3d096260cb with delete_type TABLET_DATA_DELETED (replaced by tablet 9c21c9b21c7c4aed981029846b28aee5) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.314018 4551 ts_tablet_manager.cc:1939] T d190044d103e441193e224c667108543 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.314299 4551 tablet_replica.cc:331] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:03.314426 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 5461620a4b644906ad7d9694dfc80177 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5461620a4b644906ad7d9694dfc80177 already in progress: creating tablet
I20250115 10:12:03.314451 4589 tablet_replica.cc:331] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.314507 4589 raft_consensus.cc:2238] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:03.314561 4589 pending_rounds.cc:62] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:03.314584 4589 pending_rounds.cc:69] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489541870878720 op_type: NO_OP noop_request { }
I20250115 10:12:03.314622 4589 raft_consensus.cc:2883] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:03.314652 4589 raft_consensus.cc:2267] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.314900 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:03.315137 4569 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.315239 4477 catalog_manager.cc:6596] ReplaceTablet: tablet 57d3800d79794d3bad6c50d2dc8e9258 deleted and replaced by tablet d5490db43ba14c039847a9326a7620c4
I20250115 10:12:03.315357 4569 ts_tablet_manager.cc:1397] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20250115 10:12:03.315558 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 with delete_type TABLET_DATA_DELETED (replaced by tablet d5490db43ba14c039847a9326a7620c4) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.315569 4569 raft_consensus.cc:357] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.315768 4569 raft_consensus.cc:383] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.315834 4569 raft_consensus.cc:738] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.315932 4569 consensus_queue.cc:260] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.315981 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d190044d103e441193e224c667108543 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]) successfully deleted
W20250115 10:12:03.316212 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f682c7942a454d86a5df19eeac533361 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f682c7942a454d86a5df19eeac533361 already in progress: creating tablet
W20250115 10:12:03.316283 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 46b8efd1622a4efcb009f999cb915dfc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 46b8efd1622a4efcb009f999cb915dfc already in progress: creating tablet
W20250115 10:12:03.316366 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3b89df9f987e46ae98fe21df847cb311 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3b89df9f987e46ae98fe21df847cb311 already in progress: creating tablet
I20250115 10:12:03.313938 4575 ts_tablet_manager.cc:1397] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
W20250115 10:12:03.316435 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 8c045349a48644eda41ea8965b16174d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c045349a48644eda41ea8965b16174d already in progress: creating tablet
I20250115 10:12:03.314497 3384 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e6390660c485c99b2e115fd1b272f with delete_type TABLET_DATA_DELETED (replaced by tablet 13cfdf73dea14543aff0e564c5fa51b6) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.315235 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 with delete_type TABLET_DATA_DELETED (replaced by tablet d5490db43ba14c039847a9326a7620c4) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.316640 4575 raft_consensus.cc:357] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.316713 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet fd76846bc164480d9b77aa3d096260cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd76846bc164480d9b77aa3d096260cb already in progress: creating tablet
I20250115 10:12:03.316723 4575 raft_consensus.cc:383] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.316747 4575 raft_consensus.cc:738] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.316789 4575 consensus_queue.cc:260] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.316881 4575 ts_tablet_manager.cc:1428] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:03.316920 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 166e6390660c485c99b2e115fd1b272f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 166e6390660c485c99b2e115fd1b272f already in progress: creating tablet
I20250115 10:12:03.316962 4575 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:03.316974 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 57d3800d79794d3bad6c50d2dc8e9258 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57d3800d79794d3bad6c50d2dc8e9258 already in progress: creating tablet
I20250115 10:12:03.315620 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 57d3800d79794d3bad6c50d2dc8e9258 with delete_type TABLET_DATA_DELETED (replaced by tablet d5490db43ba14c039847a9326a7620c4) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.317054 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 77b422773c3346199383ca64330719c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77b422773c3346199383ca64330719c6 already in progress: creating tablet
I20250115 10:12:03.317099 4551 raft_consensus.cc:2238] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:03.317118 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6d9a83c4de3849498be5c6e4f9c8b00c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6d9a83c4de3849498be5c6e4f9c8b00c already in progress: creating tablet
I20250115 10:12:03.317135 4551 raft_consensus.cc:2267] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.317289 4551 ts_tablet_manager.cc:1905] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.317382 4575 tablet_bootstrap.cc:654] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.317817 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:03.318497 4557 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.318540 4557 ts_tablet_manager.cc:1397] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:03.318674 4557 raft_consensus.cc:357] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.318714 4569 ts_tablet_manager.cc:1428] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:03.318730 4557 raft_consensus.cc:383] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.318759 4557 raft_consensus.cc:738] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.318796 4557 consensus_queue.cc:260] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.318872 4557 ts_tablet_manager.cc:1428] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.318940 4557 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.318864 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:03.319337 4557 tablet_bootstrap.cc:654] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.320005 4569 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.320451 4569 tablet_bootstrap.cc:654] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.320977 4600 consensus_queue.cc:1159] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20250115 10:12:03.321208 4589 ts_tablet_manager.cc:1905] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.322566 4589 ts_tablet_manager.cc:1918] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.322638 4589 log.cc:1198] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/5461620a4b644906ad7d9694dfc80177
I20250115 10:12:03.322862 4589 ts_tablet_manager.cc:1939] T 5461620a4b644906ad7d9694dfc80177 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.323565 4569 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.323611 4569 ts_tablet_manager.cc:1397] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:03.323918 4569 raft_consensus.cc:357] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.323982 4569 raft_consensus.cc:383] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.324002 4569 raft_consensus.cc:738] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.324049 4569 consensus_queue.cc:260] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.324151 4569 ts_tablet_manager.cc:1428] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.324214 4569 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.324425 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]) successfully deleted
W20250115 10:12:03.324532 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 166e6390660c485c99b2e115fd1b272f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 166e6390660c485c99b2e115fd1b272f already in progress: creating tablet
W20250115 10:12:03.324610 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 57d3800d79794d3bad6c50d2dc8e9258 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57d3800d79794d3bad6c50d2dc8e9258 already in progress: creating tablet
I20250115 10:12:03.324726 4569 tablet_bootstrap.cc:654] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.326135 4575 tablet_bootstrap.cc:492] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.326190 4575 ts_tablet_manager.cc:1397] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:03.326382 4575 raft_consensus.cc:357] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.326464 4575 raft_consensus.cc:383] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.326491 4575 raft_consensus.cc:738] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.326545 4575 consensus_queue.cc:260] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.326651 4575 ts_tablet_manager.cc:1428] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.326719 4575 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.326880 4551 ts_tablet_manager.cc:1918] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.326933 4551 log.cc:1198] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:03.327119 4551 ts_tablet_manager.cc:1939] T f9256780f6e94b7ebd1276df07baf19d P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.327148 4575 tablet_bootstrap.cc:654] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.327368 4551 tablet_replica.cc:331] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.327428 4551 raft_consensus.cc:2238] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.327502 4551 raft_consensus.cc:2267] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.327646 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet d190044d103e441193e224c667108543 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a285009787f4acb810a1829ca37a845) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.328068 4569 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.328126 4569 ts_tablet_manager.cc:1397] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:03.328305 4592 tablet_replica.cc:331] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.328290 4569 raft_consensus.cc:357] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.328347 4569 raft_consensus.cc:383] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.328372 4569 raft_consensus.cc:738] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.328369 4592 raft_consensus.cc:2238] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.328405 4592 raft_consensus.cc:2267] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.328413 4569 consensus_queue.cc:260] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.328518 4569 ts_tablet_manager.cc:1428] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.328498 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f9256780f6e94b7ebd1276df07baf19d (table default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]) successfully deleted
I20250115 10:12:03.328539 4551 ts_tablet_manager.cc:1905] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.328584 4569 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:03.328622 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet fd76846bc164480d9b77aa3d096260cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd76846bc164480d9b77aa3d096260cb already in progress: creating tablet
I20250115 10:12:03.328964 4569 tablet_bootstrap.cc:654] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.330358 4569 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.330359 4592 ts_tablet_manager.cc:1905] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.330405 4569 ts_tablet_manager.cc:1397] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.330552 4569 raft_consensus.cc:357] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.330611 4569 raft_consensus.cc:383] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.330632 4569 raft_consensus.cc:738] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.330672 4569 consensus_queue.cc:260] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.330806 4569 ts_tablet_manager.cc:1428] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.330868 4569 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.331241 4569 tablet_bootstrap.cc:654] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.331704 4551 ts_tablet_manager.cc:1918] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.332048 4592 ts_tablet_manager.cc:1918] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.332105 4592 log.cc:1198] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d190044d103e441193e224c667108543
I20250115 10:12:03.332276 4592 ts_tablet_manager.cc:1939] T d190044d103e441193e224c667108543 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.332594 4569 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.332636 4569 ts_tablet_manager.cc:1397] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.332813 4569 raft_consensus.cc:357] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.332877 4569 raft_consensus.cc:383] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.332906 4569 raft_consensus.cc:738] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.332945 4569 consensus_queue.cc:260] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.332983 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d190044d103e441193e224c667108543 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]) successfully deleted
I20250115 10:12:03.333066 4569 ts_tablet_manager.cc:1428] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.333141 4569 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.333689 4569 tablet_bootstrap.cc:654] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.333738 4551 log.cc:1198] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/5461620a4b644906ad7d9694dfc80177
I20250115 10:12:03.334019 4551 ts_tablet_manager.cc:1939] T 5461620a4b644906ad7d9694dfc80177 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.335256 4569 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.335304 4569 ts_tablet_manager.cc:1397] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.335464 4569 raft_consensus.cc:357] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.335526 4569 raft_consensus.cc:383] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.335551 4569 raft_consensus.cc:738] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.335609 4569 consensus_queue.cc:260] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.335742 4569 ts_tablet_manager.cc:1428] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.335811 4569 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:03.335897 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:03.336241 4569 tablet_bootstrap.cc:654] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.336352 4338 raft_consensus.cc:491] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.336400 4338 raft_consensus.cc:513] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.336519 4338 leader_election.cc:290] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.336725 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.336771 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.337211 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]) successfully deleted
W20250115 10:12:03.337391 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 166e6390660c485c99b2e115fd1b272f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 166e6390660c485c99b2e115fd1b272f already in progress: creating tablet
W20250115 10:12:03.337452 3484 leader_election.cc:343] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.337599 3485 leader_election.cc:343] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.337630 3485 leader_election.cc:304] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:03.337574 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 57d3800d79794d3bad6c50d2dc8e9258 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 57d3800d79794d3bad6c50d2dc8e9258 already in progress: creating tablet
I20250115 10:12:03.337693 4338 raft_consensus.cc:2743] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.337919 4557 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.337971 4557 ts_tablet_manager.cc:1397] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20250115 10:12:03.338078 4569 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.338130 4569 ts_tablet_manager.cc:1397] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.338140 4557 raft_consensus.cc:357] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.338199 4557 raft_consensus.cc:383] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.338220 4557 raft_consensus.cc:738] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.338259 4557 consensus_queue.cc:260] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.338264 4569 raft_consensus.cc:357] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.338318 4569 raft_consensus.cc:383] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.338339 4569 raft_consensus.cc:738] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.338356 4557 ts_tablet_manager.cc:1428] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.338388 4569 consensus_queue.cc:260] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.338426 4557 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.338480 4569 ts_tablet_manager.cc:1428] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.338537 4569 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.338837 4557 tablet_bootstrap.cc:654] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.338912 4569 tablet_bootstrap.cc:654] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.339195 4575 tablet_bootstrap.cc:492] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.339246 4575 ts_tablet_manager.cc:1397] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:12:03.339395 4575 raft_consensus.cc:357] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.339449 4575 raft_consensus.cc:383] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.339466 4575 raft_consensus.cc:738] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.339498 4575 consensus_queue.cc:260] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:03.339607 4575 ts_tablet_manager.cc:1428] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.339690 4575 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.340107 4575 tablet_bootstrap.cc:654] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.341073 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 5461620a4b644906ad7d9694dfc80177 with delete_type TABLET_DATA_DELETED (replaced by tablet 31964c90876c4d289d68b6be6ebb8c12) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.341364 4592 tablet_replica.cc:331] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.341421 4592 raft_consensus.cc:2238] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.341456 4592 raft_consensus.cc:2267] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.342193 4592 ts_tablet_manager.cc:1905] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.343851 4592 ts_tablet_manager.cc:1918] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.344013 4592 log.cc:1198] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/5461620a4b644906ad7d9694dfc80177
I20250115 10:12:03.344034 4569 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.344076 4569 ts_tablet_manager.cc:1397] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:03.344332 4569 raft_consensus.cc:357] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.344393 4569 raft_consensus.cc:383] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.344415 4569 raft_consensus.cc:738] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.344453 4569 consensus_queue.cc:260] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.344477 4592 ts_tablet_manager.cc:1939] T 5461620a4b644906ad7d9694dfc80177 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.344542 4569 ts_tablet_manager.cc:1428] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.344607 4569 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.344875 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 5461620a4b644906ad7d9694dfc80177 (table default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]) successfully deleted
I20250115 10:12:03.345022 4569 tablet_bootstrap.cc:654] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.345252 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.345924 4557 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.345969 4557 ts_tablet_manager.cc:1397] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:03.346148 4557 raft_consensus.cc:357] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.346221 4557 raft_consensus.cc:383] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.346246 4557 raft_consensus.cc:738] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.346294 4557 consensus_queue.cc:260] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.346411 4557 ts_tablet_manager.cc:1428] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.346499 4557 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.347081 4557 tablet_bootstrap.cc:654] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.347306 4551 tablet_replica.cc:331] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.347426 4551 raft_consensus.cc:2238] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.347503 4551 raft_consensus.cc:2267] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.347736 4551 ts_tablet_manager.cc:1905] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.347944 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.348785 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.349436 4551 ts_tablet_manager.cc:1918] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.349524 4551 log.cc:1198] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3b89df9f987e46ae98fe21df847cb311
I20250115 10:12:03.349725 4551 ts_tablet_manager.cc:1939] T 3b89df9f987e46ae98fe21df847cb311 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.350281 4569 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.350327 4569 ts_tablet_manager.cc:1397] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:03.350468 4569 raft_consensus.cc:357] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.350474 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3b89df9f987e46ae98fe21df847cb311 (table default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]) successfully deleted
I20250115 10:12:03.350524 4569 raft_consensus.cc:383] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.350546 4569 raft_consensus.cc:738] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.350584 4569 consensus_queue.cc:260] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.350670 4569 ts_tablet_manager.cc:1428] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.350742 4569 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.350868 4557 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.350908 4557 ts_tablet_manager.cc:1397] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:03.351060 4557 raft_consensus.cc:357] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.351119 4557 raft_consensus.cc:383] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.351132 4569 tablet_bootstrap.cc:654] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.351143 4557 raft_consensus.cc:738] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.351186 4557 consensus_queue.cc:260] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.351272 4557 ts_tablet_manager.cc:1428] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.351342 4557 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.351745 4557 tablet_bootstrap.cc:654] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.352905 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.352989 4589 tablet_replica.cc:331] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.353037 4589 raft_consensus.cc:2238] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.353067 4589 raft_consensus.cc:2267] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.354503 3770 raft_consensus.cc:491] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.354564 3770 raft_consensus.cc:513] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.354686 3770 leader_election.cc:290] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.354873 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.355046 3214 leader_election.cc:343] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.355332 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.356096 3215 leader_election.cc:343] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.356149 3215 leader_election.cc:304] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.356284 3770 raft_consensus.cc:2743] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.356535 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_cf11404b146e4e1e8d59cb7501344676"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.356670 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf11404b146e4e1e8d59cb7501344676 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.356830 4589 ts_tablet_manager.cc:1905] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.358389 4589 ts_tablet_manager.cc:1918] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.358444 4589 log.cc:1198] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:03.358604 4589 ts_tablet_manager.cc:1939] T 65a0bd78c1e7409bb41392fd8f9a0862 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.358944 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_058d5ec95f2a468ab9d1edf25995bdd8" } modify_external_catalogs: true
I20250115 10:12:03.359019 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_058d5ec95f2a468ab9d1edf25995bdd8" } modify_external_catalogs: true
I20250115 10:12:03.359238 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d60729676fcc4f469e553b563bb6bafa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.359333 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d60729676fcc4f469e553b563bb6bafa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.359470 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1069ce4193974a938cb848fe3f45dfd0" } new_table_name: "default.Table_3a151d1a3a4f4bd89f2a1fec8a3caf42" modify_external_catalogs: true
I20250115 10:12:03.359627 4469 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_87580f504cf74904bf2cb93d6da42508"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.359705 4469 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87580f504cf74904bf2cb93d6da42508 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.359886 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8b385a7b3a744493997a54d2dcee22a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.359961 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b385a7b3a744493997a54d2dcee22a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.360076 4476 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19a1534e02374361911915480570557f" } modify_external_catalogs: true
I20250115 10:12:03.360113 4476 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19a1534e02374361911915480570557f" } modify_external_catalogs: true
I20250115 10:12:03.360285 4470 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_36a2b6b01e684edb9cd4c0f11317ea56" } modify_external_catalogs: true
I20250115 10:12:03.360323 4470 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_36a2b6b01e684edb9cd4c0f11317ea56" } modify_external_catalogs: true
I20250115 10:12:03.360479 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_851c083093634347bbad8d5400264cc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.360551 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_851c083093634347bbad8d5400264cc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.360661 4557 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.360704 4557 ts_tablet_manager.cc:1397] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:03.360862 4557 raft_consensus.cc:357] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.360936 4557 raft_consensus.cc:383] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.360957 4557 raft_consensus.cc:738] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.361006 4557 consensus_queue.cc:260] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.361115 4557 ts_tablet_manager.cc:1428] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.361187 4557 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.361596 4557 tablet_bootstrap.cc:654] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.362211 3770 raft_consensus.cc:491] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.362264 3770 raft_consensus.cc:513] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.362375 3770 leader_election.cc:290] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.362603 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.362828 3214 leader_election.cc:343] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.362848 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_eb6dbc05842d4cf1b1930201f8cecc7a" } modify_external_catalogs: true
I20250115 10:12:03.362901 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_eb6dbc05842d4cf1b1930201f8cecc7a" } modify_external_catalogs: true
I20250115 10:12:03.363004 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.363577 4569 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.363619 4569 ts_tablet_manager.cc:1397] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s
W20250115 10:12:03.363976 3215 leader_election.cc:343] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.364051 3215 leader_election.cc:304] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.364131 3770 raft_consensus.cc:2743] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.364058 4569 raft_consensus.cc:357] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.364509 4569 raft_consensus.cc:383] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.364533 4569 raft_consensus.cc:738] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.364586 4569 consensus_queue.cc:260] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.364717 4569 ts_tablet_manager.cc:1428] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.364800 4569 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.365242 4569 tablet_bootstrap.cc:654] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.366466 3770 raft_consensus.cc:491] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.366520 4569 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.366518 3770 raft_consensus.cc:513] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.366590 4569 ts_tablet_manager.cc:1397] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.366663 3770 leader_election.cc:290] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.366784 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.366878 3415 raft_consensus.cc:2463] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.367002 3214 leader_election.cc:304] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.366992 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.367069 3770 raft_consensus.cc:2798] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.367071 3549 raft_consensus.cc:2463] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.367095 3770 raft_consensus.cc:491] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.367136 3770 raft_consensus.cc:3054] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.368036 3770 raft_consensus.cc:513] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.368167 3770 leader_election.cc:290] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.368325 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.368417 3415 raft_consensus.cc:3054] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.368646 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b251ef905b74375bd9b387cc8b057c0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.368718 3549 raft_consensus.cc:3054] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.369202 3415 raft_consensus.cc:2463] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.369393 3214 leader_election.cc:304] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.369449 3549 raft_consensus.cc:2463] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.369462 3770 raft_consensus.cc:2798] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.369496 3770 raft_consensus.cc:695] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.369537 3770 consensus_queue.cc:237] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.369921 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f76bbfe3db904a49b8b83f2aa695931b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.370051 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f76bbfe3db904a49b8b83f2aa695931b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.370159 4569 raft_consensus.cc:357] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.370232 4569 raft_consensus.cc:383] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.370256 4569 raft_consensus.cc:738] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.370674 4569 consensus_queue.cc:260] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.370911 4569 ts_tablet_manager.cc:1428] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:03.370975 4569 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.371241 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 65a0bd78c1e7409bb41392fd8f9a0862 (table default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]) successfully deleted
I20250115 10:12:03.371776 4569 tablet_bootstrap.cc:654] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.372895 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 367694b5edf143ef81e99e348543659a
I20250115 10:12:03.373647 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 367694b5edf143ef81e99e348543659a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.373847 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 367694b5edf143ef81e99e348543659a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367694b5edf143ef81e99e348543659a already in progress: creating tablet
I20250115 10:12:03.374184 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 367694b5edf143ef81e99e348543659a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.374223 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 367694b5edf143ef81e99e348543659a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.374868 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 367694b5edf143ef81e99e348543659a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367694b5edf143ef81e99e348543659a already in progress: creating tablet
W20250115 10:12:03.374902 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36b19ae7373c4de688ae30eb7e1d9eab consensus state has no leader
W20250115 10:12:03.374989 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 367694b5edf143ef81e99e348543659a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 367694b5edf143ef81e99e348543659a already in progress: creating tablet
I20250115 10:12:03.375671 4338 raft_consensus.cc:491] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.375748 4338 raft_consensus.cc:513] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.375895 4338 leader_election.cc:290] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.376209 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.376283 3278 raft_consensus.cc:2463] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.376283 4476 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0e033d609eef46a792b1a568ec2936de
I20250115 10:12:03.376446 3485 leader_election.cc:304] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.376518 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e033d609eef46a792b1a568ec2936de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.376600 4338 raft_consensus.cc:2798] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.376644 4338 raft_consensus.cc:491] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.376668 4338 raft_consensus.cc:3054] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.376688 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 0e033d609eef46a792b1a568ec2936de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e033d609eef46a792b1a568ec2936de already in progress: creating tablet
I20250115 10:12:03.376794 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.377032 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 616166bc9d5d4651999b1d2e0a1851bb
I20250115 10:12:03.377269 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.377462 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 616166bc9d5d4651999b1d2e0a1851bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 616166bc9d5d4651999b1d2e0a1851bb already in progress: creating tablet
I20250115 10:12:03.377492 4338 raft_consensus.cc:513] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.377601 4338 leader_election.cc:290] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.377830 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.377902 3278 raft_consensus.cc:3054] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.378055 4468 catalog_manager.cc:5526] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.378161 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.378340 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2416abb545854c57852bd1080ef3f640"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.378427 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2416abb545854c57852bd1080ef3f640 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.378587 3278 raft_consensus.cc:2463] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.378639 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19e945af3350495ca3abc6261a945770" } modify_external_catalogs: true
I20250115 10:12:03.378685 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19e945af3350495ca3abc6261a945770" } modify_external_catalogs: true
I20250115 10:12:03.378760 3485 leader_election.cc:304] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.379014 3484 leader_election.cc:343] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.379285 4338 raft_consensus.cc:2798] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.379338 4338 raft_consensus.cc:695] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.379379 4338 consensus_queue.cc:237] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.379392 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.379608 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4283a096b18b4be69e1f57e60c3efd3e
W20250115 10:12:03.379745 3484 leader_election.cc:343] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.379782 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.379956 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 4283a096b18b4be69e1f57e60c3efd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4283a096b18b4be69e1f57e60c3efd3e already in progress: creating tablet
I20250115 10:12:03.380280 4472 catalog_manager.cc:5526] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.381408 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.381527 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e033d609eef46a792b1a568ec2936de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.381800 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.382221 3952 raft_consensus.cc:491] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.382274 3952 raft_consensus.cc:513] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.382397 3952 leader_election.cc:290] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.382541 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.382763 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e033d609eef46a792b1a568ec2936de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.382793 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 4283a096b18b4be69e1f57e60c3efd3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.382849 3215 leader_election.cc:343] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.382771 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 616166bc9d5d4651999b1d2e0a1851bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.383234 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.383575 3214 leader_election.cc:343] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.383625 3214 leader_election.cc:304] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:03.383642 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 0e033d609eef46a792b1a568ec2936de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e033d609eef46a792b1a568ec2936de already in progress: creating tablet
W20250115 10:12:03.383703 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 4283a096b18b4be69e1f57e60c3efd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4283a096b18b4be69e1f57e60c3efd3e already in progress: creating tablet
W20250115 10:12:03.383802 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 616166bc9d5d4651999b1d2e0a1851bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 616166bc9d5d4651999b1d2e0a1851bb already in progress: creating tablet
W20250115 10:12:03.383878 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 616166bc9d5d4651999b1d2e0a1851bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 616166bc9d5d4651999b1d2e0a1851bb already in progress: creating tablet
W20250115 10:12:03.384174 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 0e033d609eef46a792b1a568ec2936de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0e033d609eef46a792b1a568ec2936de already in progress: creating tablet
W20250115 10:12:03.384284 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 4283a096b18b4be69e1f57e60c3efd3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4283a096b18b4be69e1f57e60c3efd3e already in progress: creating tablet
I20250115 10:12:03.384706 3952 raft_consensus.cc:2743] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.386025 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:03.386229 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet f3cba581c6884fd98503d4883b09d4a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.386327 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet f3cba581c6884fd98503d4883b09d4a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:03.386502 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f3cba581c6884fd98503d4883b09d4a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cba581c6884fd98503d4883b09d4a6 already in progress: creating tablet
I20250115 10:12:03.386663 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet f3cba581c6884fd98503d4883b09d4a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.386715 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f3cba581c6884fd98503d4883b09d4a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cba581c6884fd98503d4883b09d4a6 already in progress: creating tablet
W20250115 10:12:03.387122 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f3cba581c6884fd98503d4883b09d4a6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f3cba581c6884fd98503d4883b09d4a6 already in progress: creating tablet
I20250115 10:12:03.387979 4433 raft_consensus.cc:491] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.388048 4433 raft_consensus.cc:513] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.388175 4433 leader_election.cc:290] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.388375 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.388388 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.388577 3484 leader_election.cc:343] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.388654 3485 leader_election.cc:343] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.388688 3485 leader_election.cc:304] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.388756 4433 raft_consensus.cc:2743] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.389747 4575 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.389804 4575 ts_tablet_manager.cc:1397] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.050s user 0.001s sys 0.000s
I20250115 10:12:03.389981 4575 raft_consensus.cc:357] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.390051 4575 raft_consensus.cc:383] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.390071 4575 raft_consensus.cc:738] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.390115 4575 consensus_queue.cc:260] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.390214 4575 ts_tablet_manager.cc:1428] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.390275 4575 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.390846 4575 tablet_bootstrap.cc:654] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.391551 4433 raft_consensus.cc:491] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.391595 4433 raft_consensus.cc:513] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.391695 4433 leader_election.cc:290] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.391914 4569 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.391956 4569 ts_tablet_manager.cc:1397] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:03.392092 4569 raft_consensus.cc:357] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.392153 4569 raft_consensus.cc:383] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.392176 4569 raft_consensus.cc:738] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.392215 4569 consensus_queue.cc:260] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.392241 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.392316 4569 ts_tablet_manager.cc:1428] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.392387 4569 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.392418 4575 tablet_bootstrap.cc:492] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.392424 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.392457 4575 ts_tablet_manager.cc:1397] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.392606 4575 raft_consensus.cc:357] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.392663 4575 raft_consensus.cc:383] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.392681 4575 raft_consensus.cc:738] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.392741 4575 consensus_queue.cc:260] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.392822 4575 ts_tablet_manager.cc:1428] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.392854 4569 tablet_bootstrap.cc:654] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.392884 4575 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.393333 4575 tablet_bootstrap.cc:654] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.393352 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:03.393922 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
W20250115 10:12:03.394485 3484 leader_election.cc:343] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.394723 4575 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.394765 4575 ts_tablet_manager.cc:1397] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.395021 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]). Expected version 1 got 0
I20250115 10:12:03.395011 4575 raft_consensus.cc:357] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.395076 4575 raft_consensus.cc:383] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.395097 4575 raft_consensus.cc:738] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.395143 4575 consensus_queue.cc:260] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.395275 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.395704 3485 leader_election.cc:343] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.395771 3485 leader_election.cc:304] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.395924 4433 raft_consensus.cc:2743] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.396008 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.396080 4575 ts_tablet_manager.cc:1428] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.396520 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.396549 4575 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.397078 4575 tablet_bootstrap.cc:654] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.397747 4569 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.397804 4569 ts_tablet_manager.cc:1397] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:03.397964 4569 raft_consensus.cc:357] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.398031 4569 raft_consensus.cc:383] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.398056 4569 raft_consensus.cc:738] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.398108 4569 consensus_queue.cc:260] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.398211 4569 ts_tablet_manager.cc:1428] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.398308 4569 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.398706 4569 tablet_bootstrap.cc:654] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.400090 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet f9256780f6e94b7ebd1276df07baf19d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:02 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.400199 4589 tablet_replica.cc:331] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.400245 4589 raft_consensus.cc:2238] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.400278 4589 raft_consensus.cc:2267] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.400650 4589 ts_tablet_manager.cc:1905] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.401546 4557 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.401599 4557 ts_tablet_manager.cc:1397] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.001s
I20250115 10:12:03.401752 4557 raft_consensus.cc:357] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.401814 4557 raft_consensus.cc:383] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.401835 4557 raft_consensus.cc:738] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.401876 4557 consensus_queue.cc:260] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.402005 4557 ts_tablet_manager.cc:1428] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.402091 4557 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.402215 4589 ts_tablet_manager.cc:1918] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.402256 4589 log.cc:1198] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:03.402428 4589 ts_tablet_manager.cc:1939] T f9256780f6e94b7ebd1276df07baf19d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.402700 4557 tablet_bootstrap.cc:654] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.403385 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f9256780f6e94b7ebd1276df07baf19d (table default.Table_6bf1b753120b4945929a94625d231802 [id=f328a452d1ed438e90da732586939ede]) successfully deleted
I20250115 10:12:03.406267 4557 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.406317 4557 ts_tablet_manager.cc:1397] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.406466 4557 raft_consensus.cc:357] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.406514 4557 raft_consensus.cc:383] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.406536 4557 raft_consensus.cc:738] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.406574 4557 consensus_queue.cc:260] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.406677 4557 ts_tablet_manager.cc:1428] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.406782 4557 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.407186 4557 tablet_bootstrap.cc:654] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.407269 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 10112ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:03.408155 4569 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.408200 4569 ts_tablet_manager.cc:1397] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:03.408365 4569 raft_consensus.cc:357] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.408423 4569 raft_consensus.cc:383] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.408445 4569 raft_consensus.cc:738] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.408481 4569 consensus_queue.cc:260] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.408579 4569 ts_tablet_manager.cc:1428] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.408856 4569 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.409251 4569 tablet_bootstrap.cc:654] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.413632 4433 raft_consensus.cc:491] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.413689 4433 raft_consensus.cc:513] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.413800 4569 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.413805 4433 leader_election.cc:290] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.413842 4569 ts_tablet_manager.cc:1397] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:03.413962 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.413977 4569 raft_consensus.cc:357] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.414036 4569 raft_consensus.cc:383] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.414057 4569 raft_consensus.cc:738] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.414093 4569 consensus_queue.cc:260] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.414125 3484 leader_election.cc:343] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.414186 4569 ts_tablet_manager.cc:1428] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.414239 4569 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.414283 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.414479 3485 leader_election.cc:343] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.414520 3485 leader_election.cc:304] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.414592 4433 raft_consensus.cc:2743] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.414613 4569 tablet_bootstrap.cc:654] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.414857 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:03.415098 3770 raft_consensus.cc:491] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.415143 3770 raft_consensus.cc:513] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.415287 3770 leader_election.cc:290] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.415472 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.415632 3215 leader_election.cc:343] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.415757 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.416007 3214 leader_election.cc:343] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.416059 3214 leader_election.cc:304] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.416168 3770 raft_consensus.cc:2743] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.416647 4575 tablet_bootstrap.cc:492] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.416824 4575 ts_tablet_manager.cc:1397] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.000s
I20250115 10:12:03.417243 4557 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.417304 4557 ts_tablet_manager.cc:1397] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.417332 4575 raft_consensus.cc:357] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.417426 4575 raft_consensus.cc:383] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.417454 4575 raft_consensus.cc:738] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.417480 4557 raft_consensus.cc:357] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.417526 4575 consensus_queue.cc:260] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.417562 4557 raft_consensus.cc:383] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.417587 4557 raft_consensus.cc:738] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.417665 4557 consensus_queue.cc:260] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.417852 4575 ts_tablet_manager.cc:1428] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.419116 4575 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.420487 4569 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.420531 4569 ts_tablet_manager.cc:1397] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:03.420683 4569 raft_consensus.cc:357] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.420743 4569 raft_consensus.cc:383] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.420774 4569 raft_consensus.cc:738] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.420809 4569 consensus_queue.cc:260] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.420894 4569 ts_tablet_manager.cc:1428] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.420961 4569 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.421201 4575 tablet_bootstrap.cc:654] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.421463 4569 tablet_bootstrap.cc:654] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.421500 4557 ts_tablet_manager.cc:1428] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.422031 3770 raft_consensus.cc:491] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.422071 3770 raft_consensus.cc:513] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.422158 3770 leader_election.cc:290] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.422330 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.422572 3214 leader_election.cc:343] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.422801 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.422993 3215 leader_election.cc:343] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.423056 3215 leader_election.cc:304] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.423127 3770 raft_consensus.cc:2743] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.423419 4557 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.424568 4569 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.424641 4569 ts_tablet_manager.cc:1397] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:03.424794 4569 raft_consensus.cc:357] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.424851 4569 raft_consensus.cc:383] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.424871 4569 raft_consensus.cc:738] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.424907 4569 consensus_queue.cc:260] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.424989 4569 ts_tablet_manager.cc:1428] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.425052 4569 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.425138 4557 tablet_bootstrap.cc:654] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.425499 4569 tablet_bootstrap.cc:654] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.426265 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
W20250115 10:12:03.427539 3484 consensus_peers.cc:487] T 2ba4b779b29841f69fe72527763ab7a1 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ba4b779b29841f69fe72527763ab7a1. This is attempt 11: this message will repeat every 5th retry.
W20250115 10:12:03.428165 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:03.428982 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.429617 4575 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.429703 4575 ts_tablet_manager.cc:1397] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20250115 10:12:03.429896 4575 raft_consensus.cc:357] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.430015 4575 raft_consensus.cc:383] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.430058 4557 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.430076 4575 raft_consensus.cc:738] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.430107 4557 ts_tablet_manager.cc:1397] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.430125 4575 consensus_queue.cc:260] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.430249 4575 ts_tablet_manager.cc:1428] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.430262 4557 raft_consensus.cc:357] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.430328 4557 raft_consensus.cc:383] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.430346 4557 raft_consensus.cc:738] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.430351 4575 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.430380 4557 consensus_queue.cc:260] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.430467 4557 ts_tablet_manager.cc:1428] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.430544 4557 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.430965 4575 tablet_bootstrap.cc:654] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.431092 4557 tablet_bootstrap.cc:654] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.431533 4569 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.431573 4569 ts_tablet_manager.cc:1397] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:03.431704 4569 raft_consensus.cc:357] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.431788 4569 raft_consensus.cc:383] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.431811 4569 raft_consensus.cc:738] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.431850 4569 consensus_queue.cc:260] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.431950 4569 ts_tablet_manager.cc:1428] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.432011 4569 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.432394 4569 tablet_bootstrap.cc:654] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.434648 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.435961 4557 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.436014 4557 ts_tablet_manager.cc:1397] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:03.436177 4557 raft_consensus.cc:357] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.436247 4557 raft_consensus.cc:383] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.436272 4557 raft_consensus.cc:738] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.436309 4557 consensus_queue.cc:260] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.436424 4557 ts_tablet_manager.cc:1428] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.436496 4557 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.436961 4557 tablet_bootstrap.cc:654] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.438963 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.439633 4557 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.439675 4557 ts_tablet_manager.cc:1397] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:03.439865 4557 raft_consensus.cc:357] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.440057 4557 raft_consensus.cc:383] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.440083 4557 raft_consensus.cc:738] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.440140 4557 consensus_queue.cc:260] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.440238 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.440385 4557 ts_tablet_manager.cc:1428] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.440409 4569 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.440456 4557 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.440457 4569 ts_tablet_manager.cc:1397] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:03.440600 4569 raft_consensus.cc:357] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.440660 4569 raft_consensus.cc:383] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.440680 4569 raft_consensus.cc:738] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.440721 4569 consensus_queue.cc:260] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.440821 4557 tablet_bootstrap.cc:654] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.440840 4569 ts_tablet_manager.cc:1428] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.440907 4569 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.441465 4569 tablet_bootstrap.cc:654] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.442023 4575 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.442183 4575 ts_tablet_manager.cc:1397] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20250115 10:12:03.442937 3770 raft_consensus.cc:491] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.442996 3770 raft_consensus.cc:513] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.443094 3484 consensus_peers.cc:487] T c3f88d5d54b74f63a94bf88d3a33cfae P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3f88d5d54b74f63a94bf88d3a33cfae. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.443141 3770 leader_election.cc:290] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.443367 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.443526 3215 leader_election.cc:343] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.444731 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
W20250115 10:12:03.445591 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:03.443289 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.446002 3214 leader_election.cc:343] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.446053 3214 leader_election.cc:304] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.446133 3770 raft_consensus.cc:2743] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:03.446221 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:03.447654 4575 raft_consensus.cc:357] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.447798 4575 raft_consensus.cc:383] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.447826 4575 raft_consensus.cc:738] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.447960 4575 consensus_queue.cc:260] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.449463 4575 ts_tablet_manager.cc:1428] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.451100 4575 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.452462 4575 tablet_bootstrap.cc:654] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.453802 4569 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.453975 4569 ts_tablet_manager.cc:1397] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:03.454232 4569 raft_consensus.cc:357] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.454378 4569 raft_consensus.cc:383] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.454440 4569 raft_consensus.cc:738] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.454537 4569 consensus_queue.cc:260] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.454598 4557 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.454676 4557 ts_tablet_manager.cc:1397] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:03.454931 4557 raft_consensus.cc:357] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.455000 4557 raft_consensus.cc:383] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.455020 4557 raft_consensus.cc:738] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.455065 4557 consensus_queue.cc:260] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.455178 4557 ts_tablet_manager.cc:1428] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:03.455269 4557 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.455761 4557 tablet_bootstrap.cc:654] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.456159 4569 ts_tablet_manager.cc:1428] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.456291 4569 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.456955 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:03.457782 4569 tablet_bootstrap.cc:654] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.457994 4575 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.458475 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:03.458159 4575 ts_tablet_manager.cc:1397] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.459566 4575 raft_consensus.cc:357] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.459818 4575 raft_consensus.cc:383] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.459884 4575 raft_consensus.cc:738] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.459980 4575 consensus_queue.cc:260] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.460757 4575 ts_tablet_manager.cc:1428] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.462109 4575 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.463299 4575 tablet_bootstrap.cc:654] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.464320 3549 raft_consensus.cc:1270] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.464541 3770 consensus_queue.cc:1035] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.465109 4557 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.465168 4557 ts_tablet_manager.cc:1397] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:03.465375 4557 raft_consensus.cc:357] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.465442 4557 raft_consensus.cc:383] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.465464 4557 raft_consensus.cc:738] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.465512 4557 consensus_queue.cc:260] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.465612 4557 ts_tablet_manager.cc:1428] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.465668 4557 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.466113 4557 tablet_bootstrap.cc:654] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.466564 4569 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.466610 4569 ts_tablet_manager.cc:1397] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:03.466764 4569 raft_consensus.cc:357] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.466828 4569 raft_consensus.cc:383] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.466852 4569 raft_consensus.cc:738] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.466885 3415 raft_consensus.cc:1270] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.466897 4569 consensus_queue.cc:260] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.467005 4569 ts_tablet_manager.cc:1428] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.467069 4569 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.467088 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.467494 4569 tablet_bootstrap.cc:654] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.468307 4575 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.468355 4575 ts_tablet_manager.cc:1397] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:03.468509 4575 raft_consensus.cc:357] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.468571 4575 raft_consensus.cc:383] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.468591 4575 raft_consensus.cc:738] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.468632 4575 consensus_queue.cc:260] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.468626 3770 consensus_queue.cc:1035] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.468732 4575 ts_tablet_manager.cc:1428] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.468802 4575 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.469198 4575 tablet_bootstrap.cc:654] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.471186 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 65a0bd78c1e7409bb41392fd8f9a0862 with delete_type TABLET_DATA_DELETED (replaced by tablet d1a8c8ad0ca84fc3aec22cd825579e6d) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.471279 4592 tablet_replica.cc:331] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.471336 4592 raft_consensus.cc:2238] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.471374 4592 raft_consensus.cc:2267] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.472227 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.472669 4575 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.472712 4575 ts_tablet_manager.cc:1397] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:03.472832 4575 raft_consensus.cc:357] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.472908 4575 raft_consensus.cc:383] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.472929 4575 raft_consensus.cc:738] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.472973 4575 consensus_queue.cc:260] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.473063 4575 ts_tablet_manager.cc:1428] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.473107 4575 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.473490 4575 tablet_bootstrap.cc:654] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.474534 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_72f4c7bfce6548c1b69d560a2a7ce10e" } new_table_name: "default.Table_67cce5abd27a4efc98535136874b4b64" modify_external_catalogs: true
I20250115 10:12:03.475193 4592 ts_tablet_manager.cc:1905] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.476940 4592 ts_tablet_manager.cc:1918] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.476991 4592 log.cc:1198] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:03.477160 4592 ts_tablet_manager.cc:1939] T 65a0bd78c1e7409bb41392fd8f9a0862 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
W20250115 10:12:03.477310 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c9e04c866114cefbddc1bdb54d31cff has no consensus state
I20250115 10:12:03.477604 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 65a0bd78c1e7409bb41392fd8f9a0862 (table default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]) successfully deleted
I20250115 10:12:03.479580 4557 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.479635 4557 ts_tablet_manager.cc:1397] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:03.479831 4557 raft_consensus.cc:357] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.479926 4557 raft_consensus.cc:383] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.479950 4557 raft_consensus.cc:738] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.480003 4557 consensus_queue.cc:260] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.480127 4557 ts_tablet_manager.cc:1428] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.480208 4557 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.480647 4557 tablet_bootstrap.cc:654] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.481724 4575 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.481771 4575 ts_tablet_manager.cc:1397] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:03.481930 4575 raft_consensus.cc:357] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.482002 4575 raft_consensus.cc:383] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.482021 4575 raft_consensus.cc:738] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.482061 4575 consensus_queue.cc:260] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.482152 4575 ts_tablet_manager.cc:1428] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.482223 4575 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.482537 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.482784 4575 tablet_bootstrap.cc:654] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.485136 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:12:03.485220 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.485265 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 2cff85958d3c46069b1dd9bf5cb75ca4 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.485904 4557 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.485960 4557 ts_tablet_manager.cc:1397] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:03.486094 4557 raft_consensus.cc:357] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.486166 4557 raft_consensus.cc:383] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.486191 4557 raft_consensus.cc:738] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.486236 4557 consensus_queue.cc:260] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.486340 4557 ts_tablet_manager.cc:1428] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.486436 4557 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.486861 4557 tablet_bootstrap.cc:654] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.488441 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 2cff85958d3c46069b1dd9bf5cb75ca4
I20250115 10:12:03.488540 4473 catalog_manager.cc:6596] ReplaceTablet: tablet 2cff85958d3c46069b1dd9bf5cb75ca4 deleted and replaced by tablet 4ca42518736949a78609ff22b6f5bdce
I20250115 10:12:03.488788 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ca42518736949a78609ff22b6f5bdce) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.488787 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ca42518736949a78609ff22b6f5bdce) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.488821 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 with delete_type TABLET_DATA_DELETED (replaced by tablet 4ca42518736949a78609ff22b6f5bdce) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.489033 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cff85958d3c46069b1dd9bf5cb75ca4 already in progress: creating tablet
W20250115 10:12:03.489085 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cff85958d3c46069b1dd9bf5cb75ca4 already in progress: creating tablet
W20250115 10:12:03.489157 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 2cff85958d3c46069b1dd9bf5cb75ca4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2cff85958d3c46069b1dd9bf5cb75ca4 already in progress: creating tablet
I20250115 10:12:03.489897 4569 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.489953 4569 ts_tablet_manager.cc:1397] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.000s
I20250115 10:12:03.490232 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.490213 4569 raft_consensus.cc:357] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.490281 4569 raft_consensus.cc:383] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.490306 4569 raft_consensus.cc:738] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.490353 4569 consensus_queue.cc:260] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.490468 4569 ts_tablet_manager.cc:1428] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.490545 4569 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.490974 4569 tablet_bootstrap.cc:654] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.491655 4569 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.491700 4569 ts_tablet_manager.cc:1397] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.491849 4569 raft_consensus.cc:357] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.491916 4569 raft_consensus.cc:383] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.491938 4569 raft_consensus.cc:738] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.491981 4569 consensus_queue.cc:260] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.492106 4569 ts_tablet_manager.cc:1428] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.492180 4569 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.492623 4569 tablet_bootstrap.cc:654] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.492841 4662 tablet.cc:1721] T 1b251ef905b74375bd9b387cc8b057c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.493290 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b251ef905b74375bd9b387cc8b057c0 (table default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e]). Expected version 2 got 0
I20250115 10:12:03.493829 4557 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.493876 4557 ts_tablet_manager.cc:1397] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:03.494017 4557 raft_consensus.cc:357] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.494079 4557 raft_consensus.cc:383] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.494098 4557 raft_consensus.cc:738] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.494133 4557 consensus_queue.cc:260] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.494257 4557 ts_tablet_manager.cc:1428] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.494325 4557 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.494752 4557 tablet_bootstrap.cc:654] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.495083 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:03.495658 4667 tablet.cc:1721] T 1b251ef905b74375bd9b387cc8b057c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.497273 4575 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.497320 4575 ts_tablet_manager.cc:1397] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20250115 10:12:03.497375 4569 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.497416 4569 ts_tablet_manager.cc:1397] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:03.497460 4575 raft_consensus.cc:357] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.497526 4575 raft_consensus.cc:383] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.497546 4575 raft_consensus.cc:738] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.497541 4569 raft_consensus.cc:357] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.497596 4569 raft_consensus.cc:383] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.497617 4569 raft_consensus.cc:738] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.497593 4575 consensus_queue.cc:260] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.497669 4569 consensus_queue.cc:260] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.497715 4575 ts_tablet_manager.cc:1428] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.497759 4569 ts_tablet_manager.cc:1428] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.497786 4575 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.497812 4569 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.498193 4575 tablet_bootstrap.cc:654] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.498221 4569 tablet_bootstrap.cc:654] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.498979 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.499269 4575 tablet_bootstrap.cc:492] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.499315 4575 ts_tablet_manager.cc:1397] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.499442 4575 raft_consensus.cc:357] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.499504 4575 raft_consensus.cc:383] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.499524 4575 raft_consensus.cc:738] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.499574 4575 consensus_queue.cc:260] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.499675 4575 ts_tablet_manager.cc:1428] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.499740 4575 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.499831 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.500146 4575 tablet_bootstrap.cc:654] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.500321 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:03.500819 4569 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.500860 4569 ts_tablet_manager.cc:1397] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.500984 4569 raft_consensus.cc:357] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.501055 4569 raft_consensus.cc:383] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.501076 4569 raft_consensus.cc:738] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.501117 4569 consensus_queue.cc:260] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.501232 4569 ts_tablet_manager.cc:1428] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.501308 4569 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.501680 4569 tablet_bootstrap.cc:654] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.503265 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:03.507124 4557 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.507184 4557 ts_tablet_manager.cc:1397] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:03.507345 4557 raft_consensus.cc:357] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.507411 4557 raft_consensus.cc:383] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.507434 4557 raft_consensus.cc:738] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.507481 4557 consensus_queue.cc:260] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.507604 4557 ts_tablet_manager.cc:1428] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.507683 4557 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.507725 4569 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.507727 4575 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.507768 4569 ts_tablet_manager.cc:1397] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.507774 4575 ts_tablet_manager.cc:1397] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:03.507958 4569 raft_consensus.cc:357] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.508020 4569 raft_consensus.cc:383] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.508041 4569 raft_consensus.cc:738] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.508055 4575 raft_consensus.cc:357] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.508076 4569 consensus_queue.cc:260] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.508109 4575 raft_consensus.cc:383] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.508129 4575 raft_consensus.cc:738] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.508157 4569 ts_tablet_manager.cc:1428] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.508167 4575 consensus_queue.cc:260] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.508217 4569 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.508252 4575 ts_tablet_manager.cc:1428] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.508330 4575 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.508342 4557 tablet_bootstrap.cc:654] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.508639 4569 tablet_bootstrap.cc:654] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.508715 4575 tablet_bootstrap.cc:654] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.509958 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.509986 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_9205aa0658d14400a8be6a6ea6b304a4 [id=f97c3096f0bb46e6b362e3cb7f99461e] alter complete (version 2)
I20250115 10:12:03.510345 4338 raft_consensus.cc:491] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.510396 4338 raft_consensus.cc:513] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.510506 4338 leader_election.cc:290] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.511099 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.511267 3484 leader_election.cc:343] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.512799 3214 consensus_peers.cc:487] T f792ae7d54184207825a92d72bc5a323 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f792ae7d54184207825a92d72bc5a323. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.512898 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5a9b7a75ae964db6a818d54d77e2ced1" } new_table_name: "default.Table_e2336efa12724d77804d65cd42e446df" modify_external_catalogs: true
I20250115 10:12:03.513456 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.513527 3278 raft_consensus.cc:2463] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.513509 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4543989449c243fcad6ffbbd87796a81" } new_table_name: "default.Table_8d48bd824ad4478492174f65bbb8e5ea" modify_external_catalogs: true
I20250115 10:12:03.513700 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_253a0050b6cf43e3953c8d5affcbe231"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.513796 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f7f004c0e61c486b82180c7317e3b2cd" } new_table_name: "default.Table_7818a79436444c5a910f62c00aedd41a" modify_external_catalogs: true
W20250115 10:12:03.513821 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_253a0050b6cf43e3953c8d5affcbe231 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.513936 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f043cb2f81ea453b8d2d5c69eb66e609"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.514003 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f043cb2f81ea453b8d2d5c69eb66e609 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.514178 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_7e39e68667ac47acb9e3f14e4bb12ec1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.514250 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:03.514652 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
I20250115 10:12:03.514703 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]). Expected version 1 got 0
I20250115 10:12:03.514788 4476 master_service.cc:946] ReplaceTablet: received request to replace tablet 41e2e034ea974448922f2cb0529bd196 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.515659 3485 leader_election.cc:304] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.515909 4434 raft_consensus.cc:2798] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.515952 4434 raft_consensus.cc:491] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.515971 4434 raft_consensus.cc:3054] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.516862 4434 raft_consensus.cc:513] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.516996 4434 leader_election.cc:290] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.517521 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.517581 3278 raft_consensus.cc:3054] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.518210 3278 raft_consensus.cc:2463] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.518298 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.518514 4470 master_service.cc:946] ReplaceTablet: received request to replace tablet 0c6a04e982ee493d815322ec6b2f267e from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.518518 3485 leader_election.cc:304] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.518559 3484 leader_election.cc:343] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.518695 4338 raft_consensus.cc:2798] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.518774 4338 raft_consensus.cc:695] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.518821 4338 consensus_queue.cc:237] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.519606 4475 catalog_manager.cc:5526] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
W20250115 10:12:03.520292 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a577ace8245744d1a42938ddd99ce89b consensus state has no leader
I20250115 10:12:03.520521 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet cc395ae76a494a8eb682b7ef34dcb169 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:03.520697 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8a357badf1cd43e384d2de92e3413898 consensus state has no leader
W20250115 10:12:03.520823 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d21906d23acc4ab8b81eceb87ead049f consensus state has no leader
I20250115 10:12:03.520913 4476 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:03.520984 4476 catalog_manager.cc:6596] ReplaceTablet: tablet 41e2e034ea974448922f2cb0529bd196 deleted and replaced by tablet 31b8334f3d734968a0a7ba148bd90d72
I20250115 10:12:03.521082 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 41e2e034ea974448922f2cb0529bd196 with delete_type TABLET_DATA_DELETED (replaced by tablet 31b8334f3d734968a0a7ba148bd90d72) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.521101 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 41e2e034ea974448922f2cb0529bd196 with delete_type TABLET_DATA_DELETED (replaced by tablet 31b8334f3d734968a0a7ba148bd90d72) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.521178 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 41e2e034ea974448922f2cb0529bd196 with delete_type TABLET_DATA_DELETED (replaced by tablet 31b8334f3d734968a0a7ba148bd90d72) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.521355 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 41e2e034ea974448922f2cb0529bd196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e2e034ea974448922f2cb0529bd196 already in progress: creating tablet
W20250115 10:12:03.521435 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 41e2e034ea974448922f2cb0529bd196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e2e034ea974448922f2cb0529bd196 already in progress: creating tablet
W20250115 10:12:03.521507 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 41e2e034ea974448922f2cb0529bd196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e2e034ea974448922f2cb0529bd196 already in progress: creating tablet
I20250115 10:12:03.523674 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cc395ae76a494a8eb682b7ef34dcb169
I20250115 10:12:03.523797 4471 catalog_manager.cc:6596] ReplaceTablet: tablet cc395ae76a494a8eb682b7ef34dcb169 deleted and replaced by tablet e90df067a820456db899065f0c04fe6b
I20250115 10:12:03.523869 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0c6a04e982ee493d815322ec6b2f267e
I20250115 10:12:03.523901 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 with delete_type TABLET_DATA_DELETED (replaced by tablet e90df067a820456db899065f0c04fe6b) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.523934 4470 catalog_manager.cc:6596] ReplaceTablet: tablet 0c6a04e982ee493d815322ec6b2f267e deleted and replaced by tablet 2e3186fbc8414cb989481b59e9cae04d
I20250115 10:12:03.523968 4663 tablet.cc:1721] T 1b251ef905b74375bd9b387cc8b057c0 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.523984 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 with delete_type TABLET_DATA_DELETED (replaced by tablet e90df067a820456db899065f0c04fe6b) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:03.524082 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet cc395ae76a494a8eb682b7ef34dcb169 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc395ae76a494a8eb682b7ef34dcb169 already in progress: creating tablet
I20250115 10:12:03.524140 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet cc395ae76a494a8eb682b7ef34dcb169 with delete_type TABLET_DATA_DELETED (replaced by tablet e90df067a820456db899065f0c04fe6b) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.524246 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c6a04e982ee493d815322ec6b2f267e with delete_type TABLET_DATA_DELETED (replaced by tablet 2e3186fbc8414cb989481b59e9cae04d) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.524305 4592 tablet_replica.cc:331] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
W20250115 10:12:03.524343 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet cc395ae76a494a8eb682b7ef34dcb169 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc395ae76a494a8eb682b7ef34dcb169 already in progress: creating tablet
I20250115 10:12:03.524349 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c6a04e982ee493d815322ec6b2f267e with delete_type TABLET_DATA_DELETED (replaced by tablet 2e3186fbc8414cb989481b59e9cae04d) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.524358 4592 raft_consensus.cc:2238] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.524390 4592 raft_consensus.cc:2267] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.524400 4551 tablet_replica.cc:331] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.524446 4551 raft_consensus.cc:2238] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.524475 4551 raft_consensus.cc:2267] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.524528 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet cc395ae76a494a8eb682b7ef34dcb169 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cc395ae76a494a8eb682b7ef34dcb169 already in progress: creating tablet
I20250115 10:12:03.524535 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c6a04e982ee493d815322ec6b2f267e with delete_type TABLET_DATA_DELETED (replaced by tablet 2e3186fbc8414cb989481b59e9cae04d) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.524593 4589 tablet_replica.cc:331] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.524648 4589 raft_consensus.cc:2238] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.524677 4589 raft_consensus.cc:2267] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.524919 4592 ts_tablet_manager.cc:1905] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.525976 4470 master_service.cc:946] ReplaceTablet: received request to replace tablet a4af01517cb04be983456a98153f6146 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.526410 4592 ts_tablet_manager.cc:1918] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.526461 4592 log.cc:1198] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/0c6a04e982ee493d815322ec6b2f267e
I20250115 10:12:03.526638 4592 ts_tablet_manager.cc:1939] T 0c6a04e982ee493d815322ec6b2f267e P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.527000 4589 ts_tablet_manager.cc:1905] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.527733 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet a4af01517cb04be983456a98153f6146
I20250115 10:12:03.527819 4470 catalog_manager.cc:6596] ReplaceTablet: tablet a4af01517cb04be983456a98153f6146 deleted and replaced by tablet 61cc55da8a4c4da2b94321a912418747
I20250115 10:12:03.528007 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet a4af01517cb04be983456a98153f6146 with delete_type TABLET_DATA_DELETED (replaced by tablet 61cc55da8a4c4da2b94321a912418747) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.528333 4557 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.528374 4557 ts_tablet_manager.cc:1397] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
W20250115 10:12:03.528409 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:03.528506 4589 ts_tablet_manager.cc:1918] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.528546 4589 log.cc:1198] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/0c6a04e982ee493d815322ec6b2f267e
I20250115 10:12:03.528723 4589 ts_tablet_manager.cc:1939] T 0c6a04e982ee493d815322ec6b2f267e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.528833 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet a4af01517cb04be983456a98153f6146 with delete_type TABLET_DATA_DELETED (replaced by tablet 61cc55da8a4c4da2b94321a912418747) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.528909 4557 raft_consensus.cc:357] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.528987 4557 raft_consensus.cc:383] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.529016 4557 raft_consensus.cc:738] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.529057 4557 consensus_queue.cc:260] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.529088 4551 ts_tablet_manager.cc:1905] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.529150 4557 ts_tablet_manager.cc:1428] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.529228 4557 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.529598 4557 tablet_bootstrap.cc:654] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.529736 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]). Expected version 1 got 0
I20250115 10:12:03.530161 4569 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.530198 4569 ts_tablet_manager.cc:1397] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20250115 10:12:03.530334 4569 raft_consensus.cc:357] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.530398 4569 raft_consensus.cc:383] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.530391 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]). Expected version 1 got 0
I20250115 10:12:03.530422 4569 raft_consensus.cc:738] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.530462 4569 consensus_queue.cc:260] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.530490 4551 ts_tablet_manager.cc:1918] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.530529 4551 log.cc:1198] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/0c6a04e982ee493d815322ec6b2f267e
I20250115 10:12:03.530576 4569 ts_tablet_manager.cc:1428] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.530645 4569 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.530682 4551 ts_tablet_manager.cc:1939] T 0c6a04e982ee493d815322ec6b2f267e P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.530864 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet a4af01517cb04be983456a98153f6146 with delete_type TABLET_DATA_DELETED (replaced by tablet 61cc55da8a4c4da2b94321a912418747) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.531167 4569 tablet_bootstrap.cc:654] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.531213 4551 tablet_replica.cc:331] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.531272 4551 raft_consensus.cc:2238] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.531307 4551 raft_consensus.cc:2267] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.531394 4551 ts_tablet_manager.cc:1905] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.532531 4569 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.532554 4551 ts_tablet_manager.cc:1918] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.532575 4569 ts_tablet_manager.cc:1397] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.532600 4551 log.cc:1198] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/a4af01517cb04be983456a98153f6146
I20250115 10:12:03.532755 4551 ts_tablet_manager.cc:1939] T a4af01517cb04be983456a98153f6146 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.532730 4569 raft_consensus.cc:357] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.532788 4569 raft_consensus.cc:383] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.532809 4569 raft_consensus.cc:738] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.532936 4569 consensus_queue.cc:260] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.533072 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 0c6a04e982ee493d815322ec6b2f267e (table default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]) successfully deleted
I20250115 10:12:03.533265 4569 ts_tablet_manager.cc:1428] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.533368 4592 tablet_replica.cc:331] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.533409 4569 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.533427 4592 raft_consensus.cc:2238] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.533463 4592 raft_consensus.cc:2267] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.533527 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]) successfully deleted
I20250115 10:12:03.533586 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 0c6a04e982ee493d815322ec6b2f267e (table default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]) successfully deleted
I20250115 10:12:03.533924 4592 ts_tablet_manager.cc:1905] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.534159 4569 tablet_bootstrap.cc:654] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.534417 4575 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.534457 4575 ts_tablet_manager.cc:1397] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.000s
I20250115 10:12:03.534590 4575 raft_consensus.cc:357] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.534647 4575 raft_consensus.cc:383] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.534672 4575 raft_consensus.cc:738] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.534713 4569 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.534715 4575 consensus_queue.cc:260] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.534749 4569 ts_tablet_manager.cc:1397] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.534798 4575 ts_tablet_manager.cc:1428] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.534888 4575 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.534873 4569 raft_consensus.cc:357] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.534916 4569 raft_consensus.cc:383] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.534935 4569 raft_consensus.cc:738] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.535477 4569 consensus_queue.cc:260] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.535508 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.535591 4575 tablet_bootstrap.cc:654] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.535640 4569 ts_tablet_manager.cc:1428] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.536240 4589 tablet_replica.cc:331] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.536300 4589 raft_consensus.cc:2238] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.536337 4589 raft_consensus.cc:2267] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.536486 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 0c6a04e982ee493d815322ec6b2f267e (table default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]) successfully deleted
I20250115 10:12:03.536753 4589 ts_tablet_manager.cc:1905] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.536906 4575 tablet_bootstrap.cc:492] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.536942 4575 ts_tablet_manager.cc:1397] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.537086 4575 raft_consensus.cc:357] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.537134 4575 raft_consensus.cc:383] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.537153 4575 raft_consensus.cc:738] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.537190 4575 consensus_queue.cc:260] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.537178 4569 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.537266 4575 ts_tablet_manager.cc:1428] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.537339 4575 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.537720 4575 tablet_bootstrap.cc:654] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.537982 4569 tablet_bootstrap.cc:654] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.538184 4589 ts_tablet_manager.cc:1918] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.538232 4589 log.cc:1198] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/a4af01517cb04be983456a98153f6146
I20250115 10:12:03.538403 4589 ts_tablet_manager.cc:1939] T a4af01517cb04be983456a98153f6146 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.538419 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.538444 4575 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.538481 4575 ts_tablet_manager.cc:1397] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.538753 4575 raft_consensus.cc:357] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.538803 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:03.538825 4575 raft_consensus.cc:383] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.538856 4575 raft_consensus.cc:738] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.538884 4575 consensus_queue.cc:260] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.538965 4575 ts_tablet_manager.cc:1428] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.539042 4575 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.536350 4592 ts_tablet_manager.cc:1918] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.539484 4575 tablet_bootstrap.cc:654] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.539512 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.539628 4589 tablet_replica.cc:331] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.539680 4589 raft_consensus.cc:2238] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.539707 4589 raft_consensus.cc:2267] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.540026 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]) successfully deleted
I20250115 10:12:03.539489 4592 log.cc:1198] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/a4af01517cb04be983456a98153f6146
I20250115 10:12:03.540319 4592 ts_tablet_manager.cc:1939] T a4af01517cb04be983456a98153f6146 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.540725 4589 ts_tablet_manager.cc:1905] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.541436 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet a4af01517cb04be983456a98153f6146 (table default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]) successfully deleted
I20250115 10:12:03.541729 4575 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.541782 4575 ts_tablet_manager.cc:1397] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.541949 4575 raft_consensus.cc:357] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.542028 4575 raft_consensus.cc:383] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.542052 4575 raft_consensus.cc:738] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.542100 4575 consensus_queue.cc:260] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.542186 4575 ts_tablet_manager.cc:1428] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.542256 4575 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.542440 4569 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.542479 4569 ts_tablet_manager.cc:1397] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20250115 10:12:03.542605 4569 raft_consensus.cc:357] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.542673 4575 tablet_bootstrap.cc:654] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.542706 4569 raft_consensus.cc:383] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.542730 4569 raft_consensus.cc:738] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.542768 4569 consensus_queue.cc:260] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.542786 4589 ts_tablet_manager.cc:1918] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.542855 4589 log.cc:1198] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/21d5a121a87648ecbb842f52bc361602
I20250115 10:12:03.542881 4569 ts_tablet_manager.cc:1428] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.542951 4569 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.543285 4589 ts_tablet_manager.cc:1939] T 21d5a121a87648ecbb842f52bc361602 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.543368 4557 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.543417 4557 ts_tablet_manager.cc:1397] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:03.543459 4569 tablet_bootstrap.cc:654] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.543563 4557 raft_consensus.cc:357] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.543623 4557 raft_consensus.cc:383] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:03.543613 3214 consensus_peers.cc:487] T 4727b40e9db4460b826fcc1ca67c9c8f P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4727b40e9db4460b826fcc1ca67c9c8f. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.543645 4557 raft_consensus.cc:738] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.543690 4557 consensus_queue.cc:260] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.543810 4557 ts_tablet_manager.cc:1428] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:03.543905 4557 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.544348 4557 tablet_bootstrap.cc:654] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.544360 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]) successfully deleted
I20250115 10:12:03.545025 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.545733 4557 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.545782 4557 ts_tablet_manager.cc:1397] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
W20250115 10:12:03.545810 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:12:03.545949 4557 raft_consensus.cc:357] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.546013 4557 raft_consensus.cc:383] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.546037 4557 raft_consensus.cc:738] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.546082 4557 consensus_queue.cc:260] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.546185 4557 ts_tablet_manager.cc:1428] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.546241 4557 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.546687 4557 tablet_bootstrap.cc:654] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.547537 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:03.547605 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.547752 4569 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.547793 4569 ts_tablet_manager.cc:1397] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:03.547930 4575 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.547919 4569 raft_consensus.cc:357] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.547982 4575 ts_tablet_manager.cc:1397] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.547989 4569 raft_consensus.cc:383] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.548022 4569 raft_consensus.cc:738] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.548058 4569 consensus_queue.cc:260] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.548134 4569 ts_tablet_manager.cc:1428] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.548106 4575 raft_consensus.cc:357] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.548166 4575 raft_consensus.cc:383] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.548187 4575 raft_consensus.cc:738] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.548202 4569 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.548220 4575 consensus_queue.cc:260] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.548285 4575 ts_tablet_manager.cc:1428] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.548341 4575 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.548595 4569 tablet_bootstrap.cc:654] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.548715 4557 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.548740 4575 tablet_bootstrap.cc:654] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.548755 4557 ts_tablet_manager.cc:1397] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:03.548902 4557 raft_consensus.cc:357] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.548956 4557 raft_consensus.cc:383] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.548980 4557 raft_consensus.cc:738] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.549023 4557 consensus_queue.cc:260] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.549103 4557 ts_tablet_manager.cc:1428] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.549147 4557 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.549546 4557 tablet_bootstrap.cc:654] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.549816 4575 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.549868 4575 ts_tablet_manager.cc:1397] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.549925 4587 raft_consensus.cc:491] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.549981 4575 raft_consensus.cc:357] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.549969 4587 raft_consensus.cc:513] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.550029 4575 raft_consensus.cc:383] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.550045 4575 raft_consensus.cc:738] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.550081 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.550077 4575 consensus_queue.cc:260] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.550086 4587 leader_election.cc:290] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.550204 4575 ts_tablet_manager.cc:1428] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.550521 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def9cfbc6f764499b1c6ac9b6845f5ed" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.550588 3549 raft_consensus.cc:2463] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.550661 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def9cfbc6f764499b1c6ac9b6845f5ed" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.550721 3278 raft_consensus.cc:2463] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.550732 3350 leader_election.cc:304] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.550809 4575 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.551069 4587 raft_consensus.cc:2798] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.551115 4587 raft_consensus.cc:491] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.551137 4587 raft_consensus.cc:3054] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.551191 4575 tablet_bootstrap.cc:654] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.551950 4587 raft_consensus.cc:513] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.552049 4587 leader_election.cc:290] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.552085 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:03.552320 4575 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.552359 4575 ts_tablet_manager.cc:1397] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.552467 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def9cfbc6f764499b1c6ac9b6845f5ed" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:03.552506 3214 consensus_peers.cc:487] T 0f4dc0c74f2e43db8b87446a236771f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f4dc0c74f2e43db8b87446a236771f2. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.552487 4575 raft_consensus.cc:357] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.552551 3549 raft_consensus.cc:3054] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.552559 4575 raft_consensus.cc:383] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.552582 4575 raft_consensus.cc:738] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.552632 4575 consensus_queue.cc:260] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.552728 4575 ts_tablet_manager.cc:1428] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.552788 4575 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.552963 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:03.553172 4575 tablet_bootstrap.cc:654] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.553328 3549 raft_consensus.cc:2463] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.553540 4335 consensus_queue.cc:1035] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.553586 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "def9cfbc6f764499b1c6ac9b6845f5ed" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.553654 3278 raft_consensus.cc:3054] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.554155 3350 leader_election.cc:304] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.554318 3278 raft_consensus.cc:2463] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.554678 4587 raft_consensus.cc:2798] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.554733 4587 raft_consensus.cc:695] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.554782 4587 consensus_queue.cc:237] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.555445 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:03.555495 4471 catalog_manager.cc:5526] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.555586 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
W20250115 10:12:03.556203 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:03.556751 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:12:03.558045 4575 tablet_bootstrap.cc:492] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.558092 4575 ts_tablet_manager.cc:1397] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:03.558207 4575 raft_consensus.cc:357] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.558267 4575 raft_consensus.cc:383] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.558295 4575 raft_consensus.cc:738] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.558334 4575 consensus_queue.cc:260] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.558418 4575 ts_tablet_manager.cc:1428] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.558502 4575 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.558676 4569 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.558713 4569 ts_tablet_manager.cc:1397] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.000s
I20250115 10:12:03.558867 4569 raft_consensus.cc:357] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.558924 4569 raft_consensus.cc:383] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.558946 4569 raft_consensus.cc:738] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.558995 4575 tablet_bootstrap.cc:654] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.558990 4569 consensus_queue.cc:260] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.559125 4569 ts_tablet_manager.cc:1428] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.559212 4569 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.559330 4557 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.559367 4557 ts_tablet_manager.cc:1397] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:03.559504 4557 raft_consensus.cc:357] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.559554 4557 raft_consensus.cc:383] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.559571 4557 raft_consensus.cc:738] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.559605 4569 tablet_bootstrap.cc:654] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.559617 4557 consensus_queue.cc:260] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.559721 4557 ts_tablet_manager.cc:1428] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.559783 4557 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.560312 4557 tablet_bootstrap.cc:654] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.560719 4575 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.560765 4575 ts_tablet_manager.cc:1397] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.560892 4575 raft_consensus.cc:357] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.560935 4575 raft_consensus.cc:383] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.560950 4575 raft_consensus.cc:738] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.560981 4575 consensus_queue.cc:260] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.561066 4575 ts_tablet_manager.cc:1428] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.561115 4575 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.561478 4575 tablet_bootstrap.cc:654] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.561998 4575 tablet_bootstrap.cc:492] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.562032 4575 ts_tablet_manager.cc:1397] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.562134 4575 raft_consensus.cc:357] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.562181 4575 raft_consensus.cc:383] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.562198 4575 raft_consensus.cc:738] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.562232 4575 consensus_queue.cc:260] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.562300 4575 ts_tablet_manager.cc:1428] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.562347 4575 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.562767 4575 tablet_bootstrap.cc:654] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.562809 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_ccb48e8b4c054186a749ca16ba0e6d1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.562922 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ccb48e8b4c054186a749ca16ba0e6d1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.563796 4575 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.563853 4575 ts_tablet_manager.cc:1397] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.564002 4575 raft_consensus.cc:357] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.564059 4575 raft_consensus.cc:383] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.564078 4575 raft_consensus.cc:738] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.564111 4575 consensus_queue.cc:260] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.564188 4575 ts_tablet_manager.cc:1428] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.564236 4575 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.564692 4575 tablet_bootstrap.cc:654] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.565042 3215 consensus_peers.cc:487] T 2377c27855a64ac7bec95a6d6c5289af P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2377c27855a64ac7bec95a6d6c5289af. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:03.565233 3214 consensus_peers.cc:487] T 2836a492586e489daafc2da719455f39 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.567109 4433 raft_consensus.cc:491] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.567116 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.567165 4433 raft_consensus.cc:513] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.567286 4433 leader_election.cc:290] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.567454 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0ae1ff74cce48ada0a373f9e65508a2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.567551 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0ae1ff74cce48ada0a373f9e65508a2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.567729 3485 leader_election.cc:343] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.567919 3484 leader_election.cc:343] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.567961 3484 leader_election.cc:304] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.568198 4433 raft_consensus.cc:2743] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.568462 4557 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.568508 4557 ts_tablet_manager.cc:1397] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:03.568650 4557 raft_consensus.cc:357] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.568701 4557 raft_consensus.cc:383] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.568719 4557 raft_consensus.cc:738] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.568758 4557 consensus_queue.cc:260] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.568871 4557 ts_tablet_manager.cc:1428] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.568936 4557 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.569315 4557 tablet_bootstrap.cc:654] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.570030 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.570119 4551 tablet_replica.cc:331] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.570163 4551 raft_consensus.cc:2238] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.570195 4551 raft_consensus.cc:2267] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.570035 3549 raft_consensus.cc:1270] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.570264 4569 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.570302 4569 ts_tablet_manager.cc:1397] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.570356 3278 raft_consensus.cc:1270] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.570451 4569 raft_consensus.cc:357] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.570518 4569 raft_consensus.cc:383] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.570539 4569 raft_consensus.cc:738] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.570503 4587 consensus_queue.cc:1035] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.570590 4569 consensus_queue.cc:260] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.570607 4587 consensus_queue.cc:1035] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.570704 4569 ts_tablet_manager.cc:1428] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.570773 4569 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.571281 4569 tablet_bootstrap.cc:654] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.571681 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.572134 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet def9cfbc6f764499b1c6ac9b6845f5ed (table default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74]). Expected version 2 got 0
I20250115 10:12:03.572691 4551 ts_tablet_manager.cc:1905] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.574098 4569 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.574153 4569 ts_tablet_manager.cc:1397] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.574318 4551 ts_tablet_manager.cc:1918] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.574319 4569 raft_consensus.cc:357] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.574373 4551 log.cc:1198] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/21d5a121a87648ecbb842f52bc361602
I20250115 10:12:03.574383 4569 raft_consensus.cc:383] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.574406 4569 raft_consensus.cc:738] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.574415 4657 mvcc.cc:204] Tried to move back new op lower bound from 7114489542941847552 to 7114489542880739328. Current Snapshot: MvccSnapshot[applied={T|T < 7114489542941847552}]
I20250115 10:12:03.574448 4569 consensus_queue.cc:260] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.574476 4667 tablet.cc:1721] T def9cfbc6f764499b1c6ac9b6845f5ed P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.574542 4551 ts_tablet_manager.cc:1939] T 21d5a121a87648ecbb842f52bc361602 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.574553 4569 ts_tablet_manager.cc:1428] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.574607 3952 raft_consensus.cc:491] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.574662 3952 raft_consensus.cc:513] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.574771 3952 leader_election.cc:290] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.575368 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9d52dcd1ccf440018ac9b2aec17bd275" } modify_external_catalogs: true
I20250115 10:12:03.575439 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9d52dcd1ccf440018ac9b2aec17bd275" } modify_external_catalogs: true
I20250115 10:12:03.575424 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f560f9e7e84d47faa147b33495e85055" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.575482 3415 raft_consensus.cc:2463] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.575632 3214 leader_election.cc:304] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.575783 3952 raft_consensus.cc:2798] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.575830 3952 raft_consensus.cc:491] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.575852 3952 raft_consensus.cc:3054] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.575889 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]) successfully deleted
I20250115 10:12:03.576045 4470 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5c52b5a64d154706af4220cc2f273a98" } new_table_name: "default.Table_2bc1f827e44144f4b2bcc3b6a0229a54" modify_external_catalogs: true
I20250115 10:12:03.576015 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8266bc1d98ce401cb7fa4b8a0c775230"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.576159 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8266bc1d98ce401cb7fa4b8a0c775230 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.576514 3952 raft_consensus.cc:513] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.576624 3952 leader_election.cc:290] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.576705 4475 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet 97cfe0b8185b4f96a1d6e03dc1769948
I20250115 10:12:03.576828 4587 raft_consensus.cc:491] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.576884 4587 raft_consensus.cc:513] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.576990 4587 leader_election.cc:290] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.577286 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f560f9e7e84d47faa147b33495e85055" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.577368 3549 raft_consensus.cc:2463] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.577291 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f560f9e7e84d47faa147b33495e85055" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.577670 3550 raft_consensus.cc:3054] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.577883 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.578187 4569 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.578394 3550 raft_consensus.cc:2463] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.578505 4663 tablet.cc:1721] T def9cfbc6f764499b1c6ac9b6845f5ed P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.578588 4569 tablet_bootstrap.cc:654] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.578706 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f560f9e7e84d47faa147b33495e85055" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.578783 3415 raft_consensus.cc:3054] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.579509 3415 raft_consensus.cc:2463] T f560f9e7e84d47faa147b33495e85055 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:03.579555 3350 leader_election.cc:343] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.579730 3214 leader_election.cc:304] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.579809 3770 raft_consensus.cc:491] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.579878 3770 raft_consensus.cc:513] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.580013 3770 leader_election.cc:290] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.580047 3770 raft_consensus.cc:2798] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.580093 3770 raft_consensus.cc:695] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.580135 3770 consensus_queue.cc:237] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.580700 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.580781 3549 raft_consensus.cc:2463] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:03.580909 4470 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c68f61c8b72b4628bba5c52f8025a240 consensus state has no leader
I20250115 10:12:03.580940 3350 leader_election.cc:304] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.581099 4587 raft_consensus.cc:2798] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.581132 4587 raft_consensus.cc:491] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.581149 4587 raft_consensus.cc:3054] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.581552 4470 catalog_manager.cc:5526] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.581756 4587 raft_consensus.cc:513] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.581853 4587 leader_election.cc:290] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.581938 4471 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_1887031edf1a4f3cb19a2050252610be [id=a89a351287fc496289cc72192086be74] alter complete (version 2)
I20250115 10:12:03.582274 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9ff830223c344cf69e9954a3c90c5660"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.582386 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ff830223c344cf69e9954a3c90c5660 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.582537 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c6f8aad96bbc4bed888a43bc23bb7338"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.582608 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6f8aad96bbc4bed888a43bc23bb7338 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.582772 4476 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c0fd8860abb44e408284630ba9b8e7bc" } modify_external_catalogs: true
I20250115 10:12:03.582818 4476 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c0fd8860abb44e408284630ba9b8e7bc" } modify_external_catalogs: true
I20250115 10:12:03.583001 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_196ff2f45dc94ec58c60a08545468524" } modify_external_catalogs: true
I20250115 10:12:03.583045 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_196ff2f45dc94ec58c60a08545468524" } modify_external_catalogs: true
I20250115 10:12:03.583185 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4ef75ebcfb674a44bb6ba3feaa65423d" } modify_external_catalogs: true
I20250115 10:12:03.583233 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4ef75ebcfb674a44bb6ba3feaa65423d" } modify_external_catalogs: true
I20250115 10:12:03.583377 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6784d4c136ef4130ae859c7ec4b4125b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.583473 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6784d4c136ef4130ae859c7ec4b4125b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.583521 4569 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.583555 4569 ts_tablet_manager.cc:1397] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:03.583680 4569 raft_consensus.cc:357] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.583757 4569 raft_consensus.cc:383] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.583777 4569 raft_consensus.cc:738] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.583802 4569 consensus_queue.cc:260] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.583802 4433 raft_consensus.cc:491] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.583851 4433 raft_consensus.cc:513] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.583900 4569 ts_tablet_manager.cc:1428] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.583950 4569 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.583964 4433 leader_election.cc:290] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.584008 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_7366f53944e44236ba5b92823f51d82b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.584093 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7366f53944e44236ba5b92823f51d82b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.584219 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.584281 3278 raft_consensus.cc:2463] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.584359 4569 tablet_bootstrap.cc:654] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.584384 3485 leader_election.cc:304] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.584481 4433 raft_consensus.cc:2798] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.584513 4433 raft_consensus.cc:491] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.584533 4433 raft_consensus.cc:3054] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.584641 4557 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.584676 4557 ts_tablet_manager.cc:1397] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250115 10:12:03.584818 4557 raft_consensus.cc:357] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.584867 4557 raft_consensus.cc:383] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.584887 4557 raft_consensus.cc:738] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.584921 4557 consensus_queue.cc:260] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.585023 4557 ts_tablet_manager.cc:1428] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.585088 4557 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.585242 4433 raft_consensus.cc:513] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.585350 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.585445 3549 raft_consensus.cc:3054] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.585508 4557 tablet_bootstrap.cc:654] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.586138 3549 raft_consensus.cc:2463] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.586380 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.586441 3278 raft_consensus.cc:3054] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.586918 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9ccaf4cf30e9496ca64bf2f7cd44de56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.587023 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ccaf4cf30e9496ca64bf2f7cd44de56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.587049 3278 raft_consensus.cc:2463] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.587150 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.587437 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3ae844209e2b49ceaed3f8446ee9a1bd" } modify_external_catalogs: true
I20250115 10:12:03.587493 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3ae844209e2b49ceaed3f8446ee9a1bd" } modify_external_catalogs: true
I20250115 10:12:03.587807 3485 leader_election.cc:304] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.587850 4469 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:03.587918 4338 raft_consensus.cc:2798] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.587965 4338 raft_consensus.cc:695] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.588016 4338 consensus_queue.cc:237] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.588179 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet b7a6ec9020494019a32cfb428554bd07
I20250115 10:12:03.588299 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:03.588371 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a6ec9020494019a32cfb428554bd07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.588415 4476 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:03.588614 3350 leader_election.cc:304] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.588742 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.588850 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d8167b34064888be6e4df4dfde0b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.588878 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a6ec9020494019a32cfb428554bd07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:03.588935 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet b7a6ec9020494019a32cfb428554bd07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a6ec9020494019a32cfb428554bd07 already in progress: creating tablet
I20250115 10:12:03.588968 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d8167b34064888be6e4df4dfde0b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.589015 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.589231 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.589258 3521 tablet_service.cc:1514] Processing DeleteTablet for tablet b7a6ec9020494019a32cfb428554bd07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.589304 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet 87d8167b34064888be6e4df4dfde0b31 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.589303 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 0fbb9cfc01df408eaae41b38e8c62c86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fbb9cfc01df408eaae41b38e8c62c86 already in progress: creating tablet
W20250115 10:12:03.589365 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 87d8167b34064888be6e4df4dfde0b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d8167b34064888be6e4df4dfde0b31 already in progress: creating tablet
I20250115 10:12:03.589397 4575 tablet_bootstrap.cc:492] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.589437 4575 ts_tablet_manager.cc:1397] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.001s
I20250115 10:12:03.589571 4575 raft_consensus.cc:357] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.589640 4575 raft_consensus.cc:383] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.589664 4575 raft_consensus.cc:738] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.589701 4575 consensus_queue.cc:260] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.589722 4557 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.589757 4557 ts_tablet_manager.cc:1397] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:03.589835 4575 ts_tablet_manager.cc:1428] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.589903 4575 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.589881 4557 raft_consensus.cc:357] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.589931 4557 raft_consensus.cc:383] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.589946 4557 raft_consensus.cc:738] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.589978 4557 consensus_queue.cc:260] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.590094 4557 ts_tablet_manager.cc:1428] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.590289 4575 tablet_bootstrap.cc:654] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.590342 4557 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:03.590698 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 0fbb9cfc01df408eaae41b38e8c62c86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fbb9cfc01df408eaae41b38e8c62c86 already in progress: creating tablet
I20250115 10:12:03.590736 4557 tablet_bootstrap.cc:654] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.590761 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet b7a6ec9020494019a32cfb428554bd07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a6ec9020494019a32cfb428554bd07 already in progress: creating tablet
W20250115 10:12:03.590813 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 87d8167b34064888be6e4df4dfde0b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d8167b34064888be6e4df4dfde0b31 already in progress: creating tablet
W20250115 10:12:03.590858 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet b7a6ec9020494019a32cfb428554bd07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7a6ec9020494019a32cfb428554bd07 already in progress: creating tablet
W20250115 10:12:03.590888 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 87d8167b34064888be6e4df4dfde0b31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87d8167b34064888be6e4df4dfde0b31 already in progress: creating tablet
W20250115 10:12:03.590929 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 0fbb9cfc01df408eaae41b38e8c62c86 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0fbb9cfc01df408eaae41b38e8c62c86 already in progress: creating tablet
W20250115 10:12:03.591212 3484 leader_election.cc:343] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.591281 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.591378 4587 raft_consensus.cc:2798] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.591413 4587 raft_consensus.cc:695] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.591454 4587 consensus_queue.cc:237] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.591643 3214 leader_election.cc:343] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.592046 3952 raft_consensus.cc:491] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.592109 3952 raft_consensus.cc:513] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.592159 4662 tablet.cc:1721] T def9cfbc6f764499b1c6ac9b6845f5ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.592193 3952 leader_election.cc:290] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.592533 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:03.592970 4471 catalog_manager.cc:5526] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.593076 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:03.593490 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:03.593683 3379 tablet_service.cc:1514] Processing DeleteTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.593755 4592 tablet_replica.cc:331] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.593807 4592 raft_consensus.cc:2238] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.593851 4592 raft_consensus.cc:2267] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.593967 3259 tablet_service.cc:1514] Processing DeleteTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.594058 4589 tablet_replica.cc:331] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.594112 4589 raft_consensus.cc:2238] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.594146 4589 raft_consensus.cc:2267] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.594251 4592 ts_tablet_manager.cc:1905] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.594682 4470 catalog_manager.cc:5526] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.594779 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:03.595360 4589 ts_tablet_manager.cc:1905] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.595494 4592 ts_tablet_manager.cc:1918] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.595533 4592 log.cc:1198] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:03.595691 4592 ts_tablet_manager.cc:1939] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
W20250115 10:12:03.595793 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
I20250115 10:12:03.595994 4575 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.596038 4575 ts_tablet_manager.cc:1397] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.596182 4575 raft_consensus.cc:357] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.596238 4575 raft_consensus.cc:383] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.596261 4575 raft_consensus.cc:738] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.596298 4575 consensus_queue.cc:260] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.596398 4575 ts_tablet_manager.cc:1428] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.596472 4575 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.596617 4589 ts_tablet_manager.cc:1918] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.596664 4589 log.cc:1198] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:03.596688 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.596781 4589 ts_tablet_manager.cc:1939] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.596920 4575 tablet_bootstrap.cc:654] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.596925 3484 leader_election.cc:343] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.585357 4433 leader_election.cc:290] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.597021 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (table default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]) successfully deleted
I20250115 10:12:03.597090 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.597159 3549 raft_consensus.cc:2463] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.597234 3522 tablet_service.cc:1514] Processing DeleteTablet for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.597869 4575 tablet_bootstrap.cc:492] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.597910 4575 ts_tablet_manager.cc:1397] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
W20250115 10:12:03.598069 3214 consensus_peers.cc:487] T 4839f8e0539d468ea11077d48f8f8266 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4839f8e0539d468ea11077d48f8f8266. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.598160 4575 raft_consensus.cc:357] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.598210 4575 raft_consensus.cc:383] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.598227 4575 raft_consensus.cc:738] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.598269 4575 consensus_queue.cc:260] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.598537 4335 raft_consensus.cc:491] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.598587 4335 raft_consensus.cc:513] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.598659 4575 ts_tablet_manager.cc:1428] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.598716 4335 leader_election.cc:290] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.598740 4575 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.599188 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.599242 3414 raft_consensus.cc:2463] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.599206 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.599411 3214 leader_election.cc:304] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:03.599494 3214 leader_election.cc:343] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.599498 4575 tablet_bootstrap.cc:654] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.599542 4335 raft_consensus.cc:2798] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.599568 4335 raft_consensus.cc:491] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.599589 4335 raft_consensus.cc:3054] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.600282 4575 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.600255 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.600317 4575 ts_tablet_manager.cc:1397] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
W20250115 10:12:03.600443 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f6fe9bedd4b74166a4f4c34ec0b87f26 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f6fe9bedd4b74166a4f4c34ec0b87f26 already in progress: creating tablet
I20250115 10:12:03.600414 4335 raft_consensus.cc:513] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.600476 4575 raft_consensus.cc:357] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.600529 4575 raft_consensus.cc:383] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.600551 4335 leader_election.cc:290] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.600569 4575 raft_consensus.cc:738] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.600602 4575 consensus_queue.cc:260] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.600692 3215 leader_election.cc:304] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.600713 4575 ts_tablet_manager.cc:1428] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.600775 4575 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.600819 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.601184 4575 tablet_bootstrap.cc:654] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.601212 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.601289 3550 raft_consensus.cc:2463] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.601596 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.601693 4557 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.601725 4557 ts_tablet_manager.cc:1397] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:03.601862 4557 raft_consensus.cc:357] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.601907 4557 raft_consensus.cc:383] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.601922 4557 raft_consensus.cc:738] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.601954 4557 consensus_queue.cc:260] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.602069 4557 ts_tablet_manager.cc:1428] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.602140 4557 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.602356 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f6fe9bedd4b74166a4f4c34ec0b87f26 (table default.Table_3ae844209e2b49ceaed3f8446ee9a1bd [id=54e712dca9664efc99f6bd35c1d11dc5]) successfully deleted
W20250115 10:12:03.602861 3350 leader_election.cc:343] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.603394 3215 leader_election.cc:343] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.603451 3215 leader_election.cc:304] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:03.603530 3215 leader_election.cc:343] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.603541 4575 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.603576 4575 ts_tablet_manager.cc:1397] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:03.603628 3952 raft_consensus.cc:2798] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.603689 3952 raft_consensus.cc:491] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.603708 3952 raft_consensus.cc:3054] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.603722 4575 raft_consensus.cc:357] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.603826 4575 raft_consensus.cc:383] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.603858 4575 raft_consensus.cc:738] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.603890 4575 consensus_queue.cc:260] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.603952 4575 ts_tablet_manager.cc:1428] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.604007 4575 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.604353 4575 tablet_bootstrap.cc:654] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.604385 3952 raft_consensus.cc:513] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.604529 3952 leader_election.cc:290] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.604573 3952 raft_consensus.cc:2798] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.604545 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.604600 3952 raft_consensus.cc:491] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.604609 3415 raft_consensus.cc:3054] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.604619 3952 raft_consensus.cc:3054] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.605207 3952 raft_consensus.cc:513] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.605257 3415 raft_consensus.cc:2463] T c35ca809b19541479146f385e1d3cebe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.605319 3952 leader_election.cc:290] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.605464 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.605511 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.606031 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.607333 3214 leader_election.cc:304] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.607379 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.607406 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.607432 4335 raft_consensus.cc:2798] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.607475 4335 raft_consensus.cc:695] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.607517 4335 consensus_queue.cc:237] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.607875 4569 tablet_bootstrap.cc:492] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.607926 4569 ts_tablet_manager.cc:1397] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250115 10:12:03.608129 4569 raft_consensus.cc:357] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.608204 4569 raft_consensus.cc:383] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.608225 4569 raft_consensus.cc:738] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.608268 4569 consensus_queue.cc:260] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.608373 4569 ts_tablet_manager.cc:1428] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.608428 4569 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.608824 4569 tablet_bootstrap.cc:654] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.608762 4470 catalog_manager.cc:5526] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.609375 4569 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.609411 4569 ts_tablet_manager.cc:1397] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.609514 4569 raft_consensus.cc:357] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.609570 4569 raft_consensus.cc:383] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.609593 4569 raft_consensus.cc:738] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.609618 4569 consensus_queue.cc:260] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.609704 4569 ts_tablet_manager.cc:1428] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.609760 4569 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.609912 3770 raft_consensus.cc:491] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.609951 3770 raft_consensus.cc:513] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.610033 3770 leader_election.cc:290] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.610146 4569 tablet_bootstrap.cc:654] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.610634 4569 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.610670 4569 ts_tablet_manager.cc:1397] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.610777 4569 raft_consensus.cc:357] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.610816 4569 raft_consensus.cc:383] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.610831 4569 raft_consensus.cc:738] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.610889 4569 consensus_queue.cc:260] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.610930 3770 raft_consensus.cc:491] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.610965 4569 ts_tablet_manager.cc:1428] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.610975 3770 raft_consensus.cc:513] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.611016 4569 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.611044 3770 leader_election.cc:290] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.611415 4569 tablet_bootstrap.cc:654] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.612883 4569 tablet_bootstrap.cc:492] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.612880 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.612984 4569 ts_tablet_manager.cc:1397] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
W20250115 10:12:03.613660 3214 leader_election.cc:343] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.613718 3214 leader_election.cc:343] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.613716 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad975dacafc94bc89c3996aa58a9b5a1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.613787 3414 raft_consensus.cc:2463] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.613867 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509f854a424e497f8fa72b70d5f0f651" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.613929 3415 raft_consensus.cc:2463] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.614156 3214 leader_election.cc:304] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.614231 3214 leader_election.cc:304] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.614290 3770 raft_consensus.cc:2798] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.614344 3770 raft_consensus.cc:491] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.614362 3770 raft_consensus.cc:3054] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.615054 3770 raft_consensus.cc:513] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.615199 3770 leader_election.cc:290] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.615245 3770 raft_consensus.cc:2798] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.615268 3770 raft_consensus.cc:491] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.615288 3770 raft_consensus.cc:3054] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.615501 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad975dacafc94bc89c3996aa58a9b5a1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.615556 3415 raft_consensus.cc:3054] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.615803 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.615850 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:03.615869 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:03.616194 3415 raft_consensus.cc:2463] T ad975dacafc94bc89c3996aa58a9b5a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.616334 3214 leader_election.cc:304] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.616379 4569 raft_consensus.cc:357] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.616487 4569 raft_consensus.cc:383] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.616508 4569 raft_consensus.cc:738] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.616568 4569 consensus_queue.cc:260] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.616721 4569 ts_tablet_manager.cc:1428] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:03.616998 4569 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.617292 4335 raft_consensus.cc:2798] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.617436 4335 raft_consensus.cc:695] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.617476 4335 consensus_queue.cc:237] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.617583 4569 tablet_bootstrap.cc:654] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.618252 4569 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.618237 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.618288 4569 ts_tablet_manager.cc:1397] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.618305 3549 raft_consensus.cc:3054] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.618433 4569 raft_consensus.cc:357] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.618474 4569 raft_consensus.cc:383] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.618490 4569 raft_consensus.cc:738] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.618512 4569 consensus_queue.cc:260] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.618570 4569 ts_tablet_manager.cc:1428] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.618621 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad975dacafc94bc89c3996aa58a9b5a1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.618674 3550 raft_consensus.cc:2463] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.618731 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509f854a424e497f8fa72b70d5f0f651" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.618762 3547 raft_consensus.cc:2463] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.618860 4569 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.618930 3549 raft_consensus.cc:2463] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.619011 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.619076 3548 raft_consensus.cc:3054] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.619277 4569 tablet_bootstrap.cc:654] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.619566 3548 raft_consensus.cc:2463] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.619642 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad975dacafc94bc89c3996aa58a9b5a1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.619691 3546 raft_consensus.cc:3054] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.619983 4569 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.620033 4569 ts_tablet_manager.cc:1397] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.620165 4569 raft_consensus.cc:357] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.620229 4569 raft_consensus.cc:383] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.620257 4569 raft_consensus.cc:738] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.620327 4569 consensus_queue.cc:260] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.620431 4569 ts_tablet_manager.cc:1428] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.620450 3546 raft_consensus.cc:2463] T ad975dacafc94bc89c3996aa58a9b5a1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.620493 4569 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.620908 4569 tablet_bootstrap.cc:654] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.621148 3770 raft_consensus.cc:513] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.621249 3770 leader_election.cc:290] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.621449 3215 leader_election.cc:304] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.621523 3215 leader_election.cc:304] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.621619 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509f854a424e497f8fa72b70d5f0f651" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.621672 3415 raft_consensus.cc:3054] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.621675 4335 raft_consensus.cc:2798] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.621712 4335 raft_consensus.cc:695] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.621744 4335 consensus_queue.cc:237] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.621950 4335 raft_consensus.cc:2798] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.621986 4335 raft_consensus.cc:695] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.622037 4335 consensus_queue.cc:237] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.622229 3415 raft_consensus.cc:2463] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.622283 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "509f854a424e497f8fa72b70d5f0f651" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.622342 3546 raft_consensus.cc:3054] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.622923 3546 raft_consensus.cc:2463] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.623024 3214 leader_election.cc:304] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.623502 3770 raft_consensus.cc:2798] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.623548 3770 raft_consensus.cc:695] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.623581 3770 consensus_queue.cc:237] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.623991 4557 tablet_bootstrap.cc:654] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.624657 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 1a729d69595f47bd9872d46068acc98f (DEFAULT_TABLE table=default.Table_9ff830223c344cf69e9954a3c90c5660 [id=05ac5e0e95af480c9dc2628a8e5e3713]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.624768 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a729d69595f47bd9872d46068acc98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.625054 3522 tablet_service.cc:1467] Processing CreateTablet for tablet e356bc69b8f3414f99d7a6f804310da8 (DEFAULT_TABLE table=default.Table_9ccaf4cf30e9496ca64bf2f7cd44de56 [id=68ed575a3d514fe78954a4a8d2395b8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.625137 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356bc69b8f3414f99d7a6f804310da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.625900 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 616fe62efc124fc0ace2ff557f42dcec (DEFAULT_TABLE table=default.Table_87580f504cf74904bf2cb93d6da42508 [id=3903f93885774e08958a17c6913a9df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.625977 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616fe62efc124fc0ace2ff557f42dcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.626287 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 31964c90876c4d289d68b6be6ebb8c12 (DEFAULT_TABLE table=default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.626369 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31964c90876c4d289d68b6be6ebb8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.626603 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 698b856949484ae092d198e64e00634b (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.626722 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698b856949484ae092d198e64e00634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.627182 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 203486455372404aa0a735cd219934be (DEFAULT_TABLE table=default.Table_81168f61f4744059b5716b277280c70c [id=bcddd56f5b3e47bb837a4762527d18df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.627254 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203486455372404aa0a735cd219934be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.627308 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182 (DEFAULT_TABLE table=default.Table_096e55501304403f8fa1bf3e935b33a0 [id=0cd340db1f04466eac3c77d28c825ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.627372 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.627763 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d7af3da67d9348d7bc890b7981d8b5e8 (DEFAULT_TABLE table=default.Table_c6f8aad96bbc4bed888a43bc23bb7338 [id=95e66b8babe2436e9e429b9504452c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.627789 3525 tablet_service.cc:1467] Processing CreateTablet for tablet ffe30b01774a4345992fa0b29ee7f418 (DEFAULT_TABLE table=default.Table_a6400bf1de024af4b73446837abbe6c5 [id=c2dadea0d95c4603bb6cc011ed9894cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.627851 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af3da67d9348d7bc890b7981d8b5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.627878 3511 tablet_service.cc:1467] Processing CreateTablet for tablet aa25f3b8144f407c9c437be6676379b2 (DEFAULT_TABLE table=default.Table_6051563ff45d4e82b8c874f88c8cdaa0 [id=ef6842ab6593487db3531e1620804f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.627954 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa25f3b8144f407c9c437be6676379b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.628000 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 616fe62efc124fc0ace2ff557f42dcec (DEFAULT_TABLE table=default.Table_87580f504cf74904bf2cb93d6da42508 [id=3903f93885774e08958a17c6913a9df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.628108 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616fe62efc124fc0ace2ff557f42dcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.628877 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 31964c90876c4d289d68b6be6ebb8c12 (DEFAULT_TABLE table=default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.628937 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 6a285009787f4acb810a1829ca37a845 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.628955 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31964c90876c4d289d68b6be6ebb8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.628978 3259 tablet_service.cc:1467] Processing CreateTablet for tablet e356bc69b8f3414f99d7a6f804310da8 (DEFAULT_TABLE table=default.Table_9ccaf4cf30e9496ca64bf2f7cd44de56 [id=68ed575a3d514fe78954a4a8d2395b8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.629009 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a285009787f4acb810a1829ca37a845. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.629057 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356bc69b8f3414f99d7a6f804310da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.629559 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 203486455372404aa0a735cd219934be (DEFAULT_TABLE table=default.Table_81168f61f4744059b5716b277280c70c [id=bcddd56f5b3e47bb837a4762527d18df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.629637 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203486455372404aa0a735cd219934be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.629889 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 61cc55da8a4c4da2b94321a912418747 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.629956 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc55da8a4c4da2b94321a912418747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.630152 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182 (DEFAULT_TABLE table=default.Table_096e55501304403f8fa1bf3e935b33a0 [id=0cd340db1f04466eac3c77d28c825ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.630234 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.630260 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 6a285009787f4acb810a1829ca37a845 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.630331 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a285009787f4acb810a1829ca37a845. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.630854 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d1a8c8ad0ca84fc3aec22cd825579e6d (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.630925 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a8c8ad0ca84fc3aec22cd825579e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.630970 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 61cc55da8a4c4da2b94321a912418747 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.631050 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc55da8a4c4da2b94321a912418747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.631218 3259 tablet_service.cc:1467] Processing CreateTablet for tablet d1a8c8ad0ca84fc3aec22cd825579e6d (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.631289 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a8c8ad0ca84fc3aec22cd825579e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.631790 3530 tablet_service.cc:1467] Processing CreateTablet for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad (DEFAULT_TABLE table=default.Table_8266bc1d98ce401cb7fa4b8a0c775230 [id=90d3e6876bb2486c86fbcc9ad3329159]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.631803 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 10c5cf464dcd484191838d56253ded0b (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.631875 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.631879 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c5cf464dcd484191838d56253ded0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.631861 3247 tablet_service.cc:1467] Processing CreateTablet for tablet c1a4478e2e094f789cc9dc95da58c321 (DEFAULT_TABLE table=default.Table_f76bbfe3db904a49b8b83f2aa695931b [id=138390322663489d9dc1238dcb1cc7a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.631983 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a4478e2e094f789cc9dc95da58c321. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.632023 3257 tablet_service.cc:1467] Processing CreateTablet for tablet be17e049a138457fb70bfa2e3ec2f378 (DEFAULT_TABLE table=default.Table_253a0050b6cf43e3953c8d5affcbe231 [id=71bc62f4531e48e9b39082ccd7fec4ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.632088 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be17e049a138457fb70bfa2e3ec2f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.632848 3530 tablet_service.cc:1467] Processing CreateTablet for tablet be17e049a138457fb70bfa2e3ec2f378 (DEFAULT_TABLE table=default.Table_253a0050b6cf43e3953c8d5affcbe231 [id=71bc62f4531e48e9b39082ccd7fec4ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.632858 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3186fbc8414cb989481b59e9cae04d (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.632927 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3186fbc8414cb989481b59e9cae04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.632927 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be17e049a138457fb70bfa2e3ec2f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.632949 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 900475e1e900423c9b9205540f67e5de (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.633001 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5eb11332cb4489ade8f441158eb958 (DEFAULT_TABLE table=default.Table_8b385a7b3a744493997a54d2dcee22a3 [id=cfe09c642f16406ba0c8906e34622a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.633075 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900475e1e900423c9b9205540f67e5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.633096 3243 tablet_service.cc:1467] Processing CreateTablet for tablet ffe30b01774a4345992fa0b29ee7f418 (DEFAULT_TABLE table=default.Table_a6400bf1de024af4b73446837abbe6c5 [id=c2dadea0d95c4603bb6cc011ed9894cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.633173 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe30b01774a4345992fa0b29ee7f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.633796 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3186fbc8414cb989481b59e9cae04d (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.633807 3246 tablet_service.cc:1467] Processing CreateTablet for tablet eb2fb9983c4f45f98291c411ba9ab748 (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.633870 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3186fbc8414cb989481b59e9cae04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.633879 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2fb9983c4f45f98291c411ba9ab748. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.634043 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 80e2361a4e7040feae312bda88851e77 (DEFAULT_TABLE table=default.Table_1cbd1f5d9b4243c9b562f75483e4faad [id=685153205cef44f9bda73763c6db3d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.634088 3243 tablet_service.cc:1467] Processing CreateTablet for tablet 29d9a01abd314d0e9f60df4f6736985b (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.634115 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2361a4e7040feae312bda88851e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.634176 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 3956317a32b04585a84629c209935898 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.634248 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3956317a32b04585a84629c209935898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.634752 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b (DEFAULT_TABLE table=default.Table_6784d4c136ef4130ae859c7ec4b4125b [id=7fd789f8d7044790a0f57f3dc1c3e384]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.634752 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 18c05e81b1354e26900949537465cf08 (DEFAULT_TABLE table=default.Table_cf11404b146e4e1e8d59cb7501344676 [id=3066cface64b42e584332ff53f077b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.634824 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c05e81b1354e26900949537465cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.634825 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88fd5f4cb14241ba611291d76ed79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.635051 3247 tablet_service.cc:1467] Processing CreateTablet for tablet ef7d25c542714a6ea0b75591aea35b9e (DEFAULT_TABLE table=default.Table_d1416c23bfb64fd684934aa0671cec95 [id=757343908758466fb57fafddc6525706]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635123 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d25c542714a6ea0b75591aea35b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.635371 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 13cfdf73dea14543aff0e564c5fa51b6 (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635445 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cfdf73dea14543aff0e564c5fa51b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.635601 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 1a729d69595f47bd9872d46068acc98f (DEFAULT_TABLE table=default.Table_9ff830223c344cf69e9954a3c90c5660 [id=05ac5e0e95af480c9dc2628a8e5e3713]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635813 3528 tablet_service.cc:1467] Processing CreateTablet for tablet f778154f3bc3420abe9eb87608228bc3 (DEFAULT_TABLE table=default.Table_f043cb2f81ea453b8d2d5c69eb66e609 [id=e52e38e9e8e04c429bb6dc1e3c5aa1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635911 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f778154f3bc3420abe9eb87608228bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.636044 3378 tablet_service.cc:1467] Processing CreateTablet for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad (DEFAULT_TABLE table=default.Table_8266bc1d98ce401cb7fa4b8a0c775230 [id=90d3e6876bb2486c86fbcc9ad3329159]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.636144 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.636636 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5eb11332cb4489ade8f441158eb958 (DEFAULT_TABLE table=default.Table_8b385a7b3a744493997a54d2dcee22a3 [id=cfe09c642f16406ba0c8906e34622a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.636713 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5eb11332cb4489ade8f441158eb958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.636931 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 900475e1e900423c9b9205540f67e5de (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.636998 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900475e1e900423c9b9205540f67e5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.637414 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 616fe62efc124fc0ace2ff557f42dcec (DEFAULT_TABLE table=default.Table_87580f504cf74904bf2cb93d6da42508 [id=3903f93885774e08958a17c6913a9df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.637502 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 31964c90876c4d289d68b6be6ebb8c12 (DEFAULT_TABLE table=default.Table_4a1fbe71ee7f439eaf78d450b0501d1c [id=fe851a369af9412b8f126ef2816d4947]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.637522 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 616fe62efc124fc0ace2ff557f42dcec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.637585 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31964c90876c4d289d68b6be6ebb8c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.637959 3528 tablet_service.cc:1467] Processing CreateTablet for tablet eb2fb9983c4f45f98291c411ba9ab748 (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.638028 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2fb9983c4f45f98291c411ba9ab748. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.638202 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 203486455372404aa0a735cd219934be (DEFAULT_TABLE table=default.Table_81168f61f4744059b5716b277280c70c [id=bcddd56f5b3e47bb837a4762527d18df]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.638254 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 203486455372404aa0a735cd219934be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.638432 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182 (DEFAULT_TABLE table=default.Table_096e55501304403f8fa1bf3e935b33a0 [id=0cd340db1f04466eac3c77d28c825ed2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.638500 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d8cdd91b54444a6a6fe4cbf6fd16182. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.638818 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 6a285009787f4acb810a1829ca37a845 (DEFAULT_TABLE table=default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.638871 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a285009787f4acb810a1829ca37a845. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.638907 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 80e2361a4e7040feae312bda88851e77 (DEFAULT_TABLE table=default.Table_1cbd1f5d9b4243c9b562f75483e4faad [id=685153205cef44f9bda73763c6db3d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.638985 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2361a4e7040feae312bda88851e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.639444 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 61cc55da8a4c4da2b94321a912418747 (DEFAULT_TABLE table=default.Table_08430ab01322483682c5ea1bb80c05bb [id=db2e8f64e9044754a8f0389f427340b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639500 3393 tablet_service.cc:1467] Processing CreateTablet for tablet d1a8c8ad0ca84fc3aec22cd825579e6d (DEFAULT_TABLE table=default.Table_c3ef2cca176941c599f9e7d42f9a35ba [id=f1c9f22e38154ced86b7306f5a97e757]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639521 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61cc55da8a4c4da2b94321a912418747. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.639580 3390 tablet_service.cc:1467] Processing CreateTablet for tablet 18bb0a4436354a58976f610fab166bcf (DEFAULT_TABLE table=default.Table_7dc37da2eb7d41798faead893c7953b8 [id=81d844c461fe48a9ba8eecfee498b96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639654 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a8c8ad0ca84fc3aec22cd825579e6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.639672 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 87fa663159fc4c95a8499a84f7b6faed (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639787 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa663159fc4c95a8499a84f7b6faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.639796 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 87fa663159fc4c95a8499a84f7b6faed (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639809 3376 tablet_service.cc:1467] Processing CreateTablet for tablet f778154f3bc3420abe9eb87608228bc3 (DEFAULT_TABLE table=default.Table_f043cb2f81ea453b8d2d5c69eb66e609 [id=e52e38e9e8e04c429bb6dc1e3c5aa1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.639894 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa663159fc4c95a8499a84f7b6faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.639895 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f778154f3bc3420abe9eb87608228bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.640606 3393 tablet_service.cc:1467] Processing CreateTablet for tablet be17e049a138457fb70bfa2e3ec2f378 (DEFAULT_TABLE table=default.Table_253a0050b6cf43e3953c8d5affcbe231 [id=71bc62f4531e48e9b39082ccd7fec4ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.640676 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be17e049a138457fb70bfa2e3ec2f378. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.640791 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3186fbc8414cb989481b59e9cae04d (DEFAULT_TABLE table=default.Table_d734e721513541c1aa54ea5312db69c9 [id=61d5b12f0d9d482a9831cbb96d13eaec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.640818 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 29d9a01abd314d0e9f60df4f6736985b (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.640818 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 18c05e81b1354e26900949537465cf08 (DEFAULT_TABLE table=default.Table_cf11404b146e4e1e8d59cb7501344676 [id=3066cface64b42e584332ff53f077b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.640853 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e3186fbc8414cb989481b59e9cae04d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.640889 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d9a01abd314d0e9f60df4f6736985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.640894 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c05e81b1354e26900949537465cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.641743 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 900475e1e900423c9b9205540f67e5de (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.641758 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b (DEFAULT_TABLE table=default.Table_6784d4c136ef4130ae859c7ec4b4125b [id=7fd789f8d7044790a0f57f3dc1c3e384]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.641777 3376 tablet_service.cc:1467] Processing CreateTablet for tablet 80e2361a4e7040feae312bda88851e77 (DEFAULT_TABLE table=default.Table_1cbd1f5d9b4243c9b562f75483e4faad [id=685153205cef44f9bda73763c6db3d05]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.641827 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 900475e1e900423c9b9205540f67e5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.641834 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88fd5f4cb14241ba611291d76ed79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.641889 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 6855da12502047aba54041f663c44f86 (DEFAULT_TABLE table=default.Table_2416abb545854c57852bd1080ef3f640 [id=a13e10f29ce24acd9822aa11e8d8968c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.641984 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855da12502047aba54041f663c44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.642021 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 10c5cf464dcd484191838d56253ded0b (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.642096 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c5cf464dcd484191838d56253ded0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.642792 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 29d9a01abd314d0e9f60df4f6736985b (DEFAULT_TABLE table=default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.642843 3516 tablet_service.cc:1467] Processing CreateTablet for tablet ef7d25c542714a6ea0b75591aea35b9e (DEFAULT_TABLE table=default.Table_d1416c23bfb64fd684934aa0671cec95 [id=757343908758466fb57fafddc6525706]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.642866 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d9a01abd314d0e9f60df4f6736985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.642917 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d25c542714a6ea0b75591aea35b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.643148 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b (DEFAULT_TABLE table=default.Table_6784d4c136ef4130ae859c7ec4b4125b [id=7fd789f8d7044790a0f57f3dc1c3e384]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.643224 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f88fd5f4cb14241ba611291d76ed79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.643258 3381 tablet_service.cc:1467] Processing CreateTablet for tablet ef7d25c542714a6ea0b75591aea35b9e (DEFAULT_TABLE table=default.Table_d1416c23bfb64fd684934aa0671cec95 [id=757343908758466fb57fafddc6525706]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.643333 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef7d25c542714a6ea0b75591aea35b9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.641753 3391 tablet_service.cc:1467] Processing CreateTablet for tablet eb2fb9983c4f45f98291c411ba9ab748 (DEFAULT_TABLE table=default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.643479 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb2fb9983c4f45f98291c411ba9ab748. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.643786 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 6855da12502047aba54041f663c44f86 (DEFAULT_TABLE table=default.Table_2416abb545854c57852bd1080ef3f640 [id=a13e10f29ce24acd9822aa11e8d8968c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.643834 3388 tablet_service.cc:1467] Processing CreateTablet for tablet c1a4478e2e094f789cc9dc95da58c321 (DEFAULT_TABLE table=default.Table_f76bbfe3db904a49b8b83f2aa695931b [id=138390322663489d9dc1238dcb1cc7a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.643867 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855da12502047aba54041f663c44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.643916 3388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a4478e2e094f789cc9dc95da58c321. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.644026 3390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb0a4436354a58976f610fab166bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.644528 3392 tablet_service.cc:1467] Processing CreateTablet for tablet ba5371af45cc4382bea26abd9df1094d (DEFAULT_TABLE table=default.Table_851c083093634347bbad8d5400264cc7 [id=f5721b47cbe24c698815d57d6298c465]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.644599 3392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5371af45cc4382bea26abd9df1094d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.644634 3379 tablet_service.cc:1467] Processing CreateTablet for tablet e356bc69b8f3414f99d7a6f804310da8 (DEFAULT_TABLE table=default.Table_9ccaf4cf30e9496ca64bf2f7cd44de56 [id=68ed575a3d514fe78954a4a8d2395b8b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.644712 3379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e356bc69b8f3414f99d7a6f804310da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.644938 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 13cfdf73dea14543aff0e564c5fa51b6 (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.645005 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cfdf73dea14543aff0e564c5fa51b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.645236 4433 raft_consensus.cc:491] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.645296 4433 raft_consensus.cc:513] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.645432 4433 leader_election.cc:290] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.645663 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b580a5dc6a9c4a0f8b65ad9a92804e09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.641782 3384 tablet_service.cc:1467] Processing CreateTablet for tablet 1a729d69595f47bd9872d46068acc98f (DEFAULT_TABLE table=default.Table_9ff830223c344cf69e9954a3c90c5660 [id=05ac5e0e95af480c9dc2628a8e5e3713]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.645998 3384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a729d69595f47bd9872d46068acc98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.645989 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8334f3d734968a0a7ba148bd90d72 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.646059 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8334f3d734968a0a7ba148bd90d72. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.646287 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:03.646385 4470 catalog_manager.cc:5526] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.646514 4470 catalog_manager.cc:5526] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.646590 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:03.646628 4470 catalog_manager.cc:5526] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.628916 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 46aacb7a8c9b42588e67e6e4aef7613d (DEFAULT_TABLE table=default.Table_c0b9984c36924f0fbab00b37829f98ca [id=8e9bd4cf3fa346faa2242ec0eef2a653]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.646705 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
I20250115 10:12:03.646755 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aacb7a8c9b42588e67e6e4aef7613d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.646744 4470 catalog_manager.cc:5526] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.646811 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:03.647020 3529 tablet_service.cc:1467] Processing CreateTablet for tablet c1a4478e2e094f789cc9dc95da58c321 (DEFAULT_TABLE table=default.Table_f76bbfe3db904a49b8b83f2aa695931b [id=138390322663489d9dc1238dcb1cc7a0]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:03.647045 3484 leader_election.cc:343] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.647107 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a4478e2e094f789cc9dc95da58c321. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.647812 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe30b01774a4345992fa0b29ee7f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.647845 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 0c5eb11332cb4489ade8f441158eb958 (DEFAULT_TABLE table=default.Table_8b385a7b3a744493997a54d2dcee22a3 [id=cfe09c642f16406ba0c8906e34622a20]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.647936 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5eb11332cb4489ade8f441158eb958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.648480 3512 tablet_service.cc:1467] Processing CreateTablet for tablet 3956317a32b04585a84629c209935898 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635694 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a729d69595f47bd9872d46068acc98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.648572 3512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3956317a32b04585a84629c209935898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.632980 3242 tablet_service.cc:1467] Processing CreateTablet for tablet ba5371af45cc4382bea26abd9df1094d (DEFAULT_TABLE table=default.Table_851c083093634347bbad8d5400264cc7 [id=f5721b47cbe24c698815d57d6298c465]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635865 3260 tablet_service.cc:1467] Processing CreateTablet for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad (DEFAULT_TABLE table=default.Table_8266bc1d98ce401cb7fa4b8a0c775230 [id=90d3e6876bb2486c86fbcc9ad3329159]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635903 3241 tablet_service.cc:1467] Processing CreateTablet for tablet f778154f3bc3420abe9eb87608228bc3 (DEFAULT_TABLE table=default.Table_f043cb2f81ea453b8d2d5c69eb66e609 [id=e52e38e9e8e04c429bb6dc1e3c5aa1aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635926 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 87fa663159fc4c95a8499a84f7b6faed (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635947 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 6855da12502047aba54041f663c44f86 (DEFAULT_TABLE table=default.Table_2416abb545854c57852bd1080ef3f640 [id=a13e10f29ce24acd9822aa11e8d8968c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635988 3249 tablet_service.cc:1467] Processing CreateTablet for tablet 4732608c02834f5891a70d4ec91b9e4b (DEFAULT_TABLE table=default.Table_f1f5edc3a940475c9c4190d008aa7eff [id=64f5a62875674affa79349385d6db17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.635812 3253 tablet_service.cc:1467] Processing CreateTablet for tablet d7af3da67d9348d7bc890b7981d8b5e8 (DEFAULT_TABLE table=default.Table_c6f8aad96bbc4bed888a43bc23bb7338 [id=95e66b8babe2436e9e429b9504452c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.649230 3526 tablet_service.cc:1467] Processing CreateTablet for tablet 18bb0a4436354a58976f610fab166bcf (DEFAULT_TABLE table=default.Table_7dc37da2eb7d41798faead893c7953b8 [id=81d844c461fe48a9ba8eecfee498b96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.649299 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb0a4436354a58976f610fab166bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.649976 3519 tablet_service.cc:1467] Processing CreateTablet for tablet cc37ef40aab243c4ab4057ef2ff657e7 (DEFAULT_TABLE table=default.Table_f718abe0d8434e698daeb535c0be93c1 [id=cd6023dfbefb466aba1e462fd9418f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.650048 3519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc37ef40aab243c4ab4057ef2ff657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.650760 3527 tablet_service.cc:1467] Processing CreateTablet for tablet bae5b5194bcc4fcabe77b9ef2abf80be (DEFAULT_TABLE table=default.Table_2bf4b207818b4981b8c9f52f2cc5ace8 [id=ffa5018b5e914cd286cce59655421c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.650840 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae5b5194bcc4fcabe77b9ef2abf80be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.651480 3518 tablet_service.cc:1467] Processing CreateTablet for tablet 698b856949484ae092d198e64e00634b (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.651559 3518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698b856949484ae092d198e64e00634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.651823 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 4732608c02834f5891a70d4ec91b9e4b (DEFAULT_TABLE table=default.Table_f1f5edc3a940475c9c4190d008aa7eff [id=64f5a62875674affa79349385d6db17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.651902 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4732608c02834f5891a70d4ec91b9e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.652464 3380 tablet_service.cc:1467] Processing CreateTablet for tablet d7af3da67d9348d7bc890b7981d8b5e8 (DEFAULT_TABLE table=default.Table_c6f8aad96bbc4bed888a43bc23bb7338 [id=95e66b8babe2436e9e429b9504452c24]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.652541 3380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af3da67d9348d7bc890b7981d8b5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.653174 3382 tablet_service.cc:1467] Processing CreateTablet for tablet ffe30b01774a4345992fa0b29ee7f418 (DEFAULT_TABLE table=default.Table_a6400bf1de024af4b73446837abbe6c5 [id=c2dadea0d95c4603bb6cc011ed9894cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.653249 3382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe30b01774a4345992fa0b29ee7f418. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.653658 4433 raft_consensus.cc:491] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.653702 4699 raft_consensus.cc:491] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.653707 4433 raft_consensus.cc:513] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.653759 4699 raft_consensus.cc:513] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.653827 4433 leader_election.cc:290] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.653867 4699 leader_election.cc:290] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.653919 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 3956317a32b04585a84629c209935898 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.654003 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3956317a32b04585a84629c209935898. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.654145 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8b9bf010d245be919f1e912b103770" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.654199 3415 raft_consensus.cc:2463] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.654348 3484 leader_election.cc:304] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.654476 4433 raft_consensus.cc:2798] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.654505 4433 raft_consensus.cc:491] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.654520 4433 raft_consensus.cc:3054] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.654680 3395 tablet_service.cc:1467] Processing CreateTablet for tablet cc37ef40aab243c4ab4057ef2ff657e7 (DEFAULT_TABLE table=default.Table_f718abe0d8434e698daeb535c0be93c1 [id=cd6023dfbefb466aba1e462fd9418f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.654723 4575 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.654765 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc37ef40aab243c4ab4057ef2ff657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.654783 4575 ts_tablet_manager.cc:1397] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20250115 10:12:03.654906 4575 raft_consensus.cc:357] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.654951 4575 raft_consensus.cc:383] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.654970 4575 raft_consensus.cc:738] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.655006 4575 consensus_queue.cc:260] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.655086 4575 ts_tablet_manager.cc:1428] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.655150 4575 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.655454 3394 tablet_service.cc:1467] Processing CreateTablet for tablet aa25f3b8144f407c9c437be6676379b2 (DEFAULT_TABLE table=default.Table_6051563ff45d4e82b8c874f88c8cdaa0 [id=ef6842ab6593487db3531e1620804f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.655536 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa25f3b8144f407c9c437be6676379b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.655594 4575 tablet_bootstrap.cc:654] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.655809 3387 tablet_service.cc:1467] Processing CreateTablet for tablet bae5b5194bcc4fcabe77b9ef2abf80be (DEFAULT_TABLE table=default.Table_2bf4b207818b4981b8c9f52f2cc5ace8 [id=ffa5018b5e914cd286cce59655421c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.655886 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 46aacb7a8c9b42588e67e6e4aef7613d (DEFAULT_TABLE table=default.Table_c0b9984c36924f0fbab00b37829f98ca [id=8e9bd4cf3fa346faa2242ec0eef2a653]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.656001 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 4732608c02834f5891a70d4ec91b9e4b (DEFAULT_TABLE table=default.Table_f1f5edc3a940475c9c4190d008aa7eff [id=64f5a62875674affa79349385d6db17f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.656076 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8b9bf010d245be919f1e912b103770" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.656188 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae5b5194bcc4fcabe77b9ef2abf80be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.656226 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.656277 3485 leader_election.cc:343] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.656410 3350 leader_election.cc:343] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.627763 3521 tablet_service.cc:1467] Processing CreateTablet for tablet 10c5cf464dcd484191838d56253ded0b (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.656569 3521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c5cf464dcd484191838d56253ded0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.656611 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4732608c02834f5891a70d4ec91b9e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.656988 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aacb7a8c9b42588e67e6e4aef7613d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.647820 3520 tablet_service.cc:1467] Processing CreateTablet for tablet ba5371af45cc4382bea26abd9df1094d (DEFAULT_TABLE table=default.Table_851c083093634347bbad8d5400264cc7 [id=f5721b47cbe24c698815d57d6298c465]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.657323 3520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5371af45cc4382bea26abd9df1094d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.655943 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 698b856949484ae092d198e64e00634b (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.658248 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 698b856949484ae092d198e64e00634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.662379 4575 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.662417 4575 ts_tablet_manager.cc:1397] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.662400 4433 raft_consensus.cc:513] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.662529 4433 leader_election.cc:290] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.662546 4575 raft_consensus.cc:357] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.662608 4575 raft_consensus.cc:383] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.662653 4575 raft_consensus.cc:738] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.662701 4575 consensus_queue.cc:260] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.662808 4575 ts_tablet_manager.cc:1428] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.662875 4575 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.663075 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8b9bf010d245be919f1e912b103770" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.663324 4575 tablet_bootstrap.cc:654] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.663326 3485 leader_election.cc:343] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.663825 3248 tablet_service.cc:1467] Processing CreateTablet for tablet 80f0fe74b55740dd94f97eaf27992e70 (DEFAULT_TABLE table=default.Table_986991a3650c46aebfbc781c1ca6dc6f [id=d3bc52375b9840a380fb077dfec320b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.664009 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8b9bf010d245be919f1e912b103770" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.664073 3415 raft_consensus.cc:3054] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.664685 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 80f0fe74b55740dd94f97eaf27992e70 (DEFAULT_TABLE table=default.Table_986991a3650c46aebfbc781c1ca6dc6f [id=d3bc52375b9840a380fb077dfec320b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.664777 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f0fe74b55740dd94f97eaf27992e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.664808 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.664995 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:12:03.665014 3515 tablet_service.cc:1467] Processing CreateTablet for tablet d5490db43ba14c039847a9326a7620c4 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.665091 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5490db43ba14c039847a9326a7620c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.665874 3513 tablet_service.cc:1467] Processing CreateTablet for tablet f22785e218cb4a54ba56757c8251cfd7 (DEFAULT_TABLE table=default.Table_ccb48e8b4c054186a749ca16ba0e6d1f [id=9e0f3ed716134fe692830fc6fcf4e442]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.665947 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22785e218cb4a54ba56757c8251cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.666186 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 8def1d79286c4b8b8077121a24abee44 (DEFAULT_TABLE table=default.Table_9f0ac088111e458cbfa9f307456bba2f [id=5db8bd17802945d0bb8da8ec96b84f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.666257 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8def1d79286c4b8b8077121a24abee44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.666899 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e04c866114cefbddc1bdb54d31cff (DEFAULT_TABLE table=default.Table_67cce5abd27a4efc98535136874b4b64 [id=2c6928614f5f447baf7b7c51f8b9d8ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.666965 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9e04c866114cefbddc1bdb54d31cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.667236 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.667309 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c21c9b21c7c4aed981029846b28aee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.667990 3529 tablet_service.cc:1467] Processing CreateTablet for tablet e90df067a820456db899065f0c04fe6b (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.668067 3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90df067a820456db899065f0c04fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.668226 3515 tablet_service.cc:1467] Processing CreateTablet for tablet a16e074cf07c42e9b5e5596e81b4bd94 (DEFAULT_TABLE table=default.Table_5b3caceeab0d45b6a773279c45eafe33 [id=23b10a454cf04d14be8444c25e092197]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.668284 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16e074cf07c42e9b5e5596e81b4bd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.668819 4575 tablet_bootstrap.cc:492] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.668856 4575 ts_tablet_manager.cc:1397] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.668970 4575 raft_consensus.cc:357] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.669037 4575 raft_consensus.cc:383] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.669056 4575 raft_consensus.cc:738] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.669073 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca42518736949a78609ff22b6f5bdce (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.669091 4575 consensus_queue.cc:260] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.669139 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42518736949a78609ff22b6f5bdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.669178 4575 ts_tablet_manager.cc:1428] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.669224 4575 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.669581 4575 tablet_bootstrap.cc:654] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.669575 3523 tablet_service.cc:1467] Processing CreateTablet for tablet e143f851a88f45f0908152069c6a558b (DEFAULT_TABLE table=default.Table_b439b608419f459f8f77a0800a4ef734 [id=08169901d7b14df684fd38690e278cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.669667 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e143f851a88f45f0908152069c6a558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.669987 3770 raft_consensus.cc:491] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.670042 3770 raft_consensus.cc:513] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.670158 3770 leader_election.cc:290] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.670233 3511 tablet_service.cc:1467] Processing CreateTablet for tablet bc03234954824a64aa8d8abd5fc1dc29 (DEFAULT_TABLE table=default.Table_b056ece1636f4b1bb6bd53bf85e607a4 [id=2cef07bfd59448729380f258c5d77e96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.670307 3511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc03234954824a64aa8d8abd5fc1dc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.670506 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8191b81bdad74a9b8aa049473325720b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.670614 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8191b81bdad74a9b8aa049473325720b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.670658 3214 leader_election.cc:343] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.670677 3546 raft_consensus.cc:2463] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.670797 3215 leader_election.cc:304] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.670878 3770 raft_consensus.cc:2798] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.670900 3770 raft_consensus.cc:491] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.670926 3770 raft_consensus.cc:3054] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.671561 3770 raft_consensus.cc:513] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.671576 3525 tablet_service.cc:1467] Processing CreateTablet for tablet cb8da7533f8041768533184ef0a33d3f (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.671656 3770 leader_election.cc:290] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.671658 3525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8da7533f8041768533184ef0a33d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.671893 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8191b81bdad74a9b8aa049473325720b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.671979 3770 raft_consensus.cc:491] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.672014 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8191b81bdad74a9b8aa049473325720b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.672016 3770 raft_consensus.cc:513] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.672058 3546 raft_consensus.cc:3054] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.672096 3770 leader_election.cc:290] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.672250 3214 leader_election.cc:343] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.672575 3526 tablet_service.cc:1467] Processing CreateTablet for tablet dacd2778d9e54877b8ef6d52529c3539 (DEFAULT_TABLE table=default.Table_8c3be9ad849f479dbc770b2d6ec9f237 [id=c29867195cec4cdda0a64e63b097ec7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.672653 3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd2778d9e54877b8ef6d52529c3539. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.672703 3546 raft_consensus.cc:2463] T 8191b81bdad74a9b8aa049473325720b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.672811 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.672914 3215 leader_election.cc:304] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.672914 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.673063 4731 raft_consensus.cc:2798] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.673095 4731 raft_consensus.cc:695] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.673130 4731 consensus_queue.cc:237] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.673714 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 13cfdf73dea14543aff0e564c5fa51b6 (DEFAULT_TABLE table=default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.673738 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8334f3d734968a0a7ba148bd90d72 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.673789 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cfdf73dea14543aff0e564c5fa51b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.673832 3214 leader_election.cc:343] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.673924 3527 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3e1f44b1794f398f07bf767d54652f (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.673996 3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3e1f44b1794f398f07bf767d54652f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.674001 3215 leader_election.cc:343] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.674031 3215 leader_election.cc:304] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.674403 3770 raft_consensus.cc:2743] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.674420 3391 tablet_service.cc:1467] Processing CreateTablet for tablet e143f851a88f45f0908152069c6a558b (DEFAULT_TABLE table=default.Table_b439b608419f459f8f77a0800a4ef734 [id=08169901d7b14df684fd38690e278cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.674490 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e143f851a88f45f0908152069c6a558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.674741 4699 raft_consensus.cc:491] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.674816 4699 raft_consensus.cc:513] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.674916 4699 leader_election.cc:290] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.675062 3350 leader_election.cc:343] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.675097 3350 leader_election.cc:304] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.675174 4699 raft_consensus.cc:2743] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.675446 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e2361a4e7040feae312bda88851e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.675621 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3e1f44b1794f398f07bf767d54652f (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.675700 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3e1f44b1794f398f07bf767d54652f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.675781 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.674749 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 80f0fe74b55740dd94f97eaf27992e70 (DEFAULT_TABLE table=default.Table_986991a3650c46aebfbc781c1ca6dc6f [id=d3bc52375b9840a380fb077dfec320b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.676828 3524 tablet_service.cc:1467] Processing CreateTablet for tablet 08bee9d860f64bf5937ea9bdb095391b (DEFAULT_TABLE table=default.Table_afec1e69165e46f4a401075412905128 [id=a04c49538202493d952ae61c912fb5ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.676879 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f0fe74b55740dd94f97eaf27992e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.676918 3524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bee9d860f64bf5937ea9bdb095391b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.677029 3770 raft_consensus.cc:491] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.677083 3770 raft_consensus.cc:513] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.677166 3770 leader_election.cc:290] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.677523 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b7630b6c8b40d89b9829ffc8fc4b2b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.677717 3215 leader_election.cc:343] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.677855 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b7630b6c8b40d89b9829ffc8fc4b2b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.677970 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8334f3d734968a0a7ba148bd90d72. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.678017 3214 leader_election.cc:343] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.678061 3214 leader_election.cc:304] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.678143 3770 raft_consensus.cc:2743] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.678344 3522 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb1552d8cb541a6a2df109ea111c23f (DEFAULT_TABLE table=default.Table_d60729676fcc4f469e553b563bb6bafa [id=f473bb79920947c8a4c16ceef1992e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.678429 3522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1552d8cb541a6a2df109ea111c23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.678393 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_bc518eaf2d604c7e9ce859e76a6d72ac" } new_table_name: "default.Table_e7114f82478a498684df6ced2d600319" modify_external_catalogs: true
I20250115 10:12:03.678588 3376 tablet_service.cc:1467] Processing CreateTablet for tablet bc03234954824a64aa8d8abd5fc1dc29 (DEFAULT_TABLE table=default.Table_b056ece1636f4b1bb6bd53bf85e607a4 [id=2cef07bfd59448729380f258c5d77e96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.678653 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc03234954824a64aa8d8abd5fc1dc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.679046 3381 tablet_service.cc:1467] Processing CreateTablet for tablet cb8da7533f8041768533184ef0a33d3f (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.679121 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8da7533f8041768533184ef0a33d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.680039 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 08bee9d860f64bf5937ea9bdb095391b (DEFAULT_TABLE table=default.Table_afec1e69165e46f4a401075412905128 [id=a04c49538202493d952ae61c912fb5ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.680119 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bee9d860f64bf5937ea9bdb095391b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.680226 3376 tablet_service.cc:1467] Processing CreateTablet for tablet d5490db43ba14c039847a9326a7620c4 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.681141 3381 tablet_service.cc:1467] Processing CreateTablet for tablet f22785e218cb4a54ba56757c8251cfd7 (DEFAULT_TABLE table=default.Table_ccb48e8b4c054186a749ca16ba0e6d1f [id=9e0f3ed716134fe692830fc6fcf4e442]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:03.682174 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:03.682228 4470 catalog_manager.cc:5526] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:03.682685 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c0541097b0b4916b559c14e48e08540 consensus state has no leader
I20250115 10:12:03.683130 4569 tablet_bootstrap.cc:492] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.683171 4569 ts_tablet_manager.cc:1397] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.063s user 0.000s sys 0.000s
I20250115 10:12:03.683331 4569 raft_consensus.cc:357] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.683390 4569 raft_consensus.cc:383] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.683413 4569 raft_consensus.cc:738] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.682476 3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5490db43ba14c039847a9326a7620c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.683458 4569 consensus_queue.cc:260] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.683558 4569 ts_tablet_manager.cc:1428] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.683619 4569 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.683697 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.683800 3546 raft_consensus.cc:2463] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:03.676705 3350 leader_election.cc:343] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.676695 3391 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb1552d8cb541a6a2df109ea111c23f (DEFAULT_TABLE table=default.Table_d60729676fcc4f469e553b563bb6bafa [id=f473bb79920947c8a4c16ceef1992e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.684428 3393 tablet_service.cc:1467] Processing CreateTablet for tablet 8def1d79286c4b8b8077121a24abee44 (DEFAULT_TABLE table=default.Table_9f0ac088111e458cbfa9f307456bba2f [id=5db8bd17802945d0bb8da8ec96b84f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.684500 3393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8def1d79286c4b8b8077121a24abee44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.684587 3350 leader_election.cc:304] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.684903 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e04c866114cefbddc1bdb54d31cff (DEFAULT_TABLE table=default.Table_67cce5abd27a4efc98535136874b4b64 [id=2c6928614f5f447baf7b7c51f8b9d8ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.684976 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9e04c866114cefbddc1bdb54d31cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.686012 3391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1552d8cb541a6a2df109ea111c23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.686189 3383 tablet_service.cc:1467] Processing CreateTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.686262 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c21c9b21c7c4aed981029846b28aee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.686439 3259 tablet_service.cc:1467] Processing CreateTablet for tablet 7c3e1f44b1794f398f07bf767d54652f (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.687244 3383 tablet_service.cc:1467] Processing CreateTablet for tablet e90df067a820456db899065f0c04fe6b (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.687321 3383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90df067a820456db899065f0c04fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.687443 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.687851 4699 raft_consensus.cc:2798] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.687894 4699 raft_consensus.cc:491] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.687919 4699 raft_consensus.cc:3054] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.688515 4699 raft_consensus.cc:513] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.688609 4699 leader_election.cc:290] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.688865 4731 raft_consensus.cc:491] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.688925 4731 raft_consensus.cc:513] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.689004 3378 tablet_service.cc:1467] Processing CreateTablet for tablet a16e074cf07c42e9b5e5596e81b4bd94 (DEFAULT_TABLE table=default.Table_5b3caceeab0d45b6a773279c45eafe33 [id=23b10a454cf04d14be8444c25e092197]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.689035 4731 leader_election.cc:290] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.689061 4731 raft_consensus.cc:491] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.689076 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16e074cf07c42e9b5e5596e81b4bd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.689079 4731 raft_consensus.cc:513] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.689128 4731 leader_election.cc:290] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.689431 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09db89ab7dd543559ae8a11e60c8a873" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.689487 3413 raft_consensus.cc:2463] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.689626 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09db89ab7dd543559ae8a11e60c8a873" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.689700 3214 leader_election.cc:304] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.689812 3770 raft_consensus.cc:2798] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.689842 3770 raft_consensus.cc:491] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.689863 3770 raft_consensus.cc:3054] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.689944 3215 leader_election.cc:343] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.690122 3378 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca42518736949a78609ff22b6f5bdce (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.690196 3378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42518736949a78609ff22b6f5bdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.690253 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.690310 3414 raft_consensus.cc:2463] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.690555 3770 raft_consensus.cc:513] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.690655 3770 leader_election.cc:290] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.691352 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.691444 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:12:03.691628 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.691857 4592 tablet_replica.cc:331] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.691884 3214 leader_election.cc:304] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.691939 4592 raft_consensus.cc:2238] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:03.692203 3215 leader_election.cc:343] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.692327 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09db89ab7dd543559ae8a11e60c8a873" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.691982 4592 raft_consensus.cc:2267] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.692549 3215 leader_election.cc:343] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.692070 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09db89ab7dd543559ae8a11e60c8a873" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.692621 3414 raft_consensus.cc:3054] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.692739 4714 raft_consensus.cc:491] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.692782 4592 ts_tablet_manager.cc:1905] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.692786 4714 raft_consensus.cc:513] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.692920 4714 leader_election.cc:290] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.636507 3250 tablet_service.cc:1467] Processing CreateTablet for tablet 18bb0a4436354a58976f610fab166bcf (DEFAULT_TABLE table=default.Table_7dc37da2eb7d41798faead893c7953b8 [id=81d844c461fe48a9ba8eecfee498b96d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.636533 3255 tablet_service.cc:1467] Processing CreateTablet for tablet cc37ef40aab243c4ab4057ef2ff657e7 (DEFAULT_TABLE table=default.Table_f718abe0d8434e698daeb535c0be93c1 [id=cd6023dfbefb466aba1e462fd9418f8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.693109 3770 raft_consensus.cc:2798] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.636318 3247 tablet_service.cc:1467] Processing CreateTablet for tablet 31b8334f3d734968a0a7ba148bd90d72 (DEFAULT_TABLE table=default.Table_730810b9477747d6a9ac4fabeceb1305 [id=daec5ec82d084d9cbd1addeb817bd884]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.693166 3770 raft_consensus.cc:491] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.693192 3770 raft_consensus.cc:3054] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.693220 3414 raft_consensus.cc:2463] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.693332 3246 tablet_service.cc:1467] Processing CreateTablet for tablet e143f851a88f45f0908152069c6a558b (DEFAULT_TABLE table=default.Table_b439b608419f459f8f77a0800a4ef734 [id=08169901d7b14df684fd38690e278cde]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.680228 3386 tablet_service.cc:1467] Processing CreateTablet for tablet dacd2778d9e54877b8ef6d52529c3539 (DEFAULT_TABLE table=default.Table_8c3be9ad849f479dbc770b2d6ec9f237 [id=c29867195cec4cdda0a64e63b097ec7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.693792 3770 raft_consensus.cc:513] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.693893 3770 leader_election.cc:290] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.636571 3254 tablet_service.cc:1467] Processing CreateTablet for tablet bae5b5194bcc4fcabe77b9ef2abf80be (DEFAULT_TABLE table=default.Table_2bf4b207818b4981b8c9f52f2cc5ace8 [id=ffa5018b5e914cd286cce59655421c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.636595 3256 tablet_service.cc:1467] Processing CreateTablet for tablet 46aacb7a8c9b42588e67e6e4aef7613d (DEFAULT_TABLE table=default.Table_c0b9984c36924f0fbab00b37829f98ca [id=8e9bd4cf3fa346faa2242ec0eef2a653]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.641875 4335 raft_consensus.cc:491] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.694089 4335 raft_consensus.cc:513] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.694187 4335 leader_election.cc:290] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.645612 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b580a5dc6a9c4a0f8b65ad9a92804e09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.694290 3278 raft_consensus.cc:2463] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.648624 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c5eb11332cb4489ade8f441158eb958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.694435 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87fa663159fc4c95a8499a84f7b6faed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.694516 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc37ef40aab243c4ab4057ef2ff657e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.694516 3485 leader_election.cc:304] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.694624 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae5b5194bcc4fcabe77b9ef2abf80be. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.694612 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.694705 4433 raft_consensus.cc:2798] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.694738 4433 raft_consensus.cc:491] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.694756 4433 raft_consensus.cc:3054] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.695350 4433 raft_consensus.cc:513] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.695461 4433 leader_election.cc:290] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.695565 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.695572 3255 tablet_service.cc:1467] Processing CreateTablet for tablet bc03234954824a64aa8d8abd5fc1dc29 (DEFAULT_TABLE table=default.Table_b056ece1636f4b1bb6bd53bf85e607a4 [id=2cef07bfd59448729380f258c5d77e96]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.695616 3414 raft_consensus.cc:3054] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.695617 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29d9a01abd314d0e9f60df4f6736985b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.695775 3250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18bb0a4436354a58976f610fab166bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.636557 3251 tablet_service.cc:1467] Processing CreateTablet for tablet aa25f3b8144f407c9c437be6676379b2 (DEFAULT_TABLE table=default.Table_6051563ff45d4e82b8c874f88c8cdaa0 [id=ef6842ab6593487db3531e1620804f4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.695864 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc7f2fbfc9a4cd9b88965e6725a69ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.695915 3254 tablet_service.cc:1467] Processing CreateTablet for tablet cb8da7533f8041768533184ef0a33d3f (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.637281 3952 raft_consensus.cc:491] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.695993 3256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46aacb7a8c9b42588e67e6e4aef7613d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.695971 3952 raft_consensus.cc:513] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.696038 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b580a5dc6a9c4a0f8b65ad9a92804e09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.696080 3248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80f0fe74b55740dd94f97eaf27992e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.696105 3278 raft_consensus.cc:3054] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.696121 3952 leader_election.cc:290] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.696182 3255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc03234954824a64aa8d8abd5fc1dc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.695572 3245 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb1552d8cb541a6a2df109ea111c23f (DEFAULT_TABLE table=default.Table_d60729676fcc4f469e553b563bb6bafa [id=f473bb79920947c8a4c16ceef1992e2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.696306 3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c3e1f44b1794f398f07bf767d54652f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.696374 3247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8334f3d734968a0a7ba148bd90d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.696442 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e143f851a88f45f0908152069c6a558b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.696520 4569 tablet_bootstrap.cc:654] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.696708 3278 raft_consensus.cc:2463] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.696808 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.696898 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.696949 3548 raft_consensus.cc:2463] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.696956 3415 raft_consensus.cc:2463] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.697010 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.632948 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 18c05e81b1354e26900949537465cf08 (DEFAULT_TABLE table=default.Table_cf11404b146e4e1e8d59cb7501344676 [id=3066cface64b42e584332ff53f077b27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.697592 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c05e81b1354e26900949537465cf08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.697957 3243 tablet_service.cc:1467] Processing CreateTablet for tablet d5490db43ba14c039847a9326a7620c4 (DEFAULT_TABLE table=default.Table_2f58c731b132438cb439ebc2423f3769 [id=03a8b674905346939ae0d19e38baf46d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.698043 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5490db43ba14c039847a9326a7620c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.698091 3258 tablet_service.cc:1467] Processing CreateTablet for tablet dacd2778d9e54877b8ef6d52529c3539 (DEFAULT_TABLE table=default.Table_8c3be9ad849f479dbc770b2d6ec9f237 [id=c29867195cec4cdda0a64e63b097ec7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.698177 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd2778d9e54877b8ef6d52529c3539. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.698205 3215 leader_election.cc:343] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.698244 3215 leader_election.cc:304] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.698318 3215 leader_election.cc:343] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.698357 3952 raft_consensus.cc:2798] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.698393 3952 raft_consensus.cc:491] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.698410 3952 raft_consensus.cc:3054] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.698957 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 08bee9d860f64bf5937ea9bdb095391b (DEFAULT_TABLE table=default.Table_afec1e69165e46f4a401075412905128 [id=a04c49538202493d952ae61c912fb5ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.698998 3952 raft_consensus.cc:513] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.699035 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08bee9d860f64bf5937ea9bdb095391b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.699090 3952 leader_election.cc:290] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.699105 3243 tablet_service.cc:1467] Processing CreateTablet for tablet f22785e218cb4a54ba56757c8251cfd7 (DEFAULT_TABLE table=default.Table_ccb48e8b4c054186a749ca16ba0e6d1f [id=9e0f3ed716134fe692830fc6fcf4e442]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.699172 3243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22785e218cb4a54ba56757c8251cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.699304 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 8def1d79286c4b8b8077121a24abee44 (DEFAULT_TABLE table=default.Table_9f0ac088111e458cbfa9f307456bba2f [id=5db8bd17802945d0bb8da8ec96b84f08]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.699384 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8def1d79286c4b8b8077121a24abee44. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.699568 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.699625 3279 raft_consensus.cc:2388] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:03.700423 3245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb1552d8cb541a6a2df109ea111c23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.700970 3251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa25f3b8144f407c9c437be6676379b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.701020 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 7c9e04c866114cefbddc1bdb54d31cff (DEFAULT_TABLE table=default.Table_67cce5abd27a4efc98535136874b4b64 [id=2c6928614f5f447baf7b7c51f8b9d8ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.701694 4699 raft_consensus.cc:491] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.701756 4699 raft_consensus.cc:513] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.701851 4699 leader_election.cc:290] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.702078 3253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af3da67d9348d7bc890b7981d8b5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.702198 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.702297 3249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4732608c02834f5891a70d4ec91b9e4b. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.702337 3350 leader_election.cc:343] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.702394 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6855da12502047aba54041f663c44f86. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.702448 3391 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d5a121a87648ecbb842f52bc361602 with delete_type TABLET_DATA_DELETED (replaced by tablet 900475e1e900423c9b9205540f67e5de) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.702454 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.702488 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f778154f3bc3420abe9eb87608228bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.702499 3484 leader_election.cc:304] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.702574 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5371af45cc4382bea26abd9df1094d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.702587 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.702672 3549 raft_consensus.cc:3054] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.702641 3350 leader_election.cc:343] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.702714 3350 leader_election.cc:304] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.702735 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8da7533f8041768533184ef0a33d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.702805 4699 raft_consensus.cc:2743] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.703411 3549 raft_consensus.cc:2463] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.703510 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b580a5dc6a9c4a0f8b65ad9a92804e09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.703567 3215 leader_election.cc:304] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.703615 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cff61c5261f44b12b0da4cd3b6e58ddc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.703677 3952 raft_consensus.cc:2798] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.703742 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.703716 3952 raft_consensus.cc:695] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.691771 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22785e218cb4a54ba56757c8251cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.703802 3548 raft_consensus.cc:3054] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.703817 3952 consensus_queue.cc:237] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.703745 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.703939 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c21c9b21c7c4aed981029846b28aee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.704512 3548 raft_consensus.cc:2463] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:03.705714 3484 leader_election.cc:343] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.705806 3485 leader_election.cc:304] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.705885 4434 raft_consensus.cc:2798] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.705925 4434 raft_consensus.cc:695] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.705974 4434 consensus_queue.cc:237] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.706233 4434 raft_consensus.cc:2798] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.706235 4592 ts_tablet_manager.cc:1918] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.706269 4434 raft_consensus.cc:695] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.706282 4592 log.cc:1198] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3b89df9f987e46ae98fe21df847cb311
I20250115 10:12:03.706310 4434 consensus_queue.cc:237] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.706458 4592 ts_tablet_manager.cc:1939] T 3b89df9f987e46ae98fe21df847cb311 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.704522 3350 leader_election.cc:304] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.706650 3350 leader_election.cc:304] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.704782 4575 tablet_bootstrap.cc:492] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.706732 4699 raft_consensus.cc:2798] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.706709 4714 raft_consensus.cc:3054] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.706782 4699 raft_consensus.cc:695] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.706825 4699 consensus_queue.cc:237] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.707331 4714 raft_consensus.cc:2743] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.707410 4592 tablet_replica.cc:331] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.707482 4592 raft_consensus.cc:2238] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.707509 4592 raft_consensus.cc:2267] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.707768 4471 catalog_manager.cc:5526] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.707872 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:03.706717 4575 ts_tablet_manager.cc:1397] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.000s
I20250115 10:12:03.708381 4575 raft_consensus.cc:357] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.708436 4575 raft_consensus.cc:383] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.708463 4575 raft_consensus.cc:738] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.708499 4575 consensus_queue.cc:260] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.708606 4575 ts_tablet_manager.cc:1428] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.708670 4575 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.709201 3414 raft_consensus.cc:2463] T bcd888d924fd43b590710613560f16d5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.709281 4575 tablet_bootstrap.cc:654] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.694291 3214 leader_election.cc:304] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.709694 4569 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.709739 4569 ts_tablet_manager.cc:1397] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s
W20250115 10:12:03.709812 3214 leader_election.cc:343] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.709870 3214 leader_election.cc:304] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.709880 4569 raft_consensus.cc:357] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.709926 4569 raft_consensus.cc:383] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.709944 3770 raft_consensus.cc:491] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.709884 4470 catalog_manager.cc:5526] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.709988 4470 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.709981 3770 raft_consensus.cc:513] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.710021 4470 catalog_manager.cc:5526] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.709932 3952 raft_consensus.cc:2798] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.710083 3770 leader_election.cc:290] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.710088 3952 raft_consensus.cc:695] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.709951 4569 raft_consensus.cc:738] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.710191 4569 consensus_queue.cc:260] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.710291 4569 ts_tablet_manager.cc:1428] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.710153 3952 consensus_queue.cc:237] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.710116 3770 raft_consensus.cc:2798] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.710515 3770 raft_consensus.cc:695] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.710547 3770 consensus_queue.cc:237] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.710605 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.710911 3260 tablet_service.cc:1467] Processing CreateTablet for tablet e90df067a820456db899065f0c04fe6b (DEFAULT_TABLE table=default.Table_da80d7c2bd9a4955a1d674908d1b02ad [id=a747fe01d029453d8ed1964e3a2558d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.711019 3254 tablet_service.cc:1467] Processing CreateTablet for tablet a16e074cf07c42e9b5e5596e81b4bd94 (DEFAULT_TABLE table=default.Table_5b3caceeab0d45b6a773279c45eafe33 [id=23b10a454cf04d14be8444c25e092197]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.711160 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16e074cf07c42e9b5e5596e81b4bd94. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.711493 4468 catalog_manager.cc:5526] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.711585 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.712106 3254 tablet_service.cc:1467] Processing CreateTablet for tablet 4ca42518736949a78609ff22b6f5bdce (DEFAULT_TABLE table=default.Table_d37ea38953124a22807cf32598d5f6d8 [id=c89e9c43b4f84806948428aa3569b983]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.712175 3254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ca42518736949a78609ff22b6f5bdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.712785 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
W20250115 10:12:03.713035 3214 leader_election.cc:343] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.713150 4569 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.713569 4569 tablet_bootstrap.cc:654] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.713667 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd2778d9e54877b8ef6d52529c3539. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.713667 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e90df067a820456db899065f0c04fe6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.713913 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.713977 3413 raft_consensus.cc:2463] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.714133 4569 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.714169 4569 ts_tablet_manager.cc:1397] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.714300 4569 raft_consensus.cc:357] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.714363 4569 raft_consensus.cc:383] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.714385 4569 raft_consensus.cc:738] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.714424 4569 consensus_queue.cc:260] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.714512 4569 ts_tablet_manager.cc:1428] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.714560 4569 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.714956 4569 tablet_bootstrap.cc:654] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.716310 4592 ts_tablet_manager.cc:1905] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.717641 3214 leader_election.cc:304] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.717710 4731 raft_consensus.cc:2798] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.717733 4731 raft_consensus.cc:491] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.717749 4731 raft_consensus.cc:3054] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.717939 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 00e78a8b61e142199ba7bf73e3879b98 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.718065 4592 ts_tablet_manager.cc:1918] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.718103 4592 log.cc:1198] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/21d5a121a87648ecbb842f52bc361602
I20250115 10:12:03.718264 4592 ts_tablet_manager.cc:1939] T 21d5a121a87648ecbb842f52bc361602 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.718410 4731 raft_consensus.cc:513] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.718508 4731 leader_election.cc:290] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.719038 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.719125 3546 raft_consensus.cc:3054] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.719815 4731 raft_consensus.cc:491] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.719869 4731 raft_consensus.cc:513] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.719895 4557 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.719942 4557 ts_tablet_manager.cc:1397] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.118s user 0.001s sys 0.000s
I20250115 10:12:03.719967 4731 leader_election.cc:290] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.720085 4557 raft_consensus.cc:357] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.720136 4557 raft_consensus.cc:383] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.720152 4557 raft_consensus.cc:738] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.720139 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.720189 4557 consensus_queue.cc:260] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.720274 4557 ts_tablet_manager.cc:1428] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.720252 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff89486cde3f49528e4007189911ce4e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.720343 4557 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.720919 4557 tablet_bootstrap.cc:654] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.721172 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1fc5a24c5b6c4df9af151db5824f51f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.721230 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7818a79436444c5a910f62c00aedd41a" } new_table_name: "default.Table_f38308d61eec4f2988d3d98f6b47660a" modify_external_catalogs: true
W20250115 10:12:03.721290 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1fc5a24c5b6c4df9af151db5824f51f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.721436 4476 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_273a3677ac2f4e0f8f78271c44915a39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.721499 4476 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_273a3677ac2f4e0f8f78271c44915a39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.721995 4569 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.722029 4569 ts_tablet_manager.cc:1397] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:03.722072 4477 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c0ff9042b1554e91a840ad8adde05cc9" } new_table_name: "default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e" modify_external_catalogs: true
I20250115 10:12:03.722158 4569 raft_consensus.cc:357] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.722203 4569 raft_consensus.cc:383] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.722222 4569 raft_consensus.cc:738] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.722246 4569 consensus_queue.cc:260] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.722249 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2648dfb12d924eda9b18368da8df24a5" } new_table_name: "default.Table_47c3cc66d3ad4c95be45caf7ee18b108" modify_external_catalogs: true
I20250115 10:12:03.722335 4569 ts_tablet_manager.cc:1428] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.722389 4569 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.723022 4569 tablet_bootstrap.cc:654] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.723157 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_bfba31991c3146efa1d0b133ab6c6435"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.723249 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bfba31991c3146efa1d0b133ab6c6435 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:03.723381 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a577ace8245744d1a42938ddd99ce89b consensus state has no leader
I20250115 10:12:03.723806 4731 raft_consensus.cc:491] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.723860 4731 raft_consensus.cc:513] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.723929 4731 leader_election.cc:290] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.723943 4587 raft_consensus.cc:491] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.723992 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9e04c866114cefbddc1bdb54d31cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.723994 4587 raft_consensus.cc:513] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.724098 4587 leader_election.cc:290] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.724196 3350 leader_election.cc:343] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.724284 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe7181347114ccfbf62109147d182b3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.724334 3547 raft_consensus.cc:2463] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.724436 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.724476 3547 raft_consensus.cc:2463] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.724576 3350 leader_election.cc:304] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.724640 4587 raft_consensus.cc:2798] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.724661 4587 raft_consensus.cc:491] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.724678 4587 raft_consensus.cc:3054] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.725303 4587 raft_consensus.cc:513] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.725354 4569 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.725373 3546 raft_consensus.cc:2463] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.725389 4569 ts_tablet_manager.cc:1397] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.725410 4587 leader_election.cc:290] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.725538 4569 raft_consensus.cc:357] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.725577 3214 leader_election.cc:343] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.725628 3214 leader_election.cc:304] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.725644 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe7181347114ccfbf62109147d182b3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.725680 4731 raft_consensus.cc:2743] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.725700 3415 raft_consensus.cc:2463] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.725719 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.725811 3215 leader_election.cc:304] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.725888 3214 leader_election.cc:343] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.725910 4731 raft_consensus.cc:2798] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.726023 4731 raft_consensus.cc:491] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.726042 4731 raft_consensus.cc:3054] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.726073 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f81769b500149f7b2bf7cdf76f7ee27 consensus state has no leader
W20250115 10:12:03.726218 4477 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8441d13c5b0c47bb9e16655c964ab58f consensus state has no leader
I20250115 10:12:03.726531 4575 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.726569 4575 ts_tablet_manager.cc:1397] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20250115 10:12:03.726552 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.726613 3548 raft_consensus.cc:2371] T 9bc7d63d8661445cb804762413eac194 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1. Re-sending same reply.
I20250115 10:12:03.726667 4575 raft_consensus.cc:357] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.726680 4731 raft_consensus.cc:513] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.726716 4575 raft_consensus.cc:383] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.726737 4575 raft_consensus.cc:738] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.726771 4731 leader_election.cc:290] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.726792 4575 consensus_queue.cc:260] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.726899 4575 ts_tablet_manager.cc:1428] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.726948 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3b89df9f987e46ae98fe21df847cb311 (table default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]) successfully deleted
I20250115 10:12:03.726974 4575 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.726999 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 21d5a121a87648ecbb842f52bc361602 (table default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]) successfully deleted
I20250115 10:12:03.727324 4575 tablet_bootstrap.cc:654] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.727528 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bc7d63d8661445cb804762413eac194" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.727586 3414 raft_consensus.cc:3054] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.727758 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.727829 3549 raft_consensus.cc:2463] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.728031 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe7181347114ccfbf62109147d182b3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.728087 3413 raft_consensus.cc:3054] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.728729 3413 raft_consensus.cc:2463] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.729027 4731 raft_consensus.cc:491] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.729069 4731 raft_consensus.cc:513] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.729151 4731 leader_election.cc:290] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.729192 4587 raft_consensus.cc:491] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.729138 4470 catalog_manager.cc:5526] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.729225 3214 leader_election.cc:304] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.729234 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:03.729225 4587 raft_consensus.cc:513] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.729272 4731 raft_consensus.cc:2798] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.729296 4731 raft_consensus.cc:695] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.729292 4587 leader_election.cc:290] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.729271 4470 catalog_manager.cc:5526] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.729326 4731 consensus_queue.cc:237] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.725890 3215 leader_election.cc:304] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.729518 4731 raft_consensus.cc:2798] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.729549 4731 raft_consensus.cc:695] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.729580 4731 consensus_queue.cc:237] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.729645 3215 leader_election.cc:304] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.729759 4731 raft_consensus.cc:2798] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.729789 4731 raft_consensus.cc:491] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.729809 4731 raft_consensus.cc:3054] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.729852 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.729904 3278 raft_consensus.cc:2463] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.729959 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.730013 3548 raft_consensus.cc:2463] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.730201 3215 leader_election.cc:304] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.730295 3952 raft_consensus.cc:2798] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.730324 3952 raft_consensus.cc:491] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.730353 3952 raft_consensus.cc:3054] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.730365 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.730554 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.730618 3413 raft_consensus.cc:2388] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:03.730589 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.730644 3278 raft_consensus.cc:2388] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:03.730322 4731 raft_consensus.cc:513] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.730701 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe7181347114ccfbf62109147d182b3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.730746 3549 raft_consensus.cc:3054] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.730773 4731 leader_election.cc:290] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.730904 3952 raft_consensus.cc:513] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.731006 3952 leader_election.cc:290] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.731050 3279 raft_consensus.cc:2388] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:03.731212 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.731341 3549 raft_consensus.cc:2463] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:03.731432 3214 leader_election.cc:343] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.731474 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.731536 3546 raft_consensus.cc:3054] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.732142 3546 raft_consensus.cc:2463] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.732209 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.732249 3549 raft_consensus.cc:2388] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:03.732300 3414 raft_consensus.cc:2463] T 9bc7d63d8661445cb804762413eac194 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.732532 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c0541097b0b4916b559c14e48e08540" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.732589 3548 raft_consensus.cc:3054] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.733158 3548 raft_consensus.cc:2463] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.733228 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b573af4521064addb5bf2da9c70a79f0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.733287 3415 raft_consensus.cc:2388] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:03.733515 3214 leader_election.cc:304] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.733594 3952 raft_consensus.cc:2743] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.733696 3215 leader_election.cc:304] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.733790 3952 raft_consensus.cc:2798] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.733836 3952 raft_consensus.cc:695] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.733873 3952 consensus_queue.cc:237] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.733920 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140bf4fc35274f2284c24534d3644695" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.734337 3350 leader_election.cc:304] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.734441 3350 leader_election.cc:304] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.734517 4714 raft_consensus.cc:2798] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.734551 4714 raft_consensus.cc:695] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.734578 4699 raft_consensus.cc:3054] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.734584 4714 consensus_queue.cc:237] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.735127 4699 raft_consensus.cc:2743] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.735121 4474 catalog_manager.cc:5526] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.735241 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.735886 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 00e78a8b61e142199ba7bf73e3879b98
I20250115 10:12:03.735976 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 00e78a8b61e142199ba7bf73e3879b98 deleted and replaced by tablet 3125a457c6c24954a547ace659eefc19
I20250115 10:12:03.736245 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 3125a457c6c24954a547ace659eefc19) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.736393 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.736985 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 3125a457c6c24954a547ace659eefc19) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.737082 4589 tablet_replica.cc:331] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.737151 4589 raft_consensus.cc:2238] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.737178 4589 raft_consensus.cc:2267] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.737339 4589 ts_tablet_manager.cc:1905] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:03.737360 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 00e78a8b61e142199ba7bf73e3879b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00e78a8b61e142199ba7bf73e3879b98 already in progress: creating tablet
W20250115 10:12:03.737424 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 00e78a8b61e142199ba7bf73e3879b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00e78a8b61e142199ba7bf73e3879b98 already in progress: creating tablet
I20250115 10:12:03.737545 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 424956b90563455d8140a49fcaa05206 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.725589 4569 raft_consensus.cc:383] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.737782 4569 raft_consensus.cc:738] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.737823 4569 consensus_queue.cc:260] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.737928 4569 ts_tablet_manager.cc:1428] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.013s user 0.000s sys 0.000s
I20250115 10:12:03.737979 4569 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.738237 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 00e78a8b61e142199ba7bf73e3879b98 with delete_type TABLET_DATA_DELETED (replaced by tablet 3125a457c6c24954a547ace659eefc19) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.738413 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 00e78a8b61e142199ba7bf73e3879b98 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00e78a8b61e142199ba7bf73e3879b98 already in progress: creating tablet
I20250115 10:12:03.738422 4569 tablet_bootstrap.cc:654] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.739003 4470 master_service.cc:946] ReplaceTablet: received request to replace tablet 0d7c1c0ac4d3487187907a49343381c0 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.739382 4589 ts_tablet_manager.cc:1918] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.739427 4589 log.cc:1198] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:03.739598 4589 ts_tablet_manager.cc:1939] T 8a3ebf56500b4c97b7553644d62fe83a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.740478 4557 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.740532 4557 ts_tablet_manager.cc:1397] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20250115 10:12:03.741297 4557 raft_consensus.cc:357] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.741400 4557 raft_consensus.cc:383] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.741420 4557 raft_consensus.cc:738] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.741457 4557 consensus_queue.cc:260] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.741552 4557 ts_tablet_manager.cc:1428] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.742647 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 8a3ebf56500b4c97b7553644d62fe83a (table default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]) successfully deleted
I20250115 10:12:03.742888 4557 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.743218 4557 tablet_bootstrap.cc:654] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.743670 4557 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.743696 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 96506d095fe74ea8941b760814e393f2 (DEFAULT_TABLE table=default.Table_bfba31991c3146efa1d0b133ab6c6435 [id=e85154bb46c748da83255cea6ab52b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.743767 4557 ts_tablet_manager.cc:1397] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.743868 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96506d095fe74ea8941b760814e393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.743916 4557 raft_consensus.cc:357] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.743975 4557 raft_consensus.cc:383] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.743996 4557 raft_consensus.cc:738] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.744035 4557 consensus_queue.cc:260] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.744118 4557 ts_tablet_manager.cc:1428] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.744184 4557 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.744407 4557 tablet_bootstrap.cc:654] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.745177 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 04c5352e522a49ceb65bf409111b7969 (DEFAULT_TABLE table=default.Table_1fc5a24c5b6c4df9af151db5824f51f8 [id=83cd80527251481f8be5f1a4f9bbe641]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.745307 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c5352e522a49ceb65bf409111b7969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.745371 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 0b401233481b445bbf0f394083719ed1 (DEFAULT_TABLE table=default.Table_273a3677ac2f4e0f8f78271c44915a39 [id=4a049aacc9f841c7b246875d82a64510]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.745468 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b401233481b445bbf0f394083719ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.745636 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 96506d095fe74ea8941b760814e393f2 (DEFAULT_TABLE table=default.Table_bfba31991c3146efa1d0b133ab6c6435 [id=e85154bb46c748da83255cea6ab52b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.745733 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96506d095fe74ea8941b760814e393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.746513 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 0b401233481b445bbf0f394083719ed1 (DEFAULT_TABLE table=default.Table_273a3677ac2f4e0f8f78271c44915a39 [id=4a049aacc9f841c7b246875d82a64510]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.746594 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b401233481b445bbf0f394083719ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.746711 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 04c5352e522a49ceb65bf409111b7969 (DEFAULT_TABLE table=default.Table_1fc5a24c5b6c4df9af151db5824f51f8 [id=83cd80527251481f8be5f1a4f9bbe641]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.746825 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c5352e522a49ceb65bf409111b7969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.746860 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 04c5352e522a49ceb65bf409111b7969 (DEFAULT_TABLE table=default.Table_1fc5a24c5b6c4df9af151db5824f51f8 [id=83cd80527251481f8be5f1a4f9bbe641]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.746935 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c5352e522a49ceb65bf409111b7969. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.747728 4699 raft_consensus.cc:491] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.747776 4699 raft_consensus.cc:513] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.747871 4699 leader_election.cc:290] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.747882 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 0b401233481b445bbf0f394083719ed1 (DEFAULT_TABLE table=default.Table_273a3677ac2f4e0f8f78271c44915a39 [id=4a049aacc9f841c7b246875d82a64510]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.747958 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b401233481b445bbf0f394083719ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.747960 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 96506d095fe74ea8941b760814e393f2 (DEFAULT_TABLE table=default.Table_bfba31991c3146efa1d0b133ab6c6435 [id=e85154bb46c748da83255cea6ab52b02]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.748055 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96506d095fe74ea8941b760814e393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.748207 4575 tablet_bootstrap.cc:492] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.748241 4575 ts_tablet_manager.cc:1397] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.000s
I20250115 10:12:03.748347 4575 raft_consensus.cc:357] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.748387 4575 raft_consensus.cc:383] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.748402 4575 raft_consensus.cc:738] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.748436 4575 consensus_queue.cc:260] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.748519 4575 ts_tablet_manager.cc:1428] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.748571 4575 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.748762 4731 raft_consensus.cc:491] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.748809 4731 raft_consensus.cc:513] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.748914 4731 leader_election.cc:290] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.748931 4575 tablet_bootstrap.cc:654] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.749150 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0e3265da9be49518705bedf6daa27a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.749210 3548 raft_consensus.cc:2463] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.749277 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0e3265da9be49518705bedf6daa27a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.749341 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.749497 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.749552 3415 raft_consensus.cc:2463] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:03.749663 3350 leader_election.cc:343] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.749655 3215 leader_election.cc:343] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.749714 3350 leader_election.cc:304] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.749835 4699 raft_consensus.cc:2798] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.749864 4699 raft_consensus.cc:491] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.749884 4699 raft_consensus.cc:3054] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.750281 4575 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.750322 4575 ts_tablet_manager.cc:1397] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.750468 4575 raft_consensus.cc:357] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.750524 4575 raft_consensus.cc:383] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.750473 4471 catalog_manager.cc:5526] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.750541 4575 raft_consensus.cc:738] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.750566 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8c0541097b0b4916b559c14e48e08540 (table default.Table_e7114f82478a498684df6ced2d600319 [id=ec98d4501a674ea1888c0b341153947c]). Expected version 1 got 0
I20250115 10:12:03.750576 4575 consensus_queue.cc:260] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.750607 4471 catalog_manager.cc:5526] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.750671 4575 ts_tablet_manager.cc:1428] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.750665 4471 catalog_manager.cc:5526] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.750712 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.750720 4575 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.750909 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:03.751230 4575 tablet_bootstrap.cc:654] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.751462 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 3125a457c6c24954a547ace659eefc19 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.751549 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3125a457c6c24954a547ace659eefc19. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:03.751571 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:03.751583 3214 leader_election.cc:304] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.751612 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:03.751643 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.751792 4731 raft_consensus.cc:2798] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.751830 4731 raft_consensus.cc:491] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.751858 4731 raft_consensus.cc:3054] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.751907 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 3125a457c6c24954a547ace659eefc19 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.751991 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3125a457c6c24954a547ace659eefc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.752478 4731 raft_consensus.cc:513] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.752584 4731 leader_election.cc:290] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.752808 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.752867 3415 raft_consensus.cc:3054] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.753046 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 424956b90563455d8140a49fcaa05206
I20250115 10:12:03.753122 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 424956b90563455d8140a49fcaa05206 deleted and replaced by tablet 341e075964894a8682f2cf603420009f
I20250115 10:12:03.753245 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8c0541097b0b4916b559c14e48e08540 (table default.Table_e7114f82478a498684df6ced2d600319 [id=ec98d4501a674ea1888c0b341153947c]). Expected version 1 got 0
I20250115 10:12:03.753484 3415 raft_consensus.cc:2463] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.750470 4699 raft_consensus.cc:513] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.753578 4699 leader_election.cc:290] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.753566 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:03.753657 4470 catalog_manager.cc:6596] ReplaceTablet: tablet 0d7c1c0ac4d3487187907a49343381c0 deleted and replaced by tablet 78313248b1a74c60882d27cd7649048b
I20250115 10:12:03.753715 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f33cd582313436ba2a8a71cb708384c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:03.753886 3215 leader_election.cc:343] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.754046 3214 leader_election.cc:304] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.754045 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 3125a457c6c24954a547ace659eefc19 (DEFAULT_TABLE table=default.Table_be2c2888c6e541858428dbf2cbd8fcd3 [id=cf4a28c9e32a4000a857168fda0c1cad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.754137 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3125a457c6c24954a547ace659eefc19. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.754208 4731 raft_consensus.cc:2798] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.754205 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 78313248b1a74c60882d27cd7649048b) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.754245 4731 raft_consensus.cc:695] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.754277 4731 consensus_queue.cc:237] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.754354 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 0d7c1c0ac4d3487187907a49343381c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d7c1c0ac4d3487187907a49343381c0 already in progress: creating tablet
I20250115 10:12:03.754432 4470 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:03.754606 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 424956b90563455d8140a49fcaa05206 with delete_type TABLET_DATA_DELETED (replaced by tablet 341e075964894a8682f2cf603420009f) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.754671 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 78313248b1a74c60882d27cd7649048b) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.754777 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 424956b90563455d8140a49fcaa05206 with delete_type TABLET_DATA_DELETED (replaced by tablet 341e075964894a8682f2cf603420009f) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.754819 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
W20250115 10:12:03.754945 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 424956b90563455d8140a49fcaa05206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424956b90563455d8140a49fcaa05206 already in progress: creating tablet
I20250115 10:12:03.755430 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0e3265da9be49518705bedf6daa27a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.755439 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0e3265da9be49518705bedf6daa27a1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.755491 3549 raft_consensus.cc:3054] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.755604 3350 leader_election.cc:343] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.756183 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 424956b90563455d8140a49fcaa05206 with delete_type TABLET_DATA_DELETED (replaced by tablet 341e075964894a8682f2cf603420009f) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.756225 3549 raft_consensus.cc:2463] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.756321 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d7c1c0ac4d3487187907a49343381c0 with delete_type TABLET_DATA_DELETED (replaced by tablet 78313248b1a74c60882d27cd7649048b) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.756386 3350 leader_election.cc:304] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.756497 4699 raft_consensus.cc:2798] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.756541 4699 raft_consensus.cc:695] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.756582 4699 consensus_queue.cc:237] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.756680 4575 tablet_bootstrap.cc:492] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.756727 4575 ts_tablet_manager.cc:1397] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:03.756870 4575 raft_consensus.cc:357] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.756916 4575 raft_consensus.cc:383] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.756932 4575 raft_consensus.cc:738] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.756963 4575 consensus_queue.cc:260] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.757040 4575 ts_tablet_manager.cc:1428] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.757092 4575 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.757108 4470 catalog_manager.cc:5526] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.757651 4575 tablet_bootstrap.cc:654] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.757815 4477 catalog_manager.cc:5526] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.758332 4557 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.758373 4557 ts_tablet_manager.cc:1397] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
W20250115 10:12:03.758368 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 424956b90563455d8140a49fcaa05206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424956b90563455d8140a49fcaa05206 already in progress: creating tablet
W20250115 10:12:03.758420 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 0d7c1c0ac4d3487187907a49343381c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d7c1c0ac4d3487187907a49343381c0 already in progress: creating tablet
I20250115 10:12:03.758463 4557 raft_consensus.cc:357] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.758499 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 424956b90563455d8140a49fcaa05206 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 424956b90563455d8140a49fcaa05206 already in progress: creating tablet
I20250115 10:12:03.758508 4557 raft_consensus.cc:383] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.758524 4557 raft_consensus.cc:738] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:12:03.758545 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 0d7c1c0ac4d3487187907a49343381c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d7c1c0ac4d3487187907a49343381c0 already in progress: creating tablet
I20250115 10:12:03.758561 4557 consensus_queue.cc:260] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.758635 4557 ts_tablet_manager.cc:1428] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.758692 4557 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.759045 4557 tablet_bootstrap.cc:654] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.759824 4434 raft_consensus.cc:491] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.759869 4434 raft_consensus.cc:513] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.759958 4434 leader_election.cc:290] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.760196 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.760264 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.760321 3415 raft_consensus.cc:2463] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:03.760542 3485 leader_election.cc:343] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.760756 3484 leader_election.cc:304] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.760880 4434 raft_consensus.cc:2798] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.760917 4434 raft_consensus.cc:491] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.760941 4434 raft_consensus.cc:3054] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.760957 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:03.761293 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet 57d3800d79794d3bad6c50d2dc8e9258 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.761547 4434 raft_consensus.cc:513] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.761653 4434 leader_election.cc:290] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.761801 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.761855 3415 raft_consensus.cc:3054] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.761823 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.762466 3415 raft_consensus.cc:2463] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:12:03.762738 3485 leader_election.cc:343] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.762794 3484 leader_election.cc:304] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.762888 4434 raft_consensus.cc:2798] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.762938 4434 raft_consensus.cc:695] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.762981 4434 consensus_queue.cc:237] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.764688 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet 6f33cd582313436ba2a8a71cb708384c from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.765353 4470 catalog_manager.cc:5526] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.766012 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 78313248b1a74c60882d27cd7649048b (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.766026 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 78313248b1a74c60882d27cd7649048b (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.766132 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78313248b1a74c60882d27cd7649048b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.766139 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78313248b1a74c60882d27cd7649048b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.766569 4557 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.766615 4557 ts_tablet_manager.cc:1397] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:03.766635 4575 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.766682 4575 ts_tablet_manager.cc:1397] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.000s
I20250115 10:12:03.766760 4557 raft_consensus.cc:357] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.766817 4557 raft_consensus.cc:383] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.766839 4557 raft_consensus.cc:738] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.766845 4575 raft_consensus.cc:357] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.766916 4575 raft_consensus.cc:383] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.766896 4557 consensus_queue.cc:260] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.766947 4575 raft_consensus.cc:738] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.766983 4575 consensus_queue.cc:260] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.767000 4557 ts_tablet_manager.cc:1428] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.767058 4557 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.767077 4575 ts_tablet_manager.cc:1428] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.767143 4575 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.767549 4575 tablet_bootstrap.cc:654] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.767657 4557 tablet_bootstrap.cc:654] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.768383 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 341e075964894a8682f2cf603420009f (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.768472 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341e075964894a8682f2cf603420009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.769408 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 78313248b1a74c60882d27cd7649048b (DEFAULT_TABLE table=default.Table_41b41ec907cd4106a3e77b05b00a2a0d [id=4fc064e4c9d14fde9532c09502d77dc7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.769446 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 341e075964894a8682f2cf603420009f (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.769512 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78313248b1a74c60882d27cd7649048b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.769516 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341e075964894a8682f2cf603420009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.770165 4569 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.770216 4569 ts_tablet_manager.cc:1397] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.001s
I20250115 10:12:03.770255 4575 tablet_bootstrap.cc:492] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.770294 4575 ts_tablet_manager.cc:1397] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.770368 4569 raft_consensus.cc:357] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.770432 4569 raft_consensus.cc:383] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.770449 4569 raft_consensus.cc:738] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.770488 4569 consensus_queue.cc:260] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.770478 4575 raft_consensus.cc:357] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.770526 4575 raft_consensus.cc:383] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.770545 4575 raft_consensus.cc:738] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.770568 4575 consensus_queue.cc:260] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.770583 4569 ts_tablet_manager.cc:1428] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.770653 4569 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.770671 4575 ts_tablet_manager.cc:1428] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.770722 4575 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.770905 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_87743a88b9cd4bbc816cf305d189bf4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.770993 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87743a88b9cd4bbc816cf305d189bf4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.771154 4575 tablet_bootstrap.cc:654] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.771154 4569 tablet_bootstrap.cc:654] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.771351 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 341e075964894a8682f2cf603420009f (DEFAULT_TABLE table=default.Table_cf02cb026779436ba2ab00d32700b1e1 [id=4e1726cbf3c340ee97b76ef674767ddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.771452 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 341e075964894a8682f2cf603420009f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.771808 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6f33cd582313436ba2a8a71cb708384c
I20250115 10:12:03.771883 4471 catalog_manager.cc:6596] ReplaceTablet: tablet 6f33cd582313436ba2a8a71cb708384c deleted and replaced by tablet 6aa7b604904145c3ac45082b76426ee5
I20250115 10:12:03.772146 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f33cd582313436ba2a8a71cb708384c with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa7b604904145c3ac45082b76426ee5) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.772248 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 4 got 0
I20250115 10:12:03.772352 4592 tablet_replica.cc:331] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.772413 4592 raft_consensus.cc:2238] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.772446 4592 raft_consensus.cc:2267] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.772500 4714 raft_consensus.cc:491] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:03.772548 3215 consensus_peers.cc:487] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d92890d082e242ccae8ad4e40d056c74. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.772540 4714 raft_consensus.cc:513] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.772622 4714 leader_election.cc:290] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.772639 4592 ts_tablet_manager.cc:1905] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.772990 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.773001 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.773058 3549 raft_consensus.cc:2463] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:03.773303 3350 leader_election.cc:343] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.773602 3350 leader_election.cc:304] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.773787 4714 raft_consensus.cc:2798] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.773828 4714 raft_consensus.cc:491] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.773857 4714 raft_consensus.cc:3054] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.774334 4592 ts_tablet_manager.cc:1918] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.774384 4592 log.cc:1198] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6f33cd582313436ba2a8a71cb708384c
I20250115 10:12:03.774463 4714 raft_consensus.cc:513] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.774561 4592 ts_tablet_manager.cc:1939] T 6f33cd582313436ba2a8a71cb708384c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.774771 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.774778 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2462c50d3684176aa5ff5caf79f9644" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.774840 3549 raft_consensus.cc:3054] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.774843 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6f33cd582313436ba2a8a71cb708384c (table default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]) successfully deleted
I20250115 10:12:03.775147 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f33cd582313436ba2a8a71cb708384c with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa7b604904145c3ac45082b76426ee5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.774569 4714 leader_election.cc:290] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.775348 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6f33cd582313436ba2a8a71cb708384c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f33cd582313436ba2a8a71cb708384c already in progress: creating tablet
I20250115 10:12:03.775475 3549 raft_consensus.cc:2463] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:03.775620 3350 leader_election.cc:343] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.775633 3952 raft_consensus.cc:491] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.775679 3350 leader_election.cc:304] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.775681 3952 raft_consensus.cc:513] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.775787 4714 raft_consensus.cc:2798] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.775813 3952 leader_election.cc:290] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.775844 4714 raft_consensus.cc:695] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.775892 4714 consensus_queue.cc:237] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.775961 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74ab86571c3a469da7a51cf6033c5b10" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.776033 3415 raft_consensus.cc:2463] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.776165 3214 leader_election.cc:304] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.776232 3952 raft_consensus.cc:2798] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.776255 3952 raft_consensus.cc:491] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.776279 3952 raft_consensus.cc:3054] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.776245 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74ab86571c3a469da7a51cf6033c5b10" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.776314 3549 raft_consensus.cc:2463] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.776953 3952 raft_consensus.cc:513] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.777058 3952 leader_election.cc:290] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.777196 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74ab86571c3a469da7a51cf6033c5b10" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.777248 3415 raft_consensus.cc:3054] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.777675 4557 tablet_bootstrap.cc:492] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.777715 4557 ts_tablet_manager.cc:1397] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.777878 3415 raft_consensus.cc:2463] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.777861 4557 raft_consensus.cc:357] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.777917 4557 raft_consensus.cc:383] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.777953 4557 raft_consensus.cc:738] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.777998 4557 consensus_queue.cc:260] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.778010 3214 leader_election.cc:304] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.778374 4731 raft_consensus.cc:2798] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.778422 4731 raft_consensus.cc:695] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.778456 4731 consensus_queue.cc:237] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.778931 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa7b604904145c3ac45082b76426ee5 (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.779043 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa7b604904145c3ac45082b76426ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.779230 4557 ts_tablet_manager.cc:1428] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.779301 4557 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.779695 4557 tablet_bootstrap.cc:654] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.779886 4575 tablet_bootstrap.cc:492] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.779923 4575 ts_tablet_manager.cc:1397] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:03.780061 4575 raft_consensus.cc:357] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.780119 4575 raft_consensus.cc:383] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.780141 4575 raft_consensus.cc:738] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.780176 4575 consensus_queue.cc:260] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.780262 4575 ts_tablet_manager.cc:1428] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.780313 4575 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.780437 4557 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.780472 4557 ts_tablet_manager.cc:1397] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.780601 4557 raft_consensus.cc:357] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.780643 4557 raft_consensus.cc:383] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.780668 4557 raft_consensus.cc:738] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.780665 4575 tablet_bootstrap.cc:654] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.780678 4470 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6784d4c136ef4130ae859c7ec4b4125b" } modify_external_catalogs: true
I20250115 10:12:03.780700 4557 consensus_queue.cc:260] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.780740 4470 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6784d4c136ef4130ae859c7ec4b4125b" } modify_external_catalogs: true
I20250115 10:12:03.780781 4557 ts_tablet_manager.cc:1428] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.780648 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74ab86571c3a469da7a51cf6033c5b10" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.780835 4557 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.780853 3549 raft_consensus.cc:3054] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.781229 4557 tablet_bootstrap.cc:654] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.781381 4699 raft_consensus.cc:491] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.781430 3549 raft_consensus.cc:2463] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.781426 4699 raft_consensus.cc:513] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.781515 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f33cd582313436ba2a8a71cb708384c with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa7b604904145c3ac45082b76426ee5) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.781540 4699 leader_election.cc:290] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.781591 4589 tablet_replica.cc:331] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.781643 4589 raft_consensus.cc:2238] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:03.781694 4589 pending_rounds.cc:62] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:03.781713 4589 pending_rounds.cc:69] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489543697670144 op_type: NO_OP noop_request { }
I20250115 10:12:03.781729 4569 tablet_bootstrap.cc:492] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.781745 4589 raft_consensus.cc:2883] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:03.781767 4589 raft_consensus.cc:2267] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.781775 4569 ts_tablet_manager.cc:1397] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.781931 4569 raft_consensus.cc:357] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.781980 4569 raft_consensus.cc:383] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.782003 4569 raft_consensus.cc:738] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.782022 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.782042 4569 consensus_queue.cc:260] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.782047 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_96e74365d1724614bc58fc1f92d4f8a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.782145 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96e74365d1724614bc58fc1f92d4f8a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.782148 4569 ts_tablet_manager.cc:1428] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.782171 3952 raft_consensus.cc:491] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.782199 4569 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.782215 3952 raft_consensus.cc:513] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.782297 3952 leader_election.cc:290] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.782485 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c6f8aad96bbc4bed888a43bc23bb7338" } new_table_name: "default.Table_f0619b05f37c439dba2a3d2f41709465" modify_external_catalogs: true
I20250115 10:12:03.782578 4569 tablet_bootstrap.cc:654] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.782692 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ab349b64b745ed97c3dae843b059aa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.782761 3415 raft_consensus.cc:2463] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.782879 3214 leader_election.cc:304] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.782955 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ab349b64b745ed97c3dae843b059aa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.783039 3549 raft_consensus.cc:2463] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.783145 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa7b604904145c3ac45082b76426ee5 (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.783088 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa7b604904145c3ac45082b76426ee5 (DEFAULT_TABLE table=default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.783164 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.783231 3549 raft_consensus.cc:2463] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.783263 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa7b604904145c3ac45082b76426ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.783288 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6aa7b604904145c3ac45082b76426ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.783807 3770 raft_consensus.cc:2798] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.783844 3770 raft_consensus.cc:491] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.783865 3770 raft_consensus.cc:3054] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.784194 3415 raft_consensus.cc:3054] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.784464 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f33cd582313436ba2a8a71cb708384c with delete_type TABLET_DATA_DELETED (replaced by tablet 6aa7b604904145c3ac45082b76426ee5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.784536 4551 tablet_replica.cc:331] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.784585 4551 raft_consensus.cc:2238] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.784555 3770 raft_consensus.cc:513] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.784615 4551 raft_consensus.cc:2267] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.784667 3770 leader_election.cc:290] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.784921 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ab349b64b745ed97c3dae843b059aa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.784993 3414 raft_consensus.cc:3054] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.785120 4477 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 4 got 0
I20250115 10:12:03.785274 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:03.785584 3414 raft_consensus.cc:2463] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.785876 3386 tablet_service.cc:1467] Processing CreateTablet for tablet eb79611319a8480da63394d0a77c1488 (DEFAULT_TABLE table=default.Table_87743a88b9cd4bbc816cf305d189bf4c [id=e36695cdb085421a99f6424f42b347ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.785900 4471 catalog_manager.cc:5526] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.785975 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb79611319a8480da63394d0a77c1488. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.786000 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.786254 3214 leader_election.cc:304] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.786329 4731 raft_consensus.cc:491] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.786358 4731 raft_consensus.cc:513] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.786450 4731 leader_election.cc:290] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.786489 4731 raft_consensus.cc:2798] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.786520 4731 raft_consensus.cc:695] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.786559 4731 consensus_queue.cc:237] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.786728 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75ab349b64b745ed97c3dae843b059aa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.786788 3548 raft_consensus.cc:3054] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.787127 4557 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.787137 4575 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.787161 4557 ts_tablet_manager.cc:1397] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.787178 4575 ts_tablet_manager.cc:1397] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.787298 3549 raft_consensus.cc:1270] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.787286 4557 raft_consensus.cc:357] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.787304 4575 raft_consensus.cc:357] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.787346 4557 raft_consensus.cc:383] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.787355 4575 raft_consensus.cc:383] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.787369 4557 raft_consensus.cc:738] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.787376 4575 raft_consensus.cc:738] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.787410 4575 consensus_queue.cc:260] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.787403 4557 consensus_queue.cc:260] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.787424 3548 raft_consensus.cc:2463] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.786731 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a485231d2de4fab8b86b4900976c76c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.787489 4575 ts_tablet_manager.cc:1428] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.787508 4557 ts_tablet_manager.cc:1428] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.787537 4575 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.787582 4557 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.787513 3546 raft_consensus.cc:2463] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.787783 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a485231d2de4fab8b86b4900976c76c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.787992 4575 tablet_bootstrap.cc:654] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.787997 4557 tablet_bootstrap.cc:654] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.788338 4589 ts_tablet_manager.cc:1905] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.788414 3215 leader_election.cc:304] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.788465 3214 leader_election.cc:343] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.788481 3770 consensus_queue.cc:1035] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.788525 4335 raft_consensus.cc:2798] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.788553 4335 raft_consensus.cc:491] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.788569 4335 raft_consensus.cc:3054] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.788846 3258 tablet_service.cc:1467] Processing CreateTablet for tablet eb79611319a8480da63394d0a77c1488 (DEFAULT_TABLE table=default.Table_87743a88b9cd4bbc816cf305d189bf4c [id=e36695cdb085421a99f6424f42b347ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.789086 3516 tablet_service.cc:1467] Processing CreateTablet for tablet eb79611319a8480da63394d0a77c1488 (DEFAULT_TABLE table=default.Table_87743a88b9cd4bbc816cf305d189bf4c [id=e36695cdb085421a99f6424f42b347ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.789183 4335 raft_consensus.cc:513] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.789220 3350 leader_election.cc:304] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.789237 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb79611319a8480da63394d0a77c1488. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.789284 4335 leader_election.cc:290] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.789284 3350 leader_election.cc:343] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.789355 4699 raft_consensus.cc:2798] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.789381 4699 raft_consensus.cc:491] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.789397 4699 raft_consensus.cc:3054] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.789955 4699 raft_consensus.cc:513] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.790046 4699 leader_election.cc:290] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.790623 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a485231d2de4fab8b86b4900976c76c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:03.790788 3214 leader_election.cc:343] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.790812 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a485231d2de4fab8b86b4900976c76c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.790887 3548 raft_consensus.cc:3054] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.790961 4575 tablet_bootstrap.cc:492] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.790947 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb79611319a8480da63394d0a77c1488. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.791025 4575 ts_tablet_manager.cc:1397] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.791167 4575 raft_consensus.cc:357] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.791234 4575 raft_consensus.cc:383] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.791256 4575 raft_consensus.cc:738] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.791311 4575 consensus_queue.cc:260] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.791416 4575 ts_tablet_manager.cc:1428] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.791461 3548 raft_consensus.cc:2463] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.791473 4575 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.791589 3215 leader_election.cc:304] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.791669 4335 raft_consensus.cc:2798] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.791757 4335 raft_consensus.cc:695] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.791800 4335 consensus_queue.cc:237] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.791888 4575 tablet_bootstrap.cc:654] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.791954 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8c0541097b0b4916b559c14e48e08540 (table default.Table_e7114f82478a498684df6ced2d600319 [id=ec98d4501a674ea1888c0b341153947c]). Expected version 1 got 0
I20250115 10:12:03.792004 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
W20250115 10:12:03.792604 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 10505ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:03.792829 4589 ts_tablet_manager.cc:1918] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:03.792879 4589 log.cc:1198] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6f33cd582313436ba2a8a71cb708384c
I20250115 10:12:03.793100 4589 ts_tablet_manager.cc:1939] T 6f33cd582313436ba2a8a71cb708384c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.793291 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.793510 4569 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.793520 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.793557 4569 ts_tablet_manager.cc:1397] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:03.793576 3548 raft_consensus.cc:3054] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.793709 4569 raft_consensus.cc:357] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.793792 4569 raft_consensus.cc:383] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.793810 4569 raft_consensus.cc:738] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.793844 4569 consensus_queue.cc:260] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.793943 4569 ts_tablet_manager.cc:1428] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.793995 4569 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.784940 3415 raft_consensus.cc:1270] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.794142 3548 raft_consensus.cc:2463] T 1e9c62a11d4744e199765f855fd0840b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:03.794183 3350 leader_election.cc:343] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.794387 4569 tablet_bootstrap.cc:654] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.794394 3350 leader_election.cc:304] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.794488 4699 raft_consensus.cc:2798] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.794534 4699 raft_consensus.cc:695] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.794584 4699 consensus_queue.cc:237] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.794988 4557 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.794961 4335 consensus_queue.cc:1035] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.795024 4557 ts_tablet_manager.cc:1397] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.795143 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.795167 4557 raft_consensus.cc:357] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.795217 4557 raft_consensus.cc:383] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.795256 4557 raft_consensus.cc:738] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.795300 4557 consensus_queue.cc:260] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.795392 4557 ts_tablet_manager.cc:1428] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.795454 4557 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.795861 4557 tablet_bootstrap.cc:654] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.797389 4667 tablet.cc:1721] T 8c0541097b0b4916b559c14e48e08540 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.797417 4662 tablet.cc:1721] T 8c0541097b0b4916b559c14e48e08540 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.798529 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6f33cd582313436ba2a8a71cb708384c (table default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]) successfully deleted
I20250115 10:12:03.798583 4434 raft_consensus.cc:491] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.798662 4434 raft_consensus.cc:513] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.798718 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_77de5a94d3fe42478dd6b0e8f1d03d26" } modify_external_catalogs: true
I20250115 10:12:03.798774 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_77de5a94d3fe42478dd6b0e8f1d03d26" } modify_external_catalogs: true
I20250115 10:12:03.798774 4434 leader_election.cc:290] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:03.799000 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7af3da67d9348d7bc890b7981d8b5e8 consensus state has no leader
I20250115 10:12:03.799257 4476 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_e58fc7d242e74ca29ccc9d8d9cb60f8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.799364 4476 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e58fc7d242e74ca29ccc9d8d9cb60f8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.799345 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a8431f0582fa439e99b774778d8281ac" } modify_external_catalogs: true
I20250115 10:12:03.799404 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a8431f0582fa439e99b774778d8281ac" } modify_external_catalogs: true
I20250115 10:12:03.799703 4434 raft_consensus.cc:491] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.799705 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_394bf9c7c1cb462589c7eb34fce76770"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.799768 4434 raft_consensus.cc:513] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.799826 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_394bf9c7c1cb462589c7eb34fce76770 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.799880 4434 leader_election.cc:290] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.799959 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f" } modify_external_catalogs: true
I20250115 10:12:03.800010 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f" } modify_external_catalogs: true
I20250115 10:12:03.800067 4434 raft_consensus.cc:491] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.800132 4434 raft_consensus.cc:513] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.800154 3085 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4cbd61aec79d479d9eea8d807cd5fb0e has no consensus state
I20250115 10:12:03.800211 4434 leader_election.cc:290] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.800367 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.800397 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.800426 3413 raft_consensus.cc:2463] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:03.800598 3484 leader_election.cc:343] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.800626 4569 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.800663 4569 ts_tablet_manager.cc:1397] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:03.800664 3484 leader_election.cc:304] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.800742 4469 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b0d8c56db3114bd89d2d0c1547bcdead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:03.800814 4569 raft_consensus.cc:357] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.800850 4469 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0d8c56db3114bd89d2d0c1547bcdead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.800855 4434 raft_consensus.cc:2798] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.800884 4434 raft_consensus.cc:491] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.800868 4569 raft_consensus.cc:383] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.800912 4434 raft_consensus.cc:3054] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.800912 4569 raft_consensus.cc:738] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.800948 4569 consensus_queue.cc:260] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.801060 4569 ts_tablet_manager.cc:1428] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.801155 4569 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.801535 4569 tablet_bootstrap.cc:654] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.801542 4434 raft_consensus.cc:513] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.801586 4470 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 5f88fd5f4cb14241ba611291d76ed79b
I20250115 10:12:03.801636 4434 leader_election.cc:290] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.801704 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_60dad5e3896a48c3bd60fd63fe95a742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.801782 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60dad5e3896a48c3bd60fd63fe95a742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.801952 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ca7bc6e893be4465b1582ee64173500c" } modify_external_catalogs: true
I20250115 10:12:03.801997 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ca7bc6e893be4465b1582ee64173500c" } modify_external_catalogs: true
I20250115 10:12:03.802047 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.802460 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.802443 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.802500 3413 raft_consensus.cc:3054] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.802515 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 5f88fd5f4cb14241ba611291d76ed79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f88fd5f4cb14241ba611291d76ed79b already in progress: creating tablet
I20250115 10:12:03.802596 4473 catalog_manager.cc:5526] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.802709 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:03.802754 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.802798 4551 ts_tablet_manager.cc:1905] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.803181 3413 raft_consensus.cc:2463] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.803357 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:03.803454 3484 leader_election.cc:304] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.803571 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:03.803746 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_ebf48b3ee3564dcf9e39755c3cdab956"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.803830 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebf48b3ee3564dcf9e39755c3cdab956 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.803972 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 6de4d57d53c648b491f66f257414394d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.803974 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.804052 3278 raft_consensus.cc:2463] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:03.804188 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6de4d57d53c648b491f66f257414394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de4d57d53c648b491f66f257414394d already in progress: creating tablet
I20250115 10:12:03.804265 4551 ts_tablet_manager.cc:1918] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250115 10:12:03.804286 4464 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3f81769b500149f7b2bf7cdf76f7ee27 consensus state has no leader
I20250115 10:12:03.804315 4551 log.cc:1198] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6f33cd582313436ba2a8a71cb708384c
I20250115 10:12:03.804301 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.804471 4551 ts_tablet_manager.cc:1939] T 6f33cd582313436ba2a8a71cb708384c P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.804491 4434 raft_consensus.cc:2798] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.804548 4434 raft_consensus.cc:695] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.804594 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.804608 4434 consensus_queue.cc:237] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.804673 3485 leader_election.cc:304] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:03.804752 3485 leader_election.cc:343] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.804811 3485 leader_election.cc:343] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.804867 4338 raft_consensus.cc:2798] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.804893 4338 raft_consensus.cc:491] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.804914 4338 raft_consensus.cc:3054] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.805536 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:03.805541 4338 raft_consensus.cc:513] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.805536 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.805640 4338 leader_election.cc:290] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.805732 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.805738 3484 leader_election.cc:343] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.805778 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:03.805903 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet f0ae1ff74cce48ada0a373f9e65508a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ae1ff74cce48ada0a373f9e65508a2 already in progress: creating tablet
W20250115 10:12:03.805972 3484 leader_election.cc:343] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.806058 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f88fd5f4cb14241ba611291d76ed79b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.806552 4575 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.806591 4575 ts_tablet_manager.cc:1397] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250115 10:12:03.806715 4575 raft_consensus.cc:357] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.806771 4575 raft_consensus.cc:383] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.806793 4575 raft_consensus.cc:738] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.806831 4575 consensus_queue.cc:260] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.806929 4575 ts_tablet_manager.cc:1428] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.806993 4575 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.807382 4575 tablet_bootstrap.cc:654] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.807973 4575 tablet_bootstrap.cc:492] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.807972 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.808032 4575 ts_tablet_manager.cc:1397] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.808063 3277 raft_consensus.cc:3054] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.808228 4575 raft_consensus.cc:357] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.808286 4575 raft_consensus.cc:383] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.808307 4575 raft_consensus.cc:738] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.808351 4575 consensus_queue.cc:260] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.808441 4575 ts_tablet_manager.cc:1428] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.808514 4575 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.808729 3277 raft_consensus.cc:2463] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.808879 3485 leader_election.cc:304] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.808964 4338 raft_consensus.cc:2798] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.809017 4338 raft_consensus.cc:695] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.809032 4575 tablet_bootstrap.cc:654] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.809062 4338 consensus_queue.cc:237] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.809202 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.809262 3279 raft_consensus.cc:2463] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.809541 3485 leader_election.cc:304] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.809682 4338 raft_consensus.cc:2798] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.809712 4338 raft_consensus.cc:491] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.809729 4338 raft_consensus.cc:3054] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.810400 4338 raft_consensus.cc:513] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.810528 4551 tablet_replica.cc:331] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.810607 4551 raft_consensus.cc:2238] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.810637 4551 raft_consensus.cc:2267] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.810626 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:03.810784 3484 leader_election.cc:343] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.811069 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.811127 3277 raft_consensus.cc:3054] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.811666 3277 raft_consensus.cc:2463] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.811911 4434 consensus_queue.cc:1035] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.810518 4338 leader_election.cc:290] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.811980 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 6de4d57d53c648b491f66f257414394d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.812064 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 6de4d57d53c648b491f66f257414394d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.811914 3485 leader_election.cc:304] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.812422 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.812426 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.812592 4551 ts_tablet_manager.cc:1905] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.812638 4338 raft_consensus.cc:2798] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.812690 4338 raft_consensus.cc:695] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:12:03.812711 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 5f88fd5f4cb14241ba611291d76ed79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f88fd5f4cb14241ba611291d76ed79b already in progress: creating tablet
I20250115 10:12:03.812723 4338 consensus_queue.cc:237] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.812757 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 6de4d57d53c648b491f66f257414394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de4d57d53c648b491f66f257414394d already in progress: creating tablet
W20250115 10:12:03.812786 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f0ae1ff74cce48ada0a373f9e65508a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0ae1ff74cce48ada0a373f9e65508a2 already in progress: creating tablet
I20250115 10:12:03.812856 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6f33cd582313436ba2a8a71cb708384c (table default.Table_9130efcb487944ea8a09f94aa5e23ad4 [id=e7b8d55efd3e422f8024a1185ef5f1f9]) successfully deleted
I20250115 10:12:03.813318 4557 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.813362 4557 ts_tablet_manager.cc:1397] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20250115 10:12:03.813496 4557 raft_consensus.cc:357] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.813547 4557 raft_consensus.cc:383] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.813565 4557 raft_consensus.cc:738] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.813608 4557 consensus_queue.cc:260] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.813684 4557 ts_tablet_manager.cc:1428] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.813746 4557 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.813915 4551 ts_tablet_manager.cc:1918] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.813956 4551 log.cc:1198] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6be683cdd24844eebaad0ed6a36be25f
I20250115 10:12:03.814109 4551 ts_tablet_manager.cc:1939] T 6be683cdd24844eebaad0ed6a36be25f P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.814278 4557 tablet_bootstrap.cc:654] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.814728 4551 tablet_replica.cc:331] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.814805 4551 raft_consensus.cc:2238] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.814836 4551 raft_consensus.cc:2267] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.815038 4569 tablet_bootstrap.cc:492] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.815099 4569 ts_tablet_manager.cc:1397] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.000s
I20250115 10:12:03.815270 4569 raft_consensus.cc:357] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.815346 4569 raft_consensus.cc:383] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.815371 4569 raft_consensus.cc:738] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.815418 4569 consensus_queue.cc:260] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.815547 4569 ts_tablet_manager.cc:1428] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.815626 4569 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.815892 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6be683cdd24844eebaad0ed6a36be25f (table default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]) successfully deleted
W20250115 10:12:03.815960 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 5f88fd5f4cb14241ba611291d76ed79b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f88fd5f4cb14241ba611291d76ed79b already in progress: creating tablet
W20250115 10:12:03.816013 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6de4d57d53c648b491f66f257414394d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6de4d57d53c648b491f66f257414394d already in progress: creating tablet
I20250115 10:12:03.816166 4569 tablet_bootstrap.cc:654] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.816727 4569 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.816766 4569 ts_tablet_manager.cc:1397] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.816896 4569 raft_consensus.cc:357] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.816941 4569 raft_consensus.cc:383] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.816956 4569 raft_consensus.cc:738] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.816989 4569 consensus_queue.cc:260] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.817147 4569 ts_tablet_manager.cc:1428] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.817212 4569 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.817250 4433 consensus_queue.cc:1035] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.817678 4569 tablet_bootstrap.cc:654] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.818455 4663 tablet.cc:1721] T 8c0541097b0b4916b559c14e48e08540 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.819099 4551 ts_tablet_manager.cc:1905] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.820873 4551 ts_tablet_manager.cc:1918] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.820937 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:03.820953 4551 log.cc:1198] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:03.820955 4569 tablet_bootstrap.cc:492] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.820989 4569 ts_tablet_manager.cc:1397] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:03.821010 4475 catalog_manager.cc:5526] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.821097 4569 raft_consensus.cc:357] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.821152 4569 raft_consensus.cc:383] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.821174 4569 raft_consensus.cc:738] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.821220 4569 consensus_queue.cc:260] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.821235 4551 ts_tablet_manager.cc:1939] T f0ae1ff74cce48ada0a373f9e65508a2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.821329 4569 ts_tablet_manager.cc:1428] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.821383 4569 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:03.821519 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:03.821740 4569 tablet_bootstrap.cc:654] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.821949 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]) successfully deleted
I20250115 10:12:03.822324 4714 raft_consensus.cc:491] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.822367 4714 raft_consensus.cc:513] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.822451 4714 leader_election.cc:290] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.822718 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.822794 3546 raft_consensus.cc:2463] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.822875 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.822901 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 1650bac5bd96467fb3d586b23ebd77be
I20250115 10:12:03.822942 3277 raft_consensus.cc:2463] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.823009 3350 leader_election.cc:304] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.823102 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 1650bac5bd96467fb3d586b23ebd77be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:03.823272 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 1650bac5bd96467fb3d586b23ebd77be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1650bac5bd96467fb3d586b23ebd77be already in progress: creating tablet
I20250115 10:12:03.823303 4714 raft_consensus.cc:2798] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.823313 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet 1650bac5bd96467fb3d586b23ebd77be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.823344 4714 raft_consensus.cc:491] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.823369 4714 raft_consensus.cc:3054] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.823786 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 1650bac5bd96467fb3d586b23ebd77be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.824190 4714 raft_consensus.cc:513] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.824301 4714 leader_election.cc:290] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.824378 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 1650bac5bd96467fb3d586b23ebd77be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1650bac5bd96467fb3d586b23ebd77be already in progress: creating tablet
W20250115 10:12:03.824465 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 1650bac5bd96467fb3d586b23ebd77be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1650bac5bd96467fb3d586b23ebd77be already in progress: creating tablet
I20250115 10:12:03.824468 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.824519 3277 raft_consensus.cc:3054] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.824599 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c66c13648b6478b8420778f48ba208a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.824654 3546 raft_consensus.cc:3054] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.824944 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:03.825009 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4f6baabd5aba4363ae13e5da601a9de8 (table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]). Expected version 1 got 0
I20250115 10:12:03.825039 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_0e49cd66dc9547a3be177283a5c1cb9c [id=71819bfc734a4e0d9e38041345bbd29b]). Expected version 1 got 0
I20250115 10:12:03.825071 4468 catalog_manager.cc:5526] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.825160 3277 raft_consensus.cc:2463] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.825191 3546 raft_consensus.cc:2463] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.825183 4468 catalog_manager.cc:5526] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.825249 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
I20250115 10:12:03.825692 3350 leader_election.cc:304] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.825826 4714 raft_consensus.cc:2798] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.825883 4714 raft_consensus.cc:695] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.825944 4714 consensus_queue.cc:237] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.829378 4575 tablet_bootstrap.cc:492] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.829429 4575 ts_tablet_manager.cc:1397] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.000s
I20250115 10:12:03.829552 4575 raft_consensus.cc:357] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.829599 4575 raft_consensus.cc:383] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.829614 4575 raft_consensus.cc:738] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.829648 4575 consensus_queue.cc:260] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.829761 4575 ts_tablet_manager.cc:1428] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.829814 4575 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.830405 4575 tablet_bootstrap.cc:654] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.831533 4569 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.831574 4569 ts_tablet_manager.cc:1397] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:03.831634 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.831705 3252 tablet_service.cc:1467] Processing CreateTablet for tablet ac9bf5560f0142bda0cafd429777e9ff (DEFAULT_TABLE table=default.Table_96e74365d1724614bc58fc1f92d4f8a1 [id=234667b22e334bc6862c3c21213bec41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.831763 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec0ec85d5040168145d8ecf6a48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.831822 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 5f809e15894942839dea32dcab30efa3 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.831693 4569 raft_consensus.cc:357] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.831888 4569 raft_consensus.cc:383] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.831909 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f809e15894942839dea32dcab30efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.831914 4569 raft_consensus.cc:738] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.831885 4477 catalog_manager.cc:5526] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.831972 4569 consensus_queue.cc:260] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.831982 4477 catalog_manager.cc:5526] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.832070 4569 ts_tablet_manager.cc:1428] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.832055 4477 catalog_manager.cc:5526] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.832119 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:03.832126 4569 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.832492 4569 tablet_bootstrap.cc:654] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.832525 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.832619 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec0ec85d5040168145d8ecf6a48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.833025 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 31143e360e784eb5b418533ff5d6a86d (DEFAULT_TABLE table=default.Table_394bf9c7c1cb462589c7eb34fce76770 [id=f7ee44dbf29b4ae3b3e3498e501e9a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.833103 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31143e360e784eb5b418533ff5d6a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.833597 4714 raft_consensus.cc:491] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.833636 4714 raft_consensus.cc:513] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.833731 4714 leader_election.cc:290] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.833957 3381 tablet_service.cc:1467] Processing CreateTablet for tablet ba2e825b244740028c62bc9ad71ae593 (DEFAULT_TABLE table=default.Table_60dad5e3896a48c3bd60fd63fe95a742 [id=e8df4fe310ad4d909005f4195b668988]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.834054 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2e825b244740028c62bc9ad71ae593. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.831635 3257 tablet_service.cc:1467] Processing CreateTablet for tablet ba2e825b244740028c62bc9ad71ae593 (DEFAULT_TABLE table=default.Table_60dad5e3896a48c3bd60fd63fe95a742 [id=e8df4fe310ad4d909005f4195b668988]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.834138 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2e825b244740028c62bc9ad71ae593. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.831662 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 23207abbcd5243e9817fdda67bc2e690 (DEFAULT_TABLE table=default.Table_e58fc7d242e74ca29ccc9d8d9cb60f8b [id=d0ffe3a70a164d41b9c95b297ff8eb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.834772 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23207abbcd5243e9817fdda67bc2e690. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.835266 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 23207abbcd5243e9817fdda67bc2e690 (DEFAULT_TABLE table=default.Table_e58fc7d242e74ca29ccc9d8d9cb60f8b [id=d0ffe3a70a164d41b9c95b297ff8eb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.835367 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23207abbcd5243e9817fdda67bc2e690. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.835611 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9bf5560f0142bda0cafd429777e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.836225 4569 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.836277 4569 ts_tablet_manager.cc:1397] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:03.836483 4569 raft_consensus.cc:357] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.836557 4569 raft_consensus.cc:383] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.836597 4569 raft_consensus.cc:738] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.836638 4569 consensus_queue.cc:260] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.836681 3387 tablet_service.cc:1467] Processing CreateTablet for tablet ac9bf5560f0142bda0cafd429777e9ff (DEFAULT_TABLE table=default.Table_96e74365d1724614bc58fc1f92d4f8a1 [id=234667b22e334bc6862c3c21213bec41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.836737 4569 ts_tablet_manager.cc:1428] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:03.836869 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9bf5560f0142bda0cafd429777e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.836907 4569 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.837288 4569 tablet_bootstrap.cc:654] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.837764 4569 tablet_bootstrap.cc:492] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.837810 4569 ts_tablet_manager.cc:1397] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.837967 4569 raft_consensus.cc:357] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.838029 4569 raft_consensus.cc:383] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.838063 4569 raft_consensus.cc:738] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.838097 4569 consensus_queue.cc:260] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.838189 4569 ts_tablet_manager.cc:1428] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.838176 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 5f809e15894942839dea32dcab30efa3 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.838239 4569 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.838263 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f809e15894942839dea32dcab30efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.838605 4569 tablet_bootstrap.cc:654] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.839087 4569 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.839126 4569 ts_tablet_manager.cc:1397] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.839249 4569 raft_consensus.cc:357] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.839290 4569 raft_consensus.cc:383] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.839394 4569 raft_consensus.cc:738] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.839453 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 31143e360e784eb5b418533ff5d6a86d (DEFAULT_TABLE table=default.Table_394bf9c7c1cb462589c7eb34fce76770 [id=f7ee44dbf29b4ae3b3e3498e501e9a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.839490 4569 consensus_queue.cc:260] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.839552 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31143e360e784eb5b418533ff5d6a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.839646 4569 ts_tablet_manager.cc:1428] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.839752 4569 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.839939 4714 raft_consensus.cc:491] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.839987 4714 raft_consensus.cc:513] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.840101 4714 leader_election.cc:290] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.840128 4569 tablet_bootstrap.cc:654] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.840620 4569 tablet_bootstrap.cc:492] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.840662 4569 ts_tablet_manager.cc:1397] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.840909 4569 raft_consensus.cc:357] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.840970 4569 raft_consensus.cc:383] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.841006 4569 raft_consensus.cc:738] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.841064 4569 consensus_queue.cc:260] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.841181 4569 ts_tablet_manager.cc:1428] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.841233 4569 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.841491 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_e7114f82478a498684df6ced2d600319 [id=ec98d4501a674ea1888c0b341153947c] alter complete (version 1)
I20250115 10:12:03.841602 4569 tablet_bootstrap.cc:654] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.841930 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d368093a74ba4918b0efcc3a909c3a07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.842002 3546 raft_consensus.cc:2463] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.842078 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 23207abbcd5243e9817fdda67bc2e690 (DEFAULT_TABLE table=default.Table_e58fc7d242e74ca29ccc9d8d9cb60f8b [id=d0ffe3a70a164d41b9c95b297ff8eb28]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.842103 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.842162 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23207abbcd5243e9817fdda67bc2e690. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.842247 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.842315 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec0ec85d5040168145d8ecf6a48184. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.843375 3528 tablet_service.cc:1467] Processing CreateTablet for tablet ac9bf5560f0142bda0cafd429777e9ff (DEFAULT_TABLE table=default.Table_96e74365d1724614bc58fc1f92d4f8a1 [id=234667b22e334bc6862c3c21213bec41]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.843402 3515 tablet_service.cc:1467] Processing CreateTablet for tablet 31143e360e784eb5b418533ff5d6a86d (DEFAULT_TABLE table=default.Table_394bf9c7c1cb462589c7eb34fce76770 [id=f7ee44dbf29b4ae3b3e3498e501e9a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.843470 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9bf5560f0142bda0cafd429777e9ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.843531 3350 leader_election.cc:304] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.843611 3350 leader_election.cc:343] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.843760 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d368093a74ba4918b0efcc3a909c3a07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.843873 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.843922 3279 raft_consensus.cc:2463] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.844022 4714 raft_consensus.cc:2798] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.844051 4714 raft_consensus.cc:491] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.844071 4714 raft_consensus.cc:3054] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.844560 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 5f809e15894942839dea32dcab30efa3 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.844645 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f809e15894942839dea32dcab30efa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.844631 4714 raft_consensus.cc:513] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.844736 4714 leader_election.cc:290] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.843375 3516 tablet_service.cc:1467] Processing CreateTablet for tablet ba2e825b244740028c62bc9ad71ae593 (DEFAULT_TABLE table=default.Table_60dad5e3896a48c3bd60fd63fe95a742 [id=e8df4fe310ad4d909005f4195b668988]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.844928 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2e825b244740028c62bc9ad71ae593. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.846127 4335 raft_consensus.cc:491] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.846172 4335 raft_consensus.cc:513] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.846266 4335 leader_election.cc:290] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.846359 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31143e360e784eb5b418533ff5d6a86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.846509 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:03.847280 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.847442 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8b3c397070467196b73dedcacf22de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.847574 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.847649 4589 tablet_replica.cc:331] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
W20250115 10:12:03.847653 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08b7630b6c8b40d89b9829ffc8fc4b2b already in progress: creating tablet
W20250115 10:12:03.847666 3215 consensus_peers.cc:487] T e3a4b1b801c84cbcae634a965be09734 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3a4b1b801c84cbcae634a965be09734. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.847697 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8b3c397070467196b73dedcacf22de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.847718 3215 leader_election.cc:343] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.847725 4589 raft_consensus.cc:2238] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.848029 4589 raft_consensus.cc:2267] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.848081 3350 leader_election.cc:343] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.847967 3214 leader_election.cc:343] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.848161 3214 leader_election.cc:304] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.848161 3350 leader_election.cc:304] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.848363 4589 ts_tablet_manager.cc:1905] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.848412 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.848593 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
W20250115 10:12:03.848620 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 08b7630b6c8b40d89b9829ffc8fc4b2b already in progress: creating tablet
I20250115 10:12:03.848632 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.848897 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.848946 4477 catalog_manager.cc:5526] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.849665 4335 raft_consensus.cc:2743] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.849833 4589 ts_tablet_manager.cc:1918] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.849885 4589 log.cc:1198] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:03.850036 4589 ts_tablet_manager.cc:1939] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.850127 4714 raft_consensus.cc:2798] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.850169 4714 raft_consensus.cc:491] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.850185 4714 raft_consensus.cc:3054] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.850677 4714 raft_consensus.cc:513] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.850772 4714 leader_election.cc:290] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.850986 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]) successfully deleted
I20250115 10:12:03.851547 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d368093a74ba4918b0efcc3a909c3a07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.851625 3546 raft_consensus.cc:3054] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.851670 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d368093a74ba4918b0efcc3a909c3a07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.851799 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.851835 3277 raft_consensus.cc:3054] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.852234 3546 raft_consensus.cc:2463] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.852314 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.852435 3277 raft_consensus.cc:2463] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.852604 3350 leader_election.cc:304] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:03.852684 3350 leader_election.cc:343] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.853888 3350 leader_election.cc:343] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.853978 3350 leader_election.cc:304] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.854064 4699 raft_consensus.cc:2798] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.854116 4699 raft_consensus.cc:695] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.854139 4587 raft_consensus.cc:2798] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.854159 4699 consensus_queue.cc:237] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.854288 4587 raft_consensus.cc:695] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.854337 4587 consensus_queue.cc:237] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.854956 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:03.855466 4731 raft_consensus.cc:491] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.855525 4731 raft_consensus.cc:513] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.855597 3770 raft_consensus.cc:491] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.855640 3770 raft_consensus.cc:513] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.855764 3770 leader_election.cc:290] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.856030 4557 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.856076 4557 ts_tablet_manager.cc:1397] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.001s
I20250115 10:12:03.856238 4557 raft_consensus.cc:357] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.856300 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.856331 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.856361 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:03.856312 4557 raft_consensus.cc:383] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.856503 4557 raft_consensus.cc:738] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.856537 4557 consensus_queue.cc:260] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.855645 4731 leader_election.cc:290] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.856609 4731 raft_consensus.cc:491] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.856634 4557 ts_tablet_manager.cc:1428] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.856639 4731 raft_consensus.cc:513] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.856700 4557 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.856729 4731 leader_election.cc:290] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.857111 4557 tablet_bootstrap.cc:654] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.857298 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.857374 3214 consensus_peers.cc:487] T 01a8681daa9b459ba85dea9410d83256 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01a8681daa9b459ba85dea9410d83256. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:03.857378 3412 raft_consensus.cc:2463] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.857393 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.857283 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.857870 3214 leader_election.cc:304] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:03.857940 3214 leader_election.cc:343] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.857988 3214 leader_election.cc:343] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.858027 3770 raft_consensus.cc:2798] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.858054 3770 raft_consensus.cc:491] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.858076 3770 raft_consensus.cc:3054] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.858762 3770 raft_consensus.cc:513] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.858850 3770 leader_election.cc:290] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.859025 3215 leader_election.cc:343] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.859073 3215 leader_election.cc:304] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.859071 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:03.859146 3215 leader_election.cc:343] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.859176 3215 leader_election.cc:304] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.859179 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.859236 3414 raft_consensus.cc:3054] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.859221 4731 raft_consensus.cc:2743] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.859308 4731 raft_consensus.cc:2743] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.859280 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.859238 3215 leader_election.cc:343] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.859416 4477 catalog_manager.cc:5526] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:03.859483 3215 leader_election.cc:343] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.859505 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.859537 4477 catalog_manager.cc:5526] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.859901 3414 raft_consensus.cc:2463] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:03.860570 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
I20250115 10:12:03.862807 3214 leader_election.cc:304] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.862898 3952 raft_consensus.cc:491] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.862941 3952 raft_consensus.cc:513] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.863052 3952 leader_election.cc:290] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.863101 3952 raft_consensus.cc:2798] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.863137 3952 raft_consensus.cc:695] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.863143 4575 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.863193 4575 ts_tablet_manager.cc:1397] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.000s
I20250115 10:12:03.863175 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d6e064ac3645a0a855d97262f6e9ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.863176 3952 consensus_queue.cc:237] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.863324 3215 leader_election.cc:343] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.863351 4575 raft_consensus.cc:357] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.863420 4575 raft_consensus.cc:383] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.863446 4575 raft_consensus.cc:738] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.863459 4433 raft_consensus.cc:491] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.863502 4433 raft_consensus.cc:513] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.863498 4575 consensus_queue.cc:260] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.863629 4433 leader_election.cc:290] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.863662 4575 ts_tablet_manager.cc:1428] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.863786 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d6e064ac3645a0a855d97262f6e9ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.863853 3414 raft_consensus.cc:2463] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.864033 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.864105 3277 raft_consensus.cc:2463] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.864120 4477 catalog_manager.cc:5526] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.864270 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.864390 4557 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.864418 3485 leader_election.cc:304] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.864437 4557 ts_tablet_manager.cc:1397] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
W20250115 10:12:03.864493 3484 leader_election.cc:343] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.864492 3214 leader_election.cc:304] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.864554 4433 raft_consensus.cc:2798] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.864583 4731 raft_consensus.cc:2798] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.864612 4731 raft_consensus.cc:491] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.864578 4557 raft_consensus.cc:357] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.864637 4731 raft_consensus.cc:3054] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.864643 4557 raft_consensus.cc:383] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.864665 4557 raft_consensus.cc:738] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.864717 4557 consensus_queue.cc:260] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.864825 4557 ts_tablet_manager.cc:1428] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.864892 4557 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.865293 4557 tablet_bootstrap.cc:654] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.865415 4731 raft_consensus.cc:513] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.865545 4731 leader_election.cc:290] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.865669 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d6e064ac3645a0a855d97262f6e9ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.865711 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f0d6e064ac3645a0a855d97262f6e9ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.865767 3414 raft_consensus.cc:3054] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:03.865797 3215 leader_election.cc:343] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.866495 3414 raft_consensus.cc:2463] T f0d6e064ac3645a0a855d97262f6e9ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.866683 3214 leader_election.cc:304] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.866818 3770 raft_consensus.cc:2798] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.866863 3770 raft_consensus.cc:695] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.866904 3770 consensus_queue.cc:237] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.867327 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 0fbb9cfc01df408eaae41b38e8c62c86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:03.867399 4551 tablet_replica.cc:331] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:03.867452 4551 raft_consensus.cc:2238] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.867488 4551 raft_consensus.cc:2267] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.867481 4575 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.867941 4575 tablet_bootstrap.cc:654] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.868036 4587 raft_consensus.cc:491] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.868077 4587 raft_consensus.cc:513] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.868176 4587 leader_election.cc:290] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:03.867416 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 10505ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:03.868289 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0b60522b15489d9726af73a7bd1ee5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.868360 3546 raft_consensus.cc:2463] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.864578 4433 raft_consensus.cc:491] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.868486 4433 raft_consensus.cc:3054] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.868518 3350 leader_election.cc:304] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.868650 4714 raft_consensus.cc:2798] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.868688 4714 raft_consensus.cc:491] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.868708 4714 raft_consensus.cc:3054] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.868858 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:03.869160 4433 raft_consensus.cc:513] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.869287 4433 leader_election.cc:290] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.869379 4714 raft_consensus.cc:513] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.869411 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0b60522b15489d9726af73a7bd1ee5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.869462 3277 raft_consensus.cc:2463] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.869477 4714 leader_election.cc:290] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.869740 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0b60522b15489d9726af73a7bd1ee5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.869796 3546 raft_consensus.cc:3054] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.869781 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.869829 3277 raft_consensus.cc:3054] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.870178 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3e3be71c4324a5589a397ae76198f27" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.870404 3546 raft_consensus.cc:2463] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.870404 3277 raft_consensus.cc:2463] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:12:03.870494 3484 leader_election.cc:343] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.870563 3485 leader_election.cc:304] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.870662 4434 raft_consensus.cc:2798] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.870718 4434 raft_consensus.cc:695] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.870769 4434 consensus_queue.cc:237] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.870796 3350 leader_election.cc:304] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.870869 4714 raft_consensus.cc:2798] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.870910 4714 raft_consensus.cc:695] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.870949 4714 consensus_queue.cc:237] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.871188 4477 catalog_manager.cc:5526] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.871503 4474 catalog_manager.cc:5526] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:03.871731 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:03.871774 4475 catalog_manager.cc:5526] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.873997 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d0b60522b15489d9726af73a7bd1ee5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.874064 3277 raft_consensus.cc:3054] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.874657 3277 raft_consensus.cc:2463] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.874729 3546 raft_consensus.cc:1270] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250115 10:12:03.874763 3214 consensus_peers.cc:487] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.874899 4551 ts_tablet_manager.cc:1905] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.874919 3952 consensus_queue.cc:1035] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.875145 4575 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.875203 4575 ts_tablet_manager.cc:1397] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:03.875403 4575 raft_consensus.cc:357] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.875464 4575 raft_consensus.cc:383] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.875483 4575 raft_consensus.cc:738] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.875522 4575 consensus_queue.cc:260] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.875633 4575 ts_tablet_manager.cc:1428] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.876021 4575 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.876202 4338 raft_consensus.cc:491] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.876246 4338 raft_consensus.cc:513] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.876343 4338 leader_election.cc:290] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.876564 4575 tablet_bootstrap.cc:654] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.876613 4551 ts_tablet_manager.cc:1918] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.876654 4551 log.cc:1198] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:03.876811 4551 ts_tablet_manager.cc:1939] T 0fbb9cfc01df408eaae41b38e8c62c86 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:03.877012 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.877329 3484 leader_election.cc:343] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.877336 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.877388 3279 raft_consensus.cc:2463] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.877444 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet f0ae1ff74cce48ada0a373f9e65508a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.877616 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
I20250115 10:12:03.877661 3485 leader_election.cc:304] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.877728 4592 tablet_replica.cc:331] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.877745 4338 raft_consensus.cc:2798] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.877776 4338 raft_consensus.cc:491] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.877794 4338 raft_consensus.cc:3054] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.877797 4592 raft_consensus.cc:2238] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.877830 4592 raft_consensus.cc:2267] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.878300 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 0fbb9cfc01df408eaae41b38e8c62c86 (table default.Table_c0fd8860abb44e408284630ba9b8e7bc [id=4b76c92ea8b74a55af139d8e3a423fd2]) successfully deleted
I20250115 10:12:03.878453 4338 raft_consensus.cc:513] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.878551 4592 ts_tablet_manager.cc:1905] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.878587 4338 leader_election.cc:290] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.878592 4557 tablet_bootstrap.cc:492] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.878681 4557 ts_tablet_manager.cc:1397] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:03.878831 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.878969 4557 raft_consensus.cc:357] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.879034 4557 raft_consensus.cc:383] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:03.879045 3484 leader_election.cc:343] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.879082 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.879154 3277 raft_consensus.cc:3054] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.879470 4575 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.879513 4575 ts_tablet_manager.cc:1397] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.879627 4575 raft_consensus.cc:357] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.879690 4575 raft_consensus.cc:383] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.879714 4575 raft_consensus.cc:738] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.879784 3277 raft_consensus.cc:2463] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.879786 4575 consensus_queue.cc:260] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.879901 4575 ts_tablet_manager.cc:1428] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.880038 3485 leader_election.cc:304] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:03.880041 4592 ts_tablet_manager.cc:1918] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.880085 4592 log.cc:1198] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:03.880125 4433 raft_consensus.cc:2798] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.880179 4433 raft_consensus.cc:695] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.880251 4592 ts_tablet_manager.cc:1939] T f0ae1ff74cce48ada0a373f9e65508a2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.880216 4433 consensus_queue.cc:237] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.880388 4575 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.880805 4575 tablet_bootstrap.cc:654] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.880919 4474 catalog_manager.cc:5526] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.881251 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:03.879056 4557 raft_consensus.cc:738] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.882181 4557 consensus_queue.cc:260] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.882287 4557 ts_tablet_manager.cc:1428] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.882364 4557 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.882771 4557 tablet_bootstrap.cc:654] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.883433 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3aae7f2489e6423f8c2da3c5ae753cdf" } new_table_name: "default.Table_2f418c5b15134aa58e94ad53b68ba2b2" modify_external_catalogs: true
I20250115 10:12:03.884313 3952 raft_consensus.cc:491] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.884361 3952 raft_consensus.cc:513] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.884464 3952 leader_election.cc:290] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.884474 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f0ae1ff74cce48ada0a373f9e65508a2 (table default.Table_77de5a94d3fe42478dd6b0e8f1d03d26 [id=3db3bcbaa94a47539118a734db0455c6]) successfully deleted
I20250115 10:12:03.884646 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.884768 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.884927 4569 tablet_bootstrap.cc:492] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
W20250115 10:12:03.884963 3214 leader_election.cc:343] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.885073 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d30f49da63241a2a794a7a18e026473 consensus state has no leader
I20250115 10:12:03.885375 4575 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.885419 4575 ts_tablet_manager.cc:1397] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:03.885701 4575 raft_consensus.cc:357] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.884968 4569 ts_tablet_manager.cc:1397] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.000s
I20250115 10:12:03.885823 4575 raft_consensus.cc:383] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.885874 4575 raft_consensus.cc:738] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:03.885891 3215 leader_election.cc:343] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.885936 4569 raft_consensus.cc:357] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.885954 4575 consensus_queue.cc:260] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.886018 4569 raft_consensus.cc:383] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.886042 4569 raft_consensus.cc:738] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.886090 4569 consensus_queue.cc:260] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.886190 4569 ts_tablet_manager.cc:1428] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.886245 4575 ts_tablet_manager.cc:1428] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.886260 4569 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.886303 4575 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.886643 4569 tablet_bootstrap.cc:654] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.886770 4575 tablet_bootstrap.cc:654] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.887050 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:03.887269 4569 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.887310 4569 ts_tablet_manager.cc:1397] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.885941 3215 leader_election.cc:304] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.887354 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:03.887434 4569 raft_consensus.cc:357] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.887485 3770 raft_consensus.cc:2743] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.888159 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:03.888826 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:03.887495 4569 raft_consensus.cc:383] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.889302 4569 raft_consensus.cc:738] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.889343 4569 consensus_queue.cc:260] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.889443 4569 ts_tablet_manager.cc:1428] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.889552 4569 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.889945 4569 tablet_bootstrap.cc:654] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.890121 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]). Expected version 1 got 0
I20250115 10:12:03.890658 4569 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.890709 4569 ts_tablet_manager.cc:1397] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.890731 4575 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.890770 4575 ts_tablet_manager.cc:1397] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.890856 4569 raft_consensus.cc:357] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.890919 4569 raft_consensus.cc:383] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.890944 4569 raft_consensus.cc:738] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.890996 4569 consensus_queue.cc:260] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.891113 4569 ts_tablet_manager.cc:1428] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.890928 4575 raft_consensus.cc:357] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.891160 4575 raft_consensus.cc:383] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.891187 4575 raft_consensus.cc:738] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.891279 4575 consensus_queue.cc:260] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.891335 4569 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.892203 4569 tablet_bootstrap.cc:654] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.892387 4575 ts_tablet_manager.cc:1428] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.892627 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a3ebf56500b4c97b7553644d62fe83a with delete_type TABLET_DATA_DELETED (replaced by tablet 29d9a01abd314d0e9f60df4f6736985b) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.892683 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_2bc1f827e44144f4b2bcc3b6a0229a54 [id=75a3cabc6ab0415992e902b02ea54d47]). Expected version 1 got 0
I20250115 10:12:03.892768 4592 tablet_replica.cc:331] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.892823 4592 raft_consensus.cc:2238] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.892855 4592 raft_consensus.cc:2267] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.892910 4575 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.893709 4575 tablet_bootstrap.cc:654] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.894050 4592 ts_tablet_manager.cc:1905] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.894310 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_2bc1f827e44144f4b2bcc3b6a0229a54 [id=75a3cabc6ab0415992e902b02ea54d47]). Expected version 1 got 0
I20250115 10:12:03.895196 4575 tablet_bootstrap.cc:492] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.895203 4592 ts_tablet_manager.cc:1918] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.895339 4575 ts_tablet_manager.cc:1397] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.895366 4592 log.cc:1198] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:03.895474 4575 raft_consensus.cc:357] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.895562 4592 ts_tablet_manager.cc:1939] T 8a3ebf56500b4c97b7553644d62fe83a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.896117 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 8a3ebf56500b4c97b7553644d62fe83a (table default.Table_e9976480454c45ae8f5c492466ad9d9d [id=e75e774360d840b9a15d23b550d42d19]) successfully deleted
I20250115 10:12:03.896339 4557 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.896399 4557 ts_tablet_manager.cc:1397] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:03.896543 4557 raft_consensus.cc:357] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.896620 4557 raft_consensus.cc:383] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.896641 4557 raft_consensus.cc:738] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.896677 4557 consensus_queue.cc:260] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.896770 4557 ts_tablet_manager.cc:1428] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.896862 4662 tablet.cc:1721] T 8a485231d2de4fab8b86b4900976c76c P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.895537 4575 raft_consensus.cc:383] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.897054 4575 raft_consensus.cc:738] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.897154 4575 consensus_queue.cc:260] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.898185 4569 tablet_bootstrap.cc:492] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.898231 4569 ts_tablet_manager.cc:1397] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.898382 4569 raft_consensus.cc:357] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.898411 4575 ts_tablet_manager.cc:1428] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:03.898438 4569 raft_consensus.cc:383] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.898459 4569 raft_consensus.cc:738] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.898489 4569 consensus_queue.cc:260] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.898571 4569 ts_tablet_manager.cc:1428] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.898631 4569 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.899015 4569 tablet_bootstrap.cc:654] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.899727 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db] alter complete (version 1)
I20250115 10:12:03.899812 4811 raft_consensus.cc:491] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.899868 4811 raft_consensus.cc:513] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.899967 4811 leader_election.cc:290] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.900192 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.900264 3277 raft_consensus.cc:2463] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.900238 4575 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.900609 3350 leader_election.cc:304] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.900732 4811 raft_consensus.cc:2798] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.900768 4811 raft_consensus.cc:491] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.900785 4811 raft_consensus.cc:3054] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.901050 4557 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.901448 4557 tablet_bootstrap.cc:654] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.901435 4811 raft_consensus.cc:513] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.901544 4811 leader_election.cc:290] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.901593 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:03.901980 3350 leader_election.cc:343] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.902066 4557 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.902112 4557 ts_tablet_manager.cc:1397] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.902274 4557 raft_consensus.cc:357] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.902341 4557 raft_consensus.cc:383] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.902321 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.902360 4557 raft_consensus.cc:738] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.902395 4557 consensus_queue.cc:260] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.902520 4557 ts_tablet_manager.cc:1428] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.902560 4663 tablet.cc:1721] T 8a485231d2de4fab8b86b4900976c76c P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.902575 4557 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:03.903264 3350 leader_election.cc:343] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.903456 4575 tablet_bootstrap.cc:654] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.903477 4557 tablet_bootstrap.cc:654] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.903563 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.903622 3277 raft_consensus.cc:3054] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.903981 4575 tablet_bootstrap.cc:492] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.904021 4575 ts_tablet_manager.cc:1397] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.904140 4575 raft_consensus.cc:357] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.904188 4575 raft_consensus.cc:383] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.904204 4575 raft_consensus.cc:738] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.904237 4575 consensus_queue.cc:260] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.904313 4575 ts_tablet_manager.cc:1428] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.904384 4575 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.904728 4575 tablet_bootstrap.cc:654] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.905121 3277 raft_consensus.cc:2463] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.905460 4569 tablet_bootstrap.cc:492] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.905506 4569 ts_tablet_manager.cc:1397] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:03.905526 3350 leader_election.cc:304] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.905598 4811 raft_consensus.cc:2798] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.905638 4811 raft_consensus.cc:695] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.905647 4569 raft_consensus.cc:357] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.905674 4811 consensus_queue.cc:237] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.905710 4569 raft_consensus.cc:383] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.905735 4569 raft_consensus.cc:738] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.905797 4569 consensus_queue.cc:260] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.905920 4569 ts_tablet_manager.cc:1428] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.905977 4569 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.906585 4569 tablet_bootstrap.cc:654] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:03.907121 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:03.907498 4569 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.907536 4569 ts_tablet_manager.cc:1397] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:03.907671 4569 raft_consensus.cc:357] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.907739 4569 raft_consensus.cc:383] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.907760 4569 raft_consensus.cc:738] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.907799 4569 consensus_queue.cc:260] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.907891 4569 ts_tablet_manager.cc:1428] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.907934 4569 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.908165 4474 catalog_manager.cc:5526] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.908277 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:03.908300 4569 tablet_bootstrap.cc:654] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.908437 4575 tablet_bootstrap.cc:492] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.908473 4575 ts_tablet_manager.cc:1397] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.908591 4575 raft_consensus.cc:357] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.908766 4575 raft_consensus.cc:383] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.908783 4575 raft_consensus.cc:738] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.908888 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b89df9f987e46ae98fe21df847cb311 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.908982 4589 tablet_replica.cc:331] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.909025 4589 raft_consensus.cc:2238] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.909056 4589 raft_consensus.cc:2267] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.909171 4575 consensus_queue.cc:260] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.909826 4589 ts_tablet_manager.cc:1905] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.910079 4569 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.910127 4569 ts_tablet_manager.cc:1397] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.910239 4569 raft_consensus.cc:357] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.910285 4569 raft_consensus.cc:383] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.910291 4575 ts_tablet_manager.cc:1428] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:03.910305 4569 raft_consensus.cc:738] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.910339 4569 consensus_queue.cc:260] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.910423 4569 ts_tablet_manager.cc:1428] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.910471 4569 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.910838 4569 tablet_bootstrap.cc:654] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.910863 4575 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.911224 4589 ts_tablet_manager.cc:1918] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.911249 4575 tablet_bootstrap.cc:654] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.911278 4589 log.cc:1198] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3b89df9f987e46ae98fe21df847cb311
I20250115 10:12:03.911437 4589 ts_tablet_manager.cc:1939] T 3b89df9f987e46ae98fe21df847cb311 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.911886 4569 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.911929 4569 ts_tablet_manager.cc:1397] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:03.912052 4569 raft_consensus.cc:357] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.912117 4569 raft_consensus.cc:383] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.912139 4569 raft_consensus.cc:738] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.912179 4569 consensus_queue.cc:260] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.912214 4575 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.912249 4575 ts_tablet_manager.cc:1397] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:03.912285 4569 ts_tablet_manager.cc:1428] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.912338 4569 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.912369 4575 raft_consensus.cc:357] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.912421 4575 raft_consensus.cc:383] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.912441 4575 raft_consensus.cc:738] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.912487 4575 consensus_queue.cc:260] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.912607 4575 ts_tablet_manager.cc:1428] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.912662 4575 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.912771 4569 tablet_bootstrap.cc:654] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.913040 4575 tablet_bootstrap.cc:654] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.913218 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3b89df9f987e46ae98fe21df847cb311 (table default.Table_7568c1ece38940aca3b40c2fc57908ee [id=ef10b7628b904af29e4b5eb825add080]) successfully deleted
I20250115 10:12:03.913976 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.914301 4589 tablet_replica.cc:331] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.914304 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:03.914359 4589 raft_consensus.cc:2238] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.914389 4589 raft_consensus.cc:2267] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.914588 4589 ts_tablet_manager.cc:1905] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.914824 4557 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.914873 4557 ts_tablet_manager.cc:1397] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:03.915019 4557 raft_consensus.cc:357] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.915087 4557 raft_consensus.cc:383] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.915108 4557 raft_consensus.cc:738] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.915151 4557 consensus_queue.cc:260] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.915282 4557 ts_tablet_manager.cc:1428] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.915343 4557 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.915841 4589 ts_tablet_manager.cc:1918] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.915884 4589 log.cc:1198] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6be683cdd24844eebaad0ed6a36be25f
I20250115 10:12:03.915915 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet e91450b4369844ea9ab09383b3dbc8ee (table default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce]). Expected version 1 got 0
I20250115 10:12:03.915956 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:03.916043 4589 ts_tablet_manager.cc:1939] T 6be683cdd24844eebaad0ed6a36be25f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.916603 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6be683cdd24844eebaad0ed6a36be25f (table default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]) successfully deleted
I20250115 10:12:03.915727 4557 tablet_bootstrap.cc:654] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.917382 4714 raft_consensus.cc:491] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.917433 4714 raft_consensus.cc:513] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.917522 4714 leader_election.cc:290] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.917728 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.917750 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e91450b4369844ea9ab09383b3dbc8ee" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.917809 3546 raft_consensus.cc:2388] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:03.918207 4575 tablet_bootstrap.cc:492] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.918246 4575 ts_tablet_manager.cc:1397] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.918262 3350 leader_election.cc:304] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.918339 4714 raft_consensus.cc:491] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.918358 4569 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.918368 4714 raft_consensus.cc:513] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.918390 4569 ts_tablet_manager.cc:1397] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:03.918432 4575 raft_consensus.cc:357] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.918480 4714 leader_election.cc:290] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.918498 4575 raft_consensus.cc:383] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.918509 4714 raft_consensus.cc:3054] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.918521 4575 raft_consensus.cc:738] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.918524 4569 raft_consensus.cc:357] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.918555 4575 consensus_queue.cc:260] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.918582 4569 raft_consensus.cc:383] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.918603 4569 raft_consensus.cc:738] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.918639 4569 consensus_queue.cc:260] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.918653 4575 ts_tablet_manager.cc:1428] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.918721 4569 ts_tablet_manager.cc:1428] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.918736 4575 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.918774 4569 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.919178 4569 tablet_bootstrap.cc:654] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.919211 4714 raft_consensus.cc:2743] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.919229 4575 tablet_bootstrap.cc:654] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.919832 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3658cad19e46969abecacf490f43f1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.919888 3277 raft_consensus.cc:2463] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.920032 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3658cad19e46969abecacf490f43f1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.920089 3546 raft_consensus.cc:2463] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.920549 4569 tablet_bootstrap.cc:492] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.920593 4569 ts_tablet_manager.cc:1397] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.920595 3350 leader_election.cc:304] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.920666 4587 raft_consensus.cc:2798] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.920708 4587 raft_consensus.cc:491] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.920732 4587 raft_consensus.cc:3054] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.920718 4569 raft_consensus.cc:357] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.920766 4569 raft_consensus.cc:383] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.920787 4569 raft_consensus.cc:738] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.920827 4569 consensus_queue.cc:260] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.920899 4569 ts_tablet_manager.cc:1428] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.920964 4569 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.921314 4569 tablet_bootstrap.cc:654] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.921466 4587 raft_consensus.cc:513] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.921610 4587 leader_election.cc:290] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.921804 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3658cad19e46969abecacf490f43f1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.921890 3546 raft_consensus.cc:3054] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.921875 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc3658cad19e46969abecacf490f43f1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.921967 3277 raft_consensus.cc:3054] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.922447 4575 tablet_bootstrap.cc:492] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.922505 4575 ts_tablet_manager.cc:1397] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:03.922554 3546 raft_consensus.cc:2463] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.922554 3277 raft_consensus.cc:2463] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.920559 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c045349a48644eda41ea8965b16174d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.922788 4575 raft_consensus.cc:357] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.922854 4575 raft_consensus.cc:383] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.922878 4575 raft_consensus.cc:738] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.922940 4575 consensus_queue.cc:260] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.923039 4575 ts_tablet_manager.cc:1428] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.923117 4575 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.923144 4589 tablet_replica.cc:331] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.923202 4589 raft_consensus.cc:2238] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.923229 4589 raft_consensus.cc:2267] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.923454 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_fa021dc761814b88af467b382cc095a0 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 1 got 0
I20250115 10:12:03.923529 4575 tablet_bootstrap.cc:654] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.923913 4557 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.923956 4557 ts_tablet_manager.cc:1397] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:03.924081 4557 raft_consensus.cc:357] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.924119 4557 raft_consensus.cc:383] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.924129 4557 raft_consensus.cc:738] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.924161 4557 consensus_queue.cc:260] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.924249 4557 ts_tablet_manager.cc:1428] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.924338 4557 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.924671 3350 leader_election.cc:304] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.924794 4557 tablet_bootstrap.cc:654] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.924835 4714 raft_consensus.cc:2798] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.924888 4714 raft_consensus.cc:695] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.924947 4714 consensus_queue.cc:237] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.925490 4575 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.925470 4477 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_fa021dc761814b88af467b382cc095a0" } new_table_name: "default.Table_6ec7c4a878164164aa74e6924146c9d2" modify_external_catalogs: true
I20250115 10:12:03.925587 4575 ts_tablet_manager.cc:1397] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:03.925587 3277 raft_consensus.cc:1270] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.925631 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:03.925710 4731 raft_consensus.cc:491] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.925750 4731 raft_consensus.cc:513] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.925855 4731 leader_election.cc:290] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.925863 4811 consensus_queue.cc:1035] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.925940 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_555dca511fe44b2da3678c74932d205c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.926050 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_555dca511fe44b2da3678c74932d205c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.926201 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f1f5e83fd8f245b786be6c97dcbece10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.926296 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1f5e83fd8f245b786be6c97dcbece10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.926681 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.926852 3548 raft_consensus.cc:1270] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250115 10:12:03.926901 3214 leader_election.cc:343] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.927126 4575 raft_consensus.cc:357] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.927342 4811 consensus_queue.cc:1035] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.927529 4477 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.928740 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:03.928807 4477 catalog_manager.cc:5526] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.928895 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:03.929364 4338 raft_consensus.cc:491] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.929364 3279 raft_consensus.cc:3054] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.929412 4338 raft_consensus.cc:513] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.929513 4338 leader_election.cc:290] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.929595 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_83d11d1609a44b49857dd3fd6489c4f6" } new_table_name: "default.Table_697427e611684f2b8af110cb304cb29b" modify_external_catalogs: true
I20250115 10:12:03.929672 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c73488a369ec4bc196196444fa9c3632" } new_table_name: "default.Table_e02abcc959ee4e66938eeb713ab5738c" modify_external_catalogs: true
I20250115 10:12:03.929796 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:03.930122 3279 raft_consensus.cc:1270] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.930142 3549 raft_consensus.cc:1270] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.930236 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.930531 3484 leader_election.cc:343] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.930776 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:03.930968 3485 leader_election.cc:343] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.931015 3485 leader_election.cc:304] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:03.931027 4714 consensus_queue.cc:1035] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.931070 4338 raft_consensus.cc:2743] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.931115 4714 consensus_queue.cc:1035] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.927176 4575 raft_consensus.cc:383] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.931900 4575 raft_consensus.cc:738] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.931999 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.932071 4731 raft_consensus.cc:491] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.932116 4731 raft_consensus.cc:513] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.932138 3215 leader_election.cc:343] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.932175 3215 leader_election.cc:304] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.932243 4731 leader_election.cc:290] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.932276 4731 raft_consensus.cc:2743] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.932427 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbcd4787a734c5bba29f8a600abf874" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.932624 4477 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_6ec7c4a878164164aa74e6924146c9d2 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 2 got 0
W20250115 10:12:03.932837 3214 leader_election.cc:343] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.932833 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fbcd4787a734c5bba29f8a600abf874" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.933010 4589 ts_tablet_manager.cc:1905] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.933085 4575 consensus_queue.cc:260] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.933122 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6b6621592191408cb1eeaf69869258a5 consensus state has no leader
I20250115 10:12:03.933211 4575 ts_tablet_manager.cc:1428] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
W20250115 10:12:03.933266 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d5da557a18648719980469579c3979f consensus state has no leader
W20250115 10:12:03.933533 3215 leader_election.cc:343] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.933581 3215 leader_election.cc:304] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.933638 4335 raft_consensus.cc:2743] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.934275 4589 ts_tablet_manager.cc:1918] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.934309 4811 raft_consensus.cc:491] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.934327 4589 log.cc:1198] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/8c045349a48644eda41ea8965b16174d
I20250115 10:12:03.934350 4811 raft_consensus.cc:513] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.934448 4811 leader_election.cc:290] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.934489 4589 ts_tablet_manager.cc:1939] T 8c045349a48644eda41ea8965b16174d P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.934778 4575 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.934854 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.934919 3546 raft_consensus.cc:2388] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:03.935153 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ed45d371a34a51a42fb04f4a450ae5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.935585 3350 leader_election.cc:304] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.935740 4714 raft_consensus.cc:3054] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.936115 4575 tablet_bootstrap.cc:654] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.936324 4714 raft_consensus.cc:2743] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.936494 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 8c045349a48644eda41ea8965b16174d (table default.Table_e1f735a8865d4ed2bbd8ff42a6c55b6b [id=7245acdcd7994c27ad53cf55dd7c5cd8]) successfully deleted
I20250115 10:12:03.936642 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_cc424a5cc8454391917b164fe51eb1f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.936744 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc424a5cc8454391917b164fe51eb1f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.936924 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:03.936967 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b573af4521064addb5bf2da9c70a79f0 (table default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2]). Expected version 2 got 0
I20250115 10:12:03.937386 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 3a999e14271a47049b8197ec2cf8f179 (DEFAULT_TABLE table=default.Table_f1f5e83fd8f245b786be6c97dcbece10 [id=346cb4f34b254e8184fd993091102365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.937433 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 3a999e14271a47049b8197ec2cf8f179 (DEFAULT_TABLE table=default.Table_f1f5e83fd8f245b786be6c97dcbece10 [id=346cb4f34b254e8184fd993091102365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.937466 4557 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.937489 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a999e14271a47049b8197ec2cf8f179. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.937511 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a999e14271a47049b8197ec2cf8f179. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.937505 4557 ts_tablet_manager.cc:1397] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:12:03.937637 4557 raft_consensus.cc:357] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.937692 4557 raft_consensus.cc:383] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.937711 4557 raft_consensus.cc:738] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.937757 4557 consensus_queue.cc:260] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.937767 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 3a999e14271a47049b8197ec2cf8f179 (DEFAULT_TABLE table=default.Table_f1f5e83fd8f245b786be6c97dcbece10 [id=346cb4f34b254e8184fd993091102365]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.937852 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a999e14271a47049b8197ec2cf8f179. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.937848 4557 ts_tablet_manager.cc:1428] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.937908 4557 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.938279 4557 tablet_bootstrap.cc:654] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.938758 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ff89486cde3f49528e4007189911ce4e (table default.Table_6ec7c4a878164164aa74e6924146c9d2 [id=fd2029e6fbca4c5591a929cfb52832bf]). Expected version 2 got 0
I20250115 10:12:03.939153 4667 tablet.cc:1721] T ff89486cde3f49528e4007189911ce4e P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.939925 4663 tablet.cc:1721] T ff89486cde3f49528e4007189911ce4e P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.942589 4335 raft_consensus.cc:491] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.942662 4335 raft_consensus.cc:513] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.942767 4335 leader_election.cc:290] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.942914 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8093f8487b9844718707e2fcdd3ae833" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.942914 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8093f8487b9844718707e2fcdd3ae833" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.942978 3414 raft_consensus.cc:2463] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:03.943096 3215 leader_election.cc:343] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.943142 3215 leader_election.cc:304] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.943209 4335 raft_consensus.cc:2798] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.943255 4335 raft_consensus.cc:491] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.943272 4335 raft_consensus.cc:3054] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.943979 4335 raft_consensus.cc:513] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.944136 4335 leader_election.cc:290] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.944231 4667 tablet.cc:1721] T b573af4521064addb5bf2da9c70a79f0 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.944308 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8093f8487b9844718707e2fcdd3ae833" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.944330 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8093f8487b9844718707e2fcdd3ae833" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.944389 3414 raft_consensus.cc:3054] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.944970 3414 raft_consensus.cc:2463] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.945119 3214 leader_election.cc:304] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:03.945168 3215 leader_election.cc:343] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.945214 4335 raft_consensus.cc:2798] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.945281 4335 raft_consensus.cc:695] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.945326 4335 consensus_queue.cc:237] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.945626 4662 tablet.cc:1721] T b573af4521064addb5bf2da9c70a79f0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.947180 4477 master_service.cc:946] ReplaceTablet: received request to replace tablet 87d8167b34064888be6e4df4dfde0b31 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.947803 4575 tablet_bootstrap.cc:492] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.947853 4575 ts_tablet_manager.cc:1397] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:03.947968 4575 raft_consensus.cc:357] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.948024 4575 raft_consensus.cc:383] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.948064 4575 raft_consensus.cc:738] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.948107 4575 consensus_queue.cc:260] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.948205 4575 ts_tablet_manager.cc:1428] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.948277 4575 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.948350 4569 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.948392 4569 ts_tablet_manager.cc:1397] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.000s
I20250115 10:12:03.948522 4569 raft_consensus.cc:357] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.948567 4569 raft_consensus.cc:383] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.948585 4569 raft_consensus.cc:738] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.948616 4575 tablet_bootstrap.cc:654] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.948622 4569 consensus_queue.cc:260] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.948707 4569 ts_tablet_manager.cc:1428] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.948765 4569 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.949158 4569 tablet_bootstrap.cc:654] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.949710 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.949805 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6827c92eff1547739e4afaf6f5eca5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.950197 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.950269 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.950294 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6827c92eff1547739e4afaf6f5eca5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.950357 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6827c92eff1547739e4afaf6f5eca5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.952858 4575 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:03.952905 4575 ts_tablet_manager.cc:1397] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:03.952935 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.953056 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963fb6e6b1724506a3a451b0d5e66ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.953074 4575 raft_consensus.cc:357] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.953126 4575 raft_consensus.cc:383] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.953115 4473 catalog_manager.cc:5526] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.953181 4575 raft_consensus.cc:738] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.953209 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:03.953225 4575 consensus_queue.cc:260] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.953320 4575 ts_tablet_manager.cc:1428] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.953373 4575 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:03.953935 4575 tablet_bootstrap.cc:654] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.954974 4569 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.955021 4569 ts_tablet_manager.cc:1397] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:03.955179 4569 raft_consensus.cc:357] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.955235 4569 raft_consensus.cc:383] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.955269 4569 raft_consensus.cc:738] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.955293 4569 consensus_queue.cc:260] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.955371 4569 ts_tablet_manager.cc:1428] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.955427 4569 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.955838 4569 tablet_bootstrap.cc:654] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.956578 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.956681 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963fb6e6b1724506a3a451b0d5e66ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.958442 3277 raft_consensus.cc:3054] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.958611 3549 raft_consensus.cc:1270] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.959041 4557 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.959082 4557 ts_tablet_manager.cc:1397] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:03.959102 3277 raft_consensus.cc:1270] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.959270 4557 raft_consensus.cc:357] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.959331 4557 raft_consensus.cc:383] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.959350 4557 raft_consensus.cc:738] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.959393 4557 consensus_queue.cc:260] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:03.959867 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:03.959967 4471 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_045a1ead2aaf41af83c54e75caaed252 [id=eb7190820bc3484982ba925dfd67b9f2] alter complete (version 2)
I20250115 10:12:03.959995 4338 raft_consensus.cc:491] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.960045 4338 raft_consensus.cc:513] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.960122 4338 leader_election.cc:290] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.960230 4557 ts_tablet_manager.cc:1428] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:03.960287 4557 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:03.960481 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e033d609eef46a792b1a568ec2936de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.960745 4557 tablet_bootstrap.cc:654] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.961251 4569 tablet_bootstrap.cc:492] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.961292 4569 ts_tablet_manager.cc:1397] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:03.961388 4589 tablet_replica.cc:331] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:03.961447 4589 raft_consensus.cc:2238] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.961412 4569 raft_consensus.cc:357] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.961473 4569 raft_consensus.cc:383] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.961504 4569 raft_consensus.cc:738] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.961534 4569 consensus_queue.cc:260] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.961613 4569 ts_tablet_manager.cc:1428] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.961660 4569 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.961939 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21906d23acc4ab8b81eceb87ead049f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.962002 3414 raft_consensus.cc:2463] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:03.962039 4569 tablet_bootstrap.cc:654] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.961473 4589 raft_consensus.cc:2267] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.962699 4335 raft_consensus.cc:491] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.962743 4335 raft_consensus.cc:513] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.962842 4335 leader_election.cc:290] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.962947 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 9c21c9b21c7c4aed981029846b28aee5 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.962998 4589 ts_tablet_manager.cc:1905] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.963179 3484 leader_election.cc:304] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.963294 4338 raft_consensus.cc:2798] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.963322 4338 raft_consensus.cc:491] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.963299 4477 master_service.cc:946] ReplaceTablet: received request to replace tablet 3956317a32b04585a84629c209935898 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.963339 4338 raft_consensus.cc:3054] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.963974 4338 raft_consensus.cc:513] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.964073 4338 leader_election.cc:290] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:03.964202 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21906d23acc4ab8b81eceb87ead049f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.964272 3280 raft_consensus.cc:3054] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.964386 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8441d13c5b0c47bb9e16655c964ab58f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:03.964452 3414 raft_consensus.cc:2463] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.964656 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8441d13c5b0c47bb9e16655c964ab58f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.964726 3548 raft_consensus.cc:2463] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:03.964934 4569 tablet_bootstrap.cc:492] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.964972 4569 ts_tablet_manager.cc:1397] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:03.965004 3280 raft_consensus.cc:2463] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.965101 4569 raft_consensus.cc:357] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.965173 4569 raft_consensus.cc:383] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.965193 4569 raft_consensus.cc:738] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.965194 4699 consensus_queue.cc:1035] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.965241 4569 consensus_queue.cc:260] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.964993 3215 leader_election.cc:304] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.965360 4699 consensus_queue.cc:1035] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.965374 4569 ts_tablet_manager.cc:1428] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.965441 4569 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.965461 3952 raft_consensus.cc:2798] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.965487 3952 raft_consensus.cc:491] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.965505 3952 raft_consensus.cc:3054] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.965785 3485 leader_election.cc:304] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.965829 4569 tablet_bootstrap.cc:654] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.965896 3549 raft_consensus.cc:1270] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.966207 3952 raft_consensus.cc:513] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.966284 4338 raft_consensus.cc:2798] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.966315 3952 leader_election.cc:290] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.966327 4338 raft_consensus.cc:695] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:03.966327 3280 raft_consensus.cc:1270] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.966367 4338 consensus_queue.cc:237] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.966442 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.966674 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21906d23acc4ab8b81eceb87ead049f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.966728 3414 raft_consensus.cc:3054] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.966209 3279 raft_consensus.cc:3054] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.967386 3414 raft_consensus.cc:2463] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:03.967414 3279 raft_consensus.cc:1270] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.967808 4587 raft_consensus.cc:491] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.967862 4587 raft_consensus.cc:513] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.967826 4475 catalog_manager.cc:5526] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:03.967938 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:03.967958 4587 leader_election.cc:290] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.968423 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.968571 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8441d13c5b0c47bb9e16655c964ab58f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.968644 3548 raft_consensus.cc:3054] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.969282 3548 raft_consensus.cc:2463] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:03.969378 3350 consensus_peers.cc:487] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:03.969460 4811 consensus_queue.cc:1035] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.969563 4811 consensus_queue.cc:1035] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.969609 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.969620 4811 consensus_queue.cc:1035] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.970146 3215 leader_election.cc:304] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:03.970216 3770 raft_consensus.cc:2798] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.970259 3770 raft_consensus.cc:695] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:03.970291 3770 consensus_queue.cc:237] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.970381 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.970415 3549 raft_consensus.cc:1270] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.970435 3276 raft_consensus.cc:2463] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:03.970491 4662 tablet.cc:1721] T ff89486cde3f49528e4007189911ce4e P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.970808 3413 raft_consensus.cc:1270] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.971285 4663 tablet.cc:1721] T b573af4521064addb5bf2da9c70a79f0 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.971340 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d21906d23acc4ab8b81eceb87ead049f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:03.971411 3277 raft_consensus.cc:2371] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1. Re-sending same reply.
I20250115 10:12:03.971580 4731 consensus_queue.cc:1035] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.972155 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3956317a32b04585a84629c209935898
I20250115 10:12:03.972239 4477 catalog_manager.cc:6596] ReplaceTablet: tablet 3956317a32b04585a84629c209935898 deleted and replaced by tablet b07efa65ed754b75abfbe4869593ab78
I20250115 10:12:03.972385 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 3956317a32b04585a84629c209935898 with delete_type TABLET_DATA_DELETED (replaced by tablet b07efa65ed754b75abfbe4869593ab78) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.972486 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 3956317a32b04585a84629c209935898 with delete_type TABLET_DATA_DELETED (replaced by tablet b07efa65ed754b75abfbe4869593ab78) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.972541 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
W20250115 10:12:03.972662 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3956317a32b04585a84629c209935898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3956317a32b04585a84629c209935898 already in progress: creating tablet
I20250115 10:12:03.972877 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9c21c9b21c7c4aed981029846b28aee5
I20250115 10:12:03.972892 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 3956317a32b04585a84629c209935898 with delete_type TABLET_DATA_DELETED (replaced by tablet b07efa65ed754b75abfbe4869593ab78) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.972911 3770 consensus_queue.cc:1035] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.972950 4473 catalog_manager.cc:6596] ReplaceTablet: tablet 9c21c9b21c7c4aed981029846b28aee5 deleted and replaced by tablet 541482be183541e0ab5b9c482f208024
I20250115 10:12:03.973037 4477 catalog_manager.cc:5526] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:03.973150 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3956317a32b04585a84629c209935898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3956317a32b04585a84629c209935898 already in progress: creating tablet
I20250115 10:12:03.973174 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 541482be183541e0ab5b9c482f208024) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.973224 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 541482be183541e0ab5b9c482f208024) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:03.973150 4477 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:03.973287 4477 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.973361 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c21c9b21c7c4aed981029846b28aee5 with delete_type TABLET_DATA_DELETED (replaced by tablet 541482be183541e0ab5b9c482f208024) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:03.973515 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9c21c9b21c7c4aed981029846b28aee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c21c9b21c7c4aed981029846b28aee5 already in progress: creating tablet
W20250115 10:12:03.973774 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 9c21c9b21c7c4aed981029846b28aee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c21c9b21c7c4aed981029846b28aee5 already in progress: creating tablet
I20250115 10:12:03.973834 3350 leader_election.cc:304] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.973887 4471 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_6ec7c4a878164164aa74e6924146c9d2 [id=fd2029e6fbca4c5591a929cfb52832bf] alter complete (version 2)
W20250115 10:12:03.973909 3350 leader_election.cc:343] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.974007 4587 raft_consensus.cc:2798] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:03.974042 4587 raft_consensus.cc:491] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:03.974064 4587 raft_consensus.cc:3054] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.974809 4587 raft_consensus.cc:513] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.974920 4587 leader_election.cc:290] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.975193 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8441d13c5b0c47bb9e16655c964ab58f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:03.975268 3414 raft_consensus.cc:3054] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.975687 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_03d97d69456b4383aad68de38c602d6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:03.975841 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03d97d69456b4383aad68de38c602d6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:03.976101 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:03.976159 3276 raft_consensus.cc:3054] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.976271 4589 ts_tablet_manager.cc:1918] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.976272 4667 tablet.cc:1721] T b2462c50d3684176aa5ff5caf79f9644 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.976323 4589 log.cc:1198] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/0e033d609eef46a792b1a568ec2936de
I20250115 10:12:03.976524 4589 ts_tablet_manager.cc:1939] T 0e033d609eef46a792b1a568ec2936de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:03.976814 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 963fb6e6b1724506a3a451b0d5e66ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.976867 3276 raft_consensus.cc:2463] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:03.977721 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:03.978201 4653 mvcc.cc:204] Tried to move back new op lower bound from 7114489544531640320 to 7114489543786430464. Current Snapshot: MvccSnapshot[applied={T|T < 7114489544531640320}]
I20250115 10:12:03.978523 4667 tablet.cc:1721] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.978909 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b7630b6c8b40d89b9829ffc8fc4b2b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:03 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.979007 4592 tablet_replica.cc:331] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.979074 4592 raft_consensus.cc:2238] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.979105 4592 raft_consensus.cc:2267] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:03.979287 4592 ts_tablet_manager.cc:1905] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.980123 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.980170 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
I20250115 10:12:03.980190 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.980672 4592 ts_tablet_manager.cc:1918] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.980777 4592 log.cc:1198] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:03.980986 4592 ts_tablet_manager.cc:1939] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.981263 3412 raft_consensus.cc:1270] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.981319 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b2462c50d3684176aa5ff5caf79f9644 (table default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e]). Expected version 1 got 0
I20250115 10:12:03.981348 3280 raft_consensus.cc:3054] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:03.981726 4338 consensus_queue.cc:1035] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.981822 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 08b7630b6c8b40d89b9829ffc8fc4b2b (table default.Table_a9db77a2e3bd48d7b1f936116a0d5b9f [id=dad7d3310e654b9aaa4938e6353787c8]) successfully deleted
I20250115 10:12:03.982049 3280 raft_consensus.cc:1270] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.982203 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cfe7181347114ccfbf62109147d182b3 (table default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214]). Expected version 2 got 0
I20250115 10:12:03.982394 3414 raft_consensus.cc:2463] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:03.982478 4338 consensus_queue.cc:1035] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.982652 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 6be683cdd24844eebaad0ed6a36be25f with delete_type TABLET_DATA_DELETED (replaced by tablet eb2fb9983c4f45f98291c411ba9ab748) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:03.982668 4338 consensus_queue.cc:1035] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.982734 4592 tablet_replica.cc:331] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:03.982795 4592 raft_consensus.cc:2238] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:03.982818 3350 leader_election.cc:304] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:03.982828 4592 raft_consensus.cc:2267] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:03.982933 3350 leader_election.cc:343] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.983073 4592 ts_tablet_manager.cc:1905] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:03.983541 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_12159c20ed474c57a3d7b3c74a92cb3d [id=e42d14cf5e5e4f728fcf6c4e8eb4938e] alter complete (version 1)
I20250115 10:12:03.983548 4714 raft_consensus.cc:2798] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:03.983635 4714 raft_consensus.cc:695] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:03.983673 4714 consensus_queue.cc:237] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.984247 4592 ts_tablet_manager.cc:1918] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:03.984266 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.984290 4592 log.cc:1198] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/6be683cdd24844eebaad0ed6a36be25f
I20250115 10:12:03.984469 4592 ts_tablet_manager.cc:1939] T 6be683cdd24844eebaad0ed6a36be25f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:03.984647 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 0e033d609eef46a792b1a568ec2936de (table default.Table_19a1534e02374361911915480570557f [id=d56da8cb7c6e43abb20ae34780541794]) successfully deleted
W20250115 10:12:03.984704 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3956317a32b04585a84629c209935898 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3956317a32b04585a84629c209935898 already in progress: creating tablet
W20250115 10:12:03.984755 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 9c21c9b21c7c4aed981029846b28aee5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c21c9b21c7c4aed981029846b28aee5 already in progress: creating tablet
I20250115 10:12:03.985040 4662 tablet.cc:1721] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.986672 4662 tablet.cc:1721] T b2462c50d3684176aa5ff5caf79f9644 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.986809 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]). Expected version 2 got 0
W20250115 10:12:03.987015 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
I20250115 10:12:03.987054 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:03.987078 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet cd8b9bf010d245be919f1e912b103770 (table default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b]). Expected version 1 got 0
I20250115 10:12:03.987635 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 6be683cdd24844eebaad0ed6a36be25f (table default.Table_08ec06f0141d4b3987b31855419390bd [id=bbc8808295b94d06b621a80aa7de1cc8]) successfully deleted
I20250115 10:12:03.987977 3952 raft_consensus.cc:491] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:03.988019 3952 raft_consensus.cc:513] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.988127 3952 leader_election.cc:290] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:03.988260 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:03.988273 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:03.988435 3215 leader_election.cc:343] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:03.988554 3214 leader_election.cc:343] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:03.988593 3214 leader_election.cc:304] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:03.988649 3952 raft_consensus.cc:2743] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:03.988935 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235] alter complete (version 2)
I20250115 10:12:03.991439 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc5552447d348e58205a130d74eb808 (DEFAULT_TABLE table=default.Table_03d97d69456b4383aad68de38c602d6c [id=9b5493839fc94234b5fdc446510bcba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.991464 3260 tablet_service.cc:1467] Processing CreateTablet for tablet b07efa65ed754b75abfbe4869593ab78 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.991518 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 541482be183541e0ab5b9c482f208024 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.991547 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc5552447d348e58205a130d74eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.991590 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541482be183541e0ab5b9c482f208024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.991633 3387 tablet_service.cc:1467] Processing CreateTablet for tablet b07efa65ed754b75abfbe4869593ab78 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.991755 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07efa65ed754b75abfbe4869593ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.992661 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07efa65ed754b75abfbe4869593ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.993127 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc5552447d348e58205a130d74eb808 (DEFAULT_TABLE table=default.Table_03d97d69456b4383aad68de38c602d6c [id=9b5493839fc94234b5fdc446510bcba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.993238 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc5552447d348e58205a130d74eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.993893 4873 tablet.cc:1721] T b2462c50d3684176aa5ff5caf79f9644 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.993955 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 541482be183541e0ab5b9c482f208024 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.994055 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541482be183541e0ab5b9c482f208024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.994359 4881 tablet.cc:1721] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.994858 4477 catalog_manager.cc:5526] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:03.995358 4569 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:03.995399 4569 ts_tablet_manager.cc:1397] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.001s
I20250115 10:12:03.995539 4569 raft_consensus.cc:357] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.995592 4569 raft_consensus.cc:383] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.995612 4569 raft_consensus.cc:738] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.995656 4569 consensus_queue.cc:260] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.995781 4569 ts_tablet_manager.cc:1428] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:03.995854 4569 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:03.996256 4569 tablet_bootstrap.cc:654] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:03.996243 4667 tablet.cc:1721] T cfe7181347114ccfbf62109147d182b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.997256 4662 tablet.cc:1721] T cfe7181347114ccfbf62109147d182b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:03.998039 4662 tablet.cc:1721] T cd8b9bf010d245be919f1e912b103770 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:03.998152 4557 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:03.998245 4557 ts_tablet_manager.cc:1397] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.000s
I20250115 10:12:03.998256 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet dc2b34be581f44028fed1514c78d1874 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.998347 4434 consensus_queue.cc:1035] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:03.998433 4557 raft_consensus.cc:357] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.998497 4557 raft_consensus.cc:383] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:03.998517 4557 raft_consensus.cc:738] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:03.998553 4557 consensus_queue.cc:260] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:03.998647 4557 ts_tablet_manager.cc:1428] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:03.998903 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 87fa663159fc4c95a8499a84f7b6faed from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:03.999003 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 541482be183541e0ab5b9c482f208024 (DEFAULT_TABLE table=default.Table_bfa733f08d354e4ba9dca2b09152b95f [id=c5c1ae5afc1d4e25b1d401e1cedb4009]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.999034 3515 tablet_service.cc:1467] Processing CreateTablet for tablet b07efa65ed754b75abfbe4869593ab78 (DEFAULT_TABLE table=default.Table_a20c21609d3f41ec98698a4bc198dcf1 [id=e9f0af93e3944acdbd173ed439860029]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:03.999102 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541482be183541e0ab5b9c482f208024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.999378 3549 raft_consensus.cc:1270] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:03.999452 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07efa65ed754b75abfbe4869593ab78. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:03.999841 3413 raft_consensus.cc:1270] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.000041 4335 consensus_queue.cc:1035] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.000110 4731 consensus_queue.cc:1035] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.000351 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc5552447d348e58205a130d74eb808 (DEFAULT_TABLE table=default.Table_03d97d69456b4383aad68de38c602d6c [id=9b5493839fc94234b5fdc446510bcba7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.000429 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cc5552447d348e58205a130d74eb808. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.000768 4575 tablet_bootstrap.cc:492] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.000813 4575 ts_tablet_manager.cc:1397] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.000s
I20250115 10:12:04.000950 4575 raft_consensus.cc:357] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.001005 4575 raft_consensus.cc:383] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.001029 4575 raft_consensus.cc:738] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.001061 4575 consensus_queue.cc:260] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.001164 4575 ts_tablet_manager.cc:1428] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.001219 4575 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.001686 4575 tablet_bootstrap.cc:654] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.002717 4587 raft_consensus.cc:491] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.002760 4587 raft_consensus.cc:513] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.002847 4587 leader_election.cc:290] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.002919 4663 tablet.cc:1721] T cd8b9bf010d245be919f1e912b103770 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.003211 4557 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.003818 4557 tablet_bootstrap.cc:654] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.003821 4470 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_74abe75013584ccbb2acb8aa9426c527" } new_table_name: "default.Table_80740761a0fe4a649dcd9095d47fc312" modify_external_catalogs: true
I20250115 10:12:04.003672 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_273a3677ac2f4e0f8f78271c44915a39" } modify_external_catalogs: true
I20250115 10:12:04.004083 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_273a3677ac2f4e0f8f78271c44915a39" } modify_external_catalogs: true
I20250115 10:12:04.003639 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.004212 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.004623 4699 raft_consensus.cc:491] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.004628 4667 tablet.cc:1721] T 29ed70f5db0e492eaf0c42e005736ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.004680 4699 raft_consensus.cc:513] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.004791 4699 leader_election.cc:290] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.005390 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:04.005470 4471 catalog_manager.cc:6596] ReplaceTablet: tablet dc2b34be581f44028fed1514c78d1874 deleted and replaced by tablet 9283eb29ce3c4a9ba4793e598e9b2092
I20250115 10:12:04.005530 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 87fa663159fc4c95a8499a84f7b6faed
I20250115 10:12:04.005519 4667 tablet.cc:1721] T cd8b9bf010d245be919f1e912b103770 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.005564 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2b34be581f44028fed1514c78d1874 with delete_type TABLET_DATA_DELETED (replaced by tablet 9283eb29ce3c4a9ba4793e598e9b2092) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.005584 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 87fa663159fc4c95a8499a84f7b6faed deleted and replaced by tablet 5d7732a7b5a54f75b55c5db4e9fbe172
I20250115 10:12:04.005769 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fa663159fc4c95a8499a84f7b6faed with delete_type TABLET_DATA_DELETED (replaced by tablet 5d7732a7b5a54f75b55c5db4e9fbe172) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.006160 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2b34be581f44028fed1514c78d1874 with delete_type TABLET_DATA_DELETED (replaced by tablet 9283eb29ce3c4a9ba4793e598e9b2092) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.006356 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 87fa663159fc4c95a8499a84f7b6faed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87fa663159fc4c95a8499a84f7b6faed already in progress: creating tablet
W20250115 10:12:04.006465 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet dc2b34be581f44028fed1514c78d1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc2b34be581f44028fed1514c78d1874 already in progress: creating tablet
I20250115 10:12:04.006588 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fa663159fc4c95a8499a84f7b6faed with delete_type TABLET_DATA_DELETED (replaced by tablet 5d7732a7b5a54f75b55c5db4e9fbe172) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.006588 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 87fa663159fc4c95a8499a84f7b6faed with delete_type TABLET_DATA_DELETED (replaced by tablet 5d7732a7b5a54f75b55c5db4e9fbe172) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.006762 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet dc2b34be581f44028fed1514c78d1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc2b34be581f44028fed1514c78d1874 already in progress: creating tablet
I20250115 10:12:04.006806 4663 tablet.cc:1721] T cfe7181347114ccfbf62109147d182b3 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250115 10:12:04.006939 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 87fa663159fc4c95a8499a84f7b6faed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87fa663159fc4c95a8499a84f7b6faed already in progress: creating tablet
W20250115 10:12:04.007002 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 87fa663159fc4c95a8499a84f7b6faed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 87fa663159fc4c95a8499a84f7b6faed already in progress: creating tablet
W20250115 10:12:04.007087 4470 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8600883e5a5449c59a747a6ef2121c61 consensus state has no leader
I20250115 10:12:04.007424 3952 consensus_queue.cc:1035] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.007944 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.008025 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet dc2b34be581f44028fed1514c78d1874 with delete_type TABLET_DATA_DELETED (replaced by tablet 9283eb29ce3c4a9ba4793e598e9b2092) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.008090 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.008114 4877 raft_consensus.cc:491] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.008155 4877 raft_consensus.cc:513] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.008481 4880 tablet.cc:1721] T 29ed70f5db0e492eaf0c42e005736ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.008478 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.008519 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2836a492586e489daafc2da719455f39" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.008549 4877 leader_election.cc:290] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.009248 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:04.009292 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.009891 4650 mvcc.cc:204] Tried to move back new op lower bound from 7114489544692678656 to 7114489544579911680. Current Snapshot: MvccSnapshot[applied={T|T < 7114489544692678656}]
I20250115 10:12:04.009900 4335 raft_consensus.cc:491] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.009963 4557 tablet_bootstrap.cc:492] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.009984 4335 raft_consensus.cc:513] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.010002 4557 ts_tablet_manager.cc:1397] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.010064 4335 leader_election.cc:290] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.010154 4557 raft_consensus.cc:357] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.010206 4557 raft_consensus.cc:383] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.010226 4557 raft_consensus.cc:738] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.010270 4557 consensus_queue.cc:260] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.010368 4557 ts_tablet_manager.cc:1428] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.010370 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet dc2b34be581f44028fed1514c78d1874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc2b34be581f44028fed1514c78d1874 already in progress: creating tablet
I20250115 10:12:04.010425 4557 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.010406 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.010376 4470 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:04.010792 4557 tablet_bootstrap.cc:654] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.011117 3350 leader_election.cc:343] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.011149 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:04.011196 3350 leader_election.cc:304] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.011257 3350 leader_election.cc:343] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.011278 3350 leader_election.cc:304] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.011281 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0b401233481b445bbf0f394083719ed1
I20250115 10:12:04.011363 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28861e966ce645878983bec6476255bb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.011417 3547 raft_consensus.cc:2388] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.011456 4811 raft_consensus.cc:2743] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.011485 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b401233481b445bbf0f394083719ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.011511 4811 raft_consensus.cc:2743] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.011591 3952 raft_consensus.cc:491] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.011629 3952 raft_consensus.cc:513] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.011657 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 0b401233481b445bbf0f394083719ed1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b401233481b445bbf0f394083719ed1 already in progress: creating tablet
I20250115 10:12:04.011729 3952 leader_election.cc:290] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.012069 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.012147 3277 raft_consensus.cc:2463] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.012138 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b401233481b445bbf0f394083719ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.012248 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b401233481b445bbf0f394083719ed1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.012413 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 0b401233481b445bbf0f394083719ed1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b401233481b445bbf0f394083719ed1 already in progress: creating tablet
I20250115 10:12:04.012601 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.012660 3549 raft_consensus.cc:2463] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.012759 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.012820 3413 raft_consensus.cc:2388] T 62aee0b0490e44a3aa820781bc9e4072 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.012879 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "62aee0b0490e44a3aa820781bc9e4072" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.012908 4880 tablet.cc:1721] T 8441d13c5b0c47bb9e16655c964ab58f P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.012969 3215 leader_election.cc:304] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.013039 3952 raft_consensus.cc:3054] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.013178 4873 tablet.cc:1721] T 8441d13c5b0c47bb9e16655c964ab58f P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.013435 3350 leader_election.cc:304] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:04.013569 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 0b401233481b445bbf0f394083719ed1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b401233481b445bbf0f394083719ed1 already in progress: creating tablet
I20250115 10:12:04.013624 3952 raft_consensus.cc:2743] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.013718 3214 leader_election.cc:304] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.013965 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_144b5268ca924ee4b8e869b12ad09043 [id=ea680eb97689482f9691961069d5361b] alter complete (version 1)
I20250115 10:12:04.013995 4877 raft_consensus.cc:2798] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.014032 4877 raft_consensus.cc:491] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.014050 4877 raft_consensus.cc:3054] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.014079 4470 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_c37b56f295b54053b5ec08e31a9a30c0 [id=e9babe96b33c4b2db8f7b71f6f0a9214] alter complete (version 2)
I20250115 10:12:04.014225 3952 raft_consensus.cc:3054] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.014323 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9b8574ea15ad4c9db7d63aa09348d5ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.014412 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b8574ea15ad4c9db7d63aa09348d5ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.014811 3952 raft_consensus.cc:2743] T 62aee0b0490e44a3aa820781bc9e4072 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.014971 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_205ef4bd277848d7947bf4073aedd705"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.015064 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_205ef4bd277848d7947bf4073aedd705 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.015147 4877 raft_consensus.cc:513] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.015288 4877 leader_election.cc:290] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.015281 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a9096cacdd92437d98da0c463a8782eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.015372 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9096cacdd92437d98da0c463a8782eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.015697 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1ca6c4ea1f824b1f9e350131149239eb" } modify_external_catalogs: true
I20250115 10:12:04.015810 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1ca6c4ea1f824b1f9e350131149239eb" } modify_external_catalogs: true
I20250115 10:12:04.015964 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e419dd2392434a8ab8def3765f49bf85" } modify_external_catalogs: true
I20250115 10:12:04.016002 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e419dd2392434a8ab8def3765f49bf85" } modify_external_catalogs: true
I20250115 10:12:04.016160 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_4125e59ac88c45be8b92b9b825848eba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.016255 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4125e59ac88c45be8b92b9b825848eba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.016165 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4] alter complete (version 1)
I20250115 10:12:04.017069 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 166e6390660c485c99b2e115fd1b272f with delete_type TABLET_DATA_DELETED (replaced by tablet 13cfdf73dea14543aff0e564c5fa51b6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.017136 4589 tablet_replica.cc:331] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.017190 4589 raft_consensus.cc:2238] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.017217 4589 raft_consensus.cc:2267] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.017324 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3c66c13648b6478b8420778f48ba208a
I20250115 10:12:04.017449 4589 ts_tablet_manager.cc:1905] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.017504 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c66c13648b6478b8420778f48ba208a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.017575 4592 tablet_replica.cc:331] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.017637 4592 raft_consensus.cc:2238] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.017678 4592 pending_rounds.cc:62] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:12:04.017694 4592 pending_rounds.cc:69] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489543991324672 op_type: NO_OP noop_request { }
I20250115 10:12:04.017725 4592 raft_consensus.cc:2883] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:04.017745 4592 raft_consensus.cc:2267] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.017925 4592 ts_tablet_manager.cc:1905] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.018644 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3fecca0f91e04702b438c9639303fac2
I20250115 10:12:04.018821 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.019044 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c66c13648b6478b8420778f48ba208a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.019260 3280 raft_consensus.cc:1270] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.019491 4592 ts_tablet_manager.cc:1918] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.019543 4592 log.cc:1198] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3c66c13648b6478b8420778f48ba208a
I20250115 10:12:04.019568 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8441d13c5b0c47bb9e16655c964ab58f (table default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0]). Expected version 1 got 0
I20250115 10:12:04.019762 4592 ts_tablet_manager.cc:1939] T 3c66c13648b6478b8420778f48ba208a P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.019762 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.020015 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.020095 3277 raft_consensus.cc:3054] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.020303 3516 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.020364 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb04f46a17134bc28719be34085f714f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.020401 3547 raft_consensus.cc:3054] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.020679 3277 raft_consensus.cc:2463] T fb04f46a17134bc28719be34085f714f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.020761 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c66c13648b6478b8420778f48ba208a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.020839 3549 raft_consensus.cc:1270] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.021018 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:04.021044 3547 raft_consensus.cc:2463] T fb04f46a17134bc28719be34085f714f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.021083 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a1a29efbe0f049ecb7deece829e59020"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.021142 4551 tablet_replica.cc:331] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:04.021159 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1a29efbe0f049ecb7deece829e59020 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.021209 4551 raft_consensus.cc:2238] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:04.021221 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3fecca0f91e04702b438c9639303fac2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fecca0f91e04702b438c9639303fac2 already in progress: creating tablet
I20250115 10:12:04.021242 4551 raft_consensus.cc:2267] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.021337 4551 ts_tablet_manager.cc:1905] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.021379 3952 consensus_queue.cc:1035] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.021543 4589 ts_tablet_manager.cc:1918] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.021582 4589 log.cc:1198] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/166e6390660c485c99b2e115fd1b272f
I20250115 10:12:04.021729 4589 ts_tablet_manager.cc:1939] T 166e6390660c485c99b2e115fd1b272f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.021862 3350 leader_election.cc:304] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.021925 4589 tablet_replica.cc:331] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.021986 4589 raft_consensus.cc:2238] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.021976 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 166e6390660c485c99b2e115fd1b272f (table default.Table_922dc1d8d8b044e680d01c155391bad7 [id=b56710616abb4f7c938211614243c259]) successfully deleted
I20250115 10:12:04.021962 4699 consensus_queue.cc:1035] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.022018 4589 raft_consensus.cc:2267] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.022042 4699 raft_consensus.cc:2798] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.022078 4699 raft_consensus.cc:695] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.022094 4714 consensus_queue.cc:1035] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.022114 4699 consensus_queue.cc:237] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.022255 4589 ts_tablet_manager.cc:1905] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.022635 4551 ts_tablet_manager.cc:1918] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.022696 4551 log.cc:1198] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3c66c13648b6478b8420778f48ba208a
I20250115 10:12:04.022902 4551 ts_tablet_manager.cc:1939] T 3c66c13648b6478b8420778f48ba208a P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.023455 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3c66c13648b6478b8420778f48ba208a (table default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]) successfully deleted
I20250115 10:12:04.023478 4589 ts_tablet_manager.cc:1918] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.023526 4589 log.cc:1198] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3c66c13648b6478b8420778f48ba208a
I20250115 10:12:04.023691 4589 ts_tablet_manager.cc:1939] T 3c66c13648b6478b8420778f48ba208a P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.024889 4569 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.024930 4569 ts_tablet_manager.cc:1397] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250115 10:12:04.025070 4569 raft_consensus.cc:357] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.025125 4569 raft_consensus.cc:383] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.025143 4569 raft_consensus.cc:738] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.025179 4569 consensus_queue.cc:260] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.025292 4569 ts_tablet_manager.cc:1428] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.025352 4569 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.025388 3770 consensus_queue.cc:1035] T ad975dacafc94bc89c3996aa58a9b5a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.025750 4569 tablet_bootstrap.cc:654] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.026048 4477 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_c31bdac2ad6c4b90bd98a3ef4e02e59e [id=a02b68d5690c4d22bd6228e2cda045c0] alter complete (version 1)
I20250115 10:12:04.026466 4557 tablet_bootstrap.cc:492] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.026504 4557 ts_tablet_manager.cc:1397] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20250115 10:12:04.026628 4557 raft_consensus.cc:357] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.026688 4557 raft_consensus.cc:383] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.026706 4557 raft_consensus.cc:738] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.026744 4557 consensus_queue.cc:260] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.026865 4557 ts_tablet_manager.cc:1428] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.026916 4557 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.027230 4477 catalog_manager.cc:5526] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.027297 4557 tablet_bootstrap.cc:654] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.028019 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ec128e5d9b6a4ee9aa3433d149db3438" } modify_external_catalogs: true
I20250115 10:12:04.028091 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ec128e5d9b6a4ee9aa3433d149db3438" } modify_external_catalogs: true
I20250115 10:12:04.028455 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:04.029146 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3c66c13648b6478b8420778f48ba208a (table default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]) successfully deleted
W20250115 10:12:04.029218 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 3fecca0f91e04702b438c9639303fac2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fecca0f91e04702b438c9639303fac2 already in progress: creating tablet
I20250115 10:12:04.029943 4335 consensus_queue.cc:1035] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.030002 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:04.030195 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 55ed45d371a34a51a42fb04f4a450ae5
I20250115 10:12:04.030483 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.030601 4592 tablet_replica.cc:331] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.030679 4592 raft_consensus.cc:2238] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.030665 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.030716 4592 raft_consensus.cc:2267] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.031229 4592 ts_tablet_manager.cc:1905] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.031616 3214 consensus_peers.cc:487] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.031690 4667 tablet.cc:1721] T 8441d13c5b0c47bb9e16655c964ab58f P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.032546 4569 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.032588 4569 ts_tablet_manager.cc:1397] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:04.032716 4569 raft_consensus.cc:357] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.032826 4569 raft_consensus.cc:383] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.032866 4569 raft_consensus.cc:738] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.032902 4569 consensus_queue.cc:260] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.033010 4569 ts_tablet_manager.cc:1428] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.033062 4569 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.033464 4569 tablet_bootstrap.cc:654] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.034368 4575 tablet_bootstrap.cc:492] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.034412 4575 ts_tablet_manager.cc:1397] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.000s
I20250115 10:12:04.034546 4575 raft_consensus.cc:357] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.034617 4575 raft_consensus.cc:383] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.034621 4557 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.034641 4575 raft_consensus.cc:738] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.034662 4557 ts_tablet_manager.cc:1397] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.034682 4575 consensus_queue.cc:260] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.034786 4575 ts_tablet_manager.cc:1428] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.034814 4557 raft_consensus.cc:357] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.034849 4575 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.034868 4557 raft_consensus.cc:383] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.034886 4557 raft_consensus.cc:738] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.034914 4557 consensus_queue.cc:260] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.035017 4557 ts_tablet_manager.cc:1428] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.035069 4557 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.035204 4589 tablet_replica.cc:331] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.035224 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3c66c13648b6478b8420778f48ba208a (table default.Table_1ca6c4ea1f824b1f9e350131149239eb [id=e146905a99764738b2035de07ec3158d]) successfully deleted
I20250115 10:12:04.035269 4575 tablet_bootstrap.cc:654] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.035269 4589 raft_consensus.cc:2238] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
W20250115 10:12:04.035319 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3fecca0f91e04702b438c9639303fac2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3fecca0f91e04702b438c9639303fac2 already in progress: creating tablet
I20250115 10:12:04.035337 4589 raft_consensus.cc:2267] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.035543 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ed45d371a34a51a42fb04f4a450ae5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.035616 4551 tablet_replica.cc:331] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.035677 4551 raft_consensus.cc:2238] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.035761 4551 raft_consensus.cc:2267] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.035845 4589 ts_tablet_manager.cc:1905] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.035622 4557 tablet_bootstrap.cc:654] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.034554 4592 ts_tablet_manager.cc:1918] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.036693 4592 log.cc:1198] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/55ed45d371a34a51a42fb04f4a450ae5
I20250115 10:12:04.036947 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
I20250115 10:12:04.036984 4592 ts_tablet_manager.cc:1939] T 55ed45d371a34a51a42fb04f4a450ae5 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.037753 4880 tablet.cc:1721] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.038034 3770 consensus_queue.cc:1035] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.038341 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 55ed45d371a34a51a42fb04f4a450ae5 (table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]) successfully deleted
I20250115 10:12:04.039566 3415 raft_consensus.cc:1270] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.039701 3770 consensus_queue.cc:1035] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.039752 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8a485231d2de4fab8b86b4900976c76c (table default.Table_75074a0c849b4155b18cafeaaf7afba3 [id=7f7d544d395147e1bf7f6652cf48d8db]). Expected version 1 got 0
W20250115 10:12:04.039906 3215 consensus_peers.cc:487] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.039911 4589 ts_tablet_manager.cc:1918] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.040289 4589 log.cc:1198] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/55ed45d371a34a51a42fb04f4a450ae5
I20250115 10:12:04.040295 4890 tablet.cc:1721] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.040354 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:04.040490 4589 ts_tablet_manager.cc:1939] T 55ed45d371a34a51a42fb04f4a450ae5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.040580 4557 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.040618 4557 ts_tablet_manager.cc:1397] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.040756 4557 raft_consensus.cc:357] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.040832 4557 raft_consensus.cc:383] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.040853 4557 raft_consensus.cc:738] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.040850 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 55ed45d371a34a51a42fb04f4a450ae5 (table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]) successfully deleted
I20250115 10:12:04.040894 4557 consensus_queue.cc:260] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.041018 4557 ts_tablet_manager.cc:1428] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.041077 4557 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.041430 3546 raft_consensus.cc:1270] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.041461 4557 tablet_bootstrap.cc:654] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.041574 4551 ts_tablet_manager.cc:1905] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.041785 3414 raft_consensus.cc:1270] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.042021 4884 raft_consensus.cc:491] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.042065 4884 raft_consensus.cc:513] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.042207 4884 leader_election.cc:290] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.042286 3770 consensus_queue.cc:1035] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.043092 4551 ts_tablet_manager.cc:1918] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.043135 4551 log.cc:1198] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/55ed45d371a34a51a42fb04f4a450ae5
I20250115 10:12:04.043239 3277 raft_consensus.cc:1270] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.043270 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.043342 3280 raft_consensus.cc:2463] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.043360 4551 ts_tablet_manager.cc:1939] T 55ed45d371a34a51a42fb04f4a450ae5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.043414 4875 consensus_queue.cc:1035] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.043483 3485 leader_election.cc:304] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.043555 4884 raft_consensus.cc:2798] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.043581 4884 raft_consensus.cc:491] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.043604 4884 raft_consensus.cc:3054] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.043869 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f] alter complete (version 5)
I20250115 10:12:04.044306 4884 raft_consensus.cc:513] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.044413 4884 leader_election.cc:290] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.044477 4731 consensus_queue.cc:1035] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.044589 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.044652 3413 raft_consensus.cc:2463] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.044785 4662 tablet.cc:1721] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.044811 4880 tablet.cc:1721] T 509f854a424e497f8fa72b70d5f0f651 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.044824 4663 tablet.cc:1721] T 509f854a424e497f8fa72b70d5f0f651 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.045993 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.046047 3277 raft_consensus.cc:3054] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.046203 3546 raft_consensus.cc:1270] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.046631 3277 raft_consensus.cc:2463] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.046742 3485 leader_election.cc:304] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.046815 4884 raft_consensus.cc:2798] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.046844 4884 raft_consensus.cc:695] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.046883 4884 consensus_queue.cc:237] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.047150 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af48bf64e2ca4a3197805c75fb0a12a6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.047214 3412 raft_consensus.cc:3054] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.047392 3277 raft_consensus.cc:1270] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250115 10:12:04.047446 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 166e6390660c485c99b2e115fd1b272f
W20250115 10:12:04.047484 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:04.047513 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
W20250115 10:12:04.047832 3484 consensus_peers.cc:487] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.047917 3412 raft_consensus.cc:2463] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.048091 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:04.048204 4699 consensus_queue.cc:1035] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.048311 4657 mvcc.cc:204] Tried to move back new op lower bound from 7114489544862318592 to 7114489543517777920. Current Snapshot: MvccSnapshot[applied={T|T < 7114489544862318592}]
I20250115 10:12:04.048542 4477 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3230c32afd0b4ef4ac496bafefed3a27" } modify_external_catalogs: true
I20250115 10:12:04.048604 4477 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3230c32afd0b4ef4ac496bafefed3a27" } modify_external_catalogs: true
W20250115 10:12:04.048825 3215 consensus_peers.cc:487] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.048941 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]). Expected version 1 got 0
I20250115 10:12:04.048949 3546 raft_consensus.cc:1270] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.049042 4890 tablet.cc:1721] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.049149 4731 consensus_queue.cc:1035] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.049403 4434 consensus_queue.cc:1035] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.050484 3414 raft_consensus.cc:1270] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.050899 4662 tablet.cc:1721] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.051291 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c] alter complete (version 1)
I20250115 10:12:04.051291 4873 tablet.cc:1721] T e91450b4369844ea9ab09383b3dbc8ee P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.051360 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 575f1a39f8a54c4cb21cd17d562c0542
I20250115 10:12:04.051807 3770 consensus_queue.cc:1035] T e91450b4369844ea9ab09383b3dbc8ee P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.051980 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.052083 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45] alter complete (version 1)
I20250115 10:12:04.052307 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.052722 3515 tablet_service.cc:1514] Processing DeleteTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.053042 4890 tablet.cc:1721] T e91450b4369844ea9ab09383b3dbc8ee P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:04.053100 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 575f1a39f8a54c4cb21cd17d562c0542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 575f1a39f8a54c4cb21cd17d562c0542 already in progress: creating tablet
I20250115 10:12:04.054073 4569 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.054118 4569 ts_tablet_manager.cc:1397] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:04.054296 4569 raft_consensus.cc:357] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.054352 4569 raft_consensus.cc:383] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.054351 4575 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.054375 4569 raft_consensus.cc:738] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.054389 4575 ts_tablet_manager.cc:1397] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.000s
I20250115 10:12:04.054410 4569 consensus_queue.cc:260] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.054514 4569 ts_tablet_manager.cc:1428] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.054461 4468 catalog_manager.cc:5526] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.054545 4575 raft_consensus.cc:357] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.054575 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:04.054600 4569 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.054602 4575 raft_consensus.cc:383] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.054615 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:04.054623 4575 raft_consensus.cc:738] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.054863 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 55ed45d371a34a51a42fb04f4a450ae5 (table default.Table_ec128e5d9b6a4ee9aa3433d149db3438 [id=f5cc0e0f47ea4db7808483e64e58b1ee]) successfully deleted
W20250115 10:12:04.054926 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 575f1a39f8a54c4cb21cd17d562c0542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 575f1a39f8a54c4cb21cd17d562c0542 already in progress: creating tablet
W20250115 10:12:04.054989 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 575f1a39f8a54c4cb21cd17d562c0542 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 575f1a39f8a54c4cb21cd17d562c0542 already in progress: creating tablet
I20250115 10:12:04.055181 4569 tablet_bootstrap.cc:654] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.054656 4575 consensus_queue.cc:260] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.056216 4575 ts_tablet_manager.cc:1428] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.056281 4575 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.056893 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:04.056978 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_5bebe80015df4ceeba5483945cad58ed [id=a41e32943f5d4e3fb6dcef4b58bb53ce] alter complete (version 1)
I20250115 10:12:04.057089 3952 raft_consensus.cc:491] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.057132 3952 raft_consensus.cc:513] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.057229 3952 leader_election.cc:290] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.057750 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.058028 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.058140 4575 tablet_bootstrap.cc:654] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.058457 3215 leader_election.cc:343] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.058625 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
W20250115 10:12:04.058940 3214 leader_election.cc:343] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.058988 3214 leader_election.cc:304] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.059041 3952 raft_consensus.cc:2743] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.059338 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:04.060933 3547 raft_consensus.cc:1270] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.061388 3952 consensus_queue.cc:1035] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.061630 4575 tablet_bootstrap.cc:492] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.061669 4575 ts_tablet_manager.cc:1397] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
W20250115 10:12:04.061688 3214 consensus_peers.cc:487] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.061874 4575 raft_consensus.cc:357] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.062074 4575 raft_consensus.cc:383] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.062105 4575 raft_consensus.cc:738] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.062145 4575 consensus_queue.cc:260] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.062245 4575 ts_tablet_manager.cc:1428] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.062301 4575 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.063620 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:04.063763 4575 tablet_bootstrap.cc:654] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.064327 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:04.065753 3484 consensus_peers.cc:487] T 4f559e7cafb04ae39af12e7681bbaf24 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f559e7cafb04ae39af12e7681bbaf24. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:04.066303 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]). Expected version 5 got 0
I20250115 10:12:04.066462 4663 tablet.cc:1721] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.066782 4557 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.066829 4557 ts_tablet_manager.cc:1397] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20250115 10:12:04.066995 4557 raft_consensus.cc:357] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.067062 4557 raft_consensus.cc:383] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.067081 4557 raft_consensus.cc:738] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.067122 4557 consensus_queue.cc:260] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.067215 4557 ts_tablet_manager.cc:1428] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.067445 4557 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.068255 4569 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.068298 4569 ts_tablet_manager.cc:1397] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:04.068437 4569 raft_consensus.cc:357] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.068492 4569 raft_consensus.cc:383] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.068511 4569 raft_consensus.cc:738] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.068555 4569 consensus_queue.cc:260] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.068670 4569 ts_tablet_manager.cc:1428] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.068938 4569 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.069372 4569 tablet_bootstrap.cc:654] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.069940 4569 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.069986 4569 ts_tablet_manager.cc:1397] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.070174 4569 raft_consensus.cc:357] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.070235 4569 raft_consensus.cc:383] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.070272 4569 raft_consensus.cc:738] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.070487 4569 consensus_queue.cc:260] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.070719 4569 ts_tablet_manager.cc:1428] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.070783 4662 tablet.cc:1721] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.071069 4663 tablet.cc:1721] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.070798 4569 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.071661 4569 tablet_bootstrap.cc:654] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.072081 4557 tablet_bootstrap.cc:654] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.074628 3394 tablet_service.cc:1467] Processing CreateTablet for tablet d3a716a282fa4445864baec3e8a16780 (DEFAULT_TABLE table=default.Table_a9096cacdd92437d98da0c463a8782eb [id=b086f65df32546efa11c6f91dcecaca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.074736 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a716a282fa4445864baec3e8a16780. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.074985 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 (DEFAULT_TABLE table=default.Table_9b8574ea15ad4c9db7d63aa09348d5ee [id=ea0893a6a869460ca8a35b462634f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.075079 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3bb9b55a54469e9c93e1e29f33e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.076421 3252 tablet_service.cc:1467] Processing CreateTablet for tablet d3a716a282fa4445864baec3e8a16780 (DEFAULT_TABLE table=default.Table_a9096cacdd92437d98da0c463a8782eb [id=b086f65df32546efa11c6f91dcecaca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.076473 3260 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 (DEFAULT_TABLE table=default.Table_9b8574ea15ad4c9db7d63aa09348d5ee [id=ea0893a6a869460ca8a35b462634f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.076516 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a716a282fa4445864baec3e8a16780. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.076583 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3bb9b55a54469e9c93e1e29f33e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.077311 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 28afafb99f264b0d9798222cb0e6556a (DEFAULT_TABLE table=default.Table_205ef4bd277848d7947bf4073aedd705 [id=26ac710a47e84850b31dc47b3a98abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.077391 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28afafb99f264b0d9798222cb0e6556a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.077952 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d (DEFAULT_TABLE table=default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a [id=3046ddf511e64d1ea924872f845fa177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.078045 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0a903ed9f34aaeacf5de038ec4e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.076421 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 5c71f6d6296343a48b2ebf54f341c679 (DEFAULT_TABLE table=default.Table_a1a29efbe0f049ecb7deece829e59020 [id=4a759451c5b943489bff90cd8883a867]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.078457 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c71f6d6296343a48b2ebf54f341c679. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.079258 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7732a7b5a54f75b55c5db4e9fbe172 (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079293 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 28afafb99f264b0d9798222cb0e6556a (DEFAULT_TABLE table=default.Table_205ef4bd277848d7947bf4073aedd705 [id=26ac710a47e84850b31dc47b3a98abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079331 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7732a7b5a54f75b55c5db4e9fbe172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.079345 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7732a7b5a54f75b55c5db4e9fbe172 (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079417 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d (DEFAULT_TABLE table=default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a [id=3046ddf511e64d1ea924872f845fa177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079345 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 5c71f6d6296343a48b2ebf54f341c679 (DEFAULT_TABLE table=default.Table_a1a29efbe0f049ecb7deece829e59020 [id=4a759451c5b943489bff90cd8883a867]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079370 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28afafb99f264b0d9798222cb0e6556a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.079587 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0a903ed9f34aaeacf5de038ec4e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.079747 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 (DEFAULT_TABLE table=default.Table_9b8574ea15ad4c9db7d63aa09348d5ee [id=ea0893a6a869460ca8a35b462634f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.079856 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3bb9b55a54469e9c93e1e29f33e533. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.080366 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 9283eb29ce3c4a9ba4793e598e9b2092 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.080478 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9283eb29ce3c4a9ba4793e598e9b2092. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.080722 3515 tablet_service.cc:1467] Processing CreateTablet for tablet d3a716a282fa4445864baec3e8a16780 (DEFAULT_TABLE table=default.Table_a9096cacdd92437d98da0c463a8782eb [id=b086f65df32546efa11c6f91dcecaca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.080811 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3a716a282fa4445864baec3e8a16780. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.081142 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:04.081153 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d (DEFAULT_TABLE table=default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a [id=3046ddf511e64d1ea924872f845fa177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.081226 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f0a903ed9f34aaeacf5de038ec4e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.081480 4557 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.081526 4557 ts_tablet_manager.cc:1397] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:04.081604 3246 tablet_service.cc:1467] Processing CreateTablet for tablet cfbe37ac4d654728b8b7aa1398fef9d4 (DEFAULT_TABLE table=default.Table_4125e59ac88c45be8b92b9b825848eba [id=d675d81c75a444c181daa17502886ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.081673 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe37ac4d654728b8b7aa1398fef9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.081663 4557 raft_consensus.cc:357] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.081725 4557 raft_consensus.cc:383] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.081758 4557 raft_consensus.cc:738] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.081795 4557 consensus_queue.cc:260] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.081903 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 28afafb99f264b0d9798222cb0e6556a (DEFAULT_TABLE table=default.Table_205ef4bd277848d7947bf4073aedd705 [id=26ac710a47e84850b31dc47b3a98abd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.081984 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28afafb99f264b0d9798222cb0e6556a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.082348 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7732a7b5a54f75b55c5db4e9fbe172 (DEFAULT_TABLE table=default.Table_7e39e68667ac47acb9e3f14e4bb12ec1 [id=efbf496c85db46bcb772fec746228736]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.081918 4557 ts_tablet_manager.cc:1428] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.082449 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 5c71f6d6296343a48b2ebf54f341c679 (DEFAULT_TABLE table=default.Table_a1a29efbe0f049ecb7deece829e59020 [id=4a759451c5b943489bff90cd8883a867]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.082504 4557 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.083141 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 9283eb29ce3c4a9ba4793e598e9b2092 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.082422 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7732a7b5a54f75b55c5db4e9fbe172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.083197 3513 tablet_service.cc:1467] Processing CreateTablet for tablet cfbe37ac4d654728b8b7aa1398fef9d4 (DEFAULT_TABLE table=default.Table_4125e59ac88c45be8b92b9b825848eba [id=d675d81c75a444c181daa17502886ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.083261 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9283eb29ce3c4a9ba4793e598e9b2092. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.083271 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe37ac4d654728b8b7aa1398fef9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.083779 3386 tablet_service.cc:1467] Processing CreateTablet for tablet cfbe37ac4d654728b8b7aa1398fef9d4 (DEFAULT_TABLE table=default.Table_4125e59ac88c45be8b92b9b825848eba [id=d675d81c75a444c181daa17502886ae4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.083889 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbe37ac4d654728b8b7aa1398fef9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.083173 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 9283eb29ce3c4a9ba4793e598e9b2092 (DEFAULT_TABLE table=default.Table_cca10c5c49044a0cbcfcc4c159f06e41 [id=39c8259b61fb4882ae8388b54a547a7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.084347 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9283eb29ce3c4a9ba4793e598e9b2092. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.085764 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c71f6d6296343a48b2ebf54f341c679. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.085798 4731 raft_consensus.cc:491] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.085847 4731 raft_consensus.cc:513] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.085935 4335 raft_consensus.cc:491] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.085974 4335 raft_consensus.cc:513] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.086004 4731 leader_election.cc:290] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.086448 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.086475 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576e273ac51f4eb498faccab336c479d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.086532 4557 tablet_bootstrap.cc:654] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.086548 3411 raft_consensus.cc:2463] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:04.086659 3214 leader_election.cc:343] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.086730 3214 leader_election.cc:304] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.086088 4335 leader_election.cc:290] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.086865 4335 raft_consensus.cc:2798] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.086885 4335 raft_consensus.cc:491] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.086926 4335 raft_consensus.cc:3054] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.086915 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576e273ac51f4eb498faccab336c479d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.086941 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
W20250115 10:12:04.086974 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:04.086979 3549 raft_consensus.cc:2463] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.087020 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c71f6d6296343a48b2ebf54f341c679. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.087540 4335 raft_consensus.cc:513] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.087654 4335 leader_election.cc:290] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.087762 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.087813 3547 raft_consensus.cc:2463] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.088217 3215 leader_election.cc:304] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.088913 4908 raft_consensus.cc:2798] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.089850 4908 raft_consensus.cc:491] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.089910 4908 raft_consensus.cc:3054] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.090503 3952 consensus_queue.cc:1035] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.090788 4662 tablet.cc:1721] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.091132 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7732a7b5a54f75b55c5db4e9fbe172. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.091765 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b3fbd549a43142f0934459f981bbe3e1" } new_table_name: "default.Table_01cee5e7893944e280e7f3faa9b07f1c" modify_external_catalogs: true
I20250115 10:12:04.092471 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576e273ac51f4eb498faccab336c479d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.092530 3547 raft_consensus.cc:3054] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.093078 4908 raft_consensus.cc:513] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.093160 3547 raft_consensus.cc:2463] T 576e273ac51f4eb498faccab336c479d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.093298 3215 leader_election.cc:304] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.093374 3952 raft_consensus.cc:2798] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.093423 3952 raft_consensus.cc:695] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.093461 3952 consensus_queue.cc:237] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.094182 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef7f182c4bde468d919523c44fdf3ea4 consensus state has no leader
I20250115 10:12:04.094233 4908 leader_election.cc:290] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.094378 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.094436 3546 raft_consensus.cc:3054] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.095017 3546 raft_consensus.cc:2463] T a154d22681d34329b497747e84ce41cf P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.095405 4557 tablet_bootstrap.cc:492] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.095422 3215 leader_election.cc:304] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.095484 4557 ts_tablet_manager.cc:1397] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:04.095521 4731 raft_consensus.cc:2798] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.095557 4731 raft_consensus.cc:695] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.095597 4731 consensus_queue.cc:237] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.095654 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "576e273ac51f4eb498faccab336c479d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.095712 3413 raft_consensus.cc:3054] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.095697 4557 raft_consensus.cc:357] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.095834 4557 raft_consensus.cc:383] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.095880 4557 raft_consensus.cc:738] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.096009 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]). Expected version 1 got 0
I20250115 10:12:04.096352 4667 tablet.cc:1721] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.096397 3413 raft_consensus.cc:2463] T 576e273ac51f4eb498faccab336c479d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.096457 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:04.097136 3214 leader_election.cc:343] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.097193 4569 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.097232 4569 ts_tablet_manager.cc:1397] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
I20250115 10:12:04.097251 3770 consensus_queue.cc:1035] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.097291 4667 tablet.cc:1721] T 509f854a424e497f8fa72b70d5f0f651 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.097361 4569 raft_consensus.cc:357] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.097414 4569 raft_consensus.cc:383] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.097434 4569 raft_consensus.cc:738] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.097489 4569 consensus_queue.cc:260] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.097622 4569 ts_tablet_manager.cc:1428] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.097975 4663 tablet.cc:1721] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.097678 4569 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.098278 3411 raft_consensus.cc:1270] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.098330 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 509f854a424e497f8fa72b70d5f0f651 (table default.Table_7a9c88dccb1842e2b6cc70c2acae3f1c [id=5ebd08c3eff74d908425a5670535ba45]). Expected version 1 got 0
I20250115 10:12:04.098731 4569 tablet_bootstrap.cc:654] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.098752 3546 raft_consensus.cc:1270] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.099195 4569 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.099231 4569 ts_tablet_manager.cc:1397] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.099241 4731 consensus_queue.cc:1035] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.099361 4569 raft_consensus.cc:357] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.099412 4569 raft_consensus.cc:383] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.099431 4569 raft_consensus.cc:738] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.099463 4569 consensus_queue.cc:260] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.099537 4569 ts_tablet_manager.cc:1428] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.099596 4569 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.100013 4569 tablet_bootstrap.cc:654] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.100080 4731 consensus_queue.cc:1035] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.100420 4662 tablet.cc:1721] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:04.100446 3484 consensus_peers.cc:487] T 3096adefffe04e008f58ecba3c3dd633 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3096adefffe04e008f58ecba3c3dd633. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:04.100756 3770 consensus_queue.cc:1035] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.096154 4557 consensus_queue.cc:260] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.101070 4557 ts_tablet_manager.cc:1428] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.101159 4557 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.101202 4653 mvcc.cc:204] Tried to move back new op lower bound from 7114489544876875776 to 7114489543030824960. Current Snapshot: MvccSnapshot[applied={T|T < 7114489544876875776}]
I20250115 10:12:04.101460 4569 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.101495 4569 ts_tablet_manager.cc:1397] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.101547 4663 tablet.cc:1721] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.101627 4569 raft_consensus.cc:357] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.101670 4569 raft_consensus.cc:383] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.101684 4569 raft_consensus.cc:738] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.101716 4569 consensus_queue.cc:260] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.101797 4569 ts_tablet_manager.cc:1428] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.101845 4569 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.102146 4569 tablet_bootstrap.cc:654] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.102262 4557 tablet_bootstrap.cc:654] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.102942 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333] alter complete (version 1)
I20250115 10:12:04.103485 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:04.103788 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc] alter complete (version 1)
W20250115 10:12:04.104653 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:12:04.104709 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:04.104687 4667 tablet.cc:1721] T 74ab86571c3a469da7a51cf6033c5b10 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.104964 4662 tablet.cc:1721] T 74ab86571c3a469da7a51cf6033c5b10 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.105080 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:04.106456 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d] alter complete (version 5)
I20250115 10:12:04.106612 4569 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.106665 4569 ts_tablet_manager.cc:1397] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.106817 4569 raft_consensus.cc:357] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.106860 4569 raft_consensus.cc:383] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.106876 4569 raft_consensus.cc:738] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.106907 4569 consensus_queue.cc:260] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.106981 4569 ts_tablet_manager.cc:1428] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.107025 4569 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.107375 4569 tablet_bootstrap.cc:654] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.108430 4557 tablet_bootstrap.cc:492] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.108466 4557 ts_tablet_manager.cc:1397] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:04.108525 4569 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
W20250115 10:12:04.108539 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
I20250115 10:12:04.108558 4569 ts_tablet_manager.cc:1397] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.108588 4557 raft_consensus.cc:357] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.108634 4557 raft_consensus.cc:383] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.108597 4472 catalog_manager.cc:5526] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.108654 4557 raft_consensus.cc:738] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.108672 4569 raft_consensus.cc:357] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.108685 4472 catalog_manager.cc:5526] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.108724 4569 raft_consensus.cc:383] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.108701 4557 consensus_queue.cc:260] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.108742 4569 raft_consensus.cc:738] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.108743 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.108770 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:04.108795 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:04.108795 4557 ts_tablet_manager.cc:1428] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.108790 4569 consensus_queue.cc:260] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.108815 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:04.108860 4557 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.108875 4569 ts_tablet_manager.cc:1428] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.108923 4569 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.109284 4569 tablet_bootstrap.cc:654] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.109364 4557 tablet_bootstrap.cc:654] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.110877 4434 raft_consensus.cc:491] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:04.110905 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:04.110920 4434 raft_consensus.cc:513] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.111018 4434 leader_election.cc:290] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.111148 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.111339 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.111507 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c35ca809b19541479146f385e1d3cebe" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.111755 3485 leader_election.cc:304] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.111809 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:04.112020 4434 raft_consensus.cc:2743] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.112763 4569 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.112803 4569 ts_tablet_manager.cc:1397] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:04.112931 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a] alter complete (version 1)
I20250115 10:12:04.112949 4569 raft_consensus.cc:357] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.113009 4569 raft_consensus.cc:383] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.113030 4569 raft_consensus.cc:738] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.113071 4569 consensus_queue.cc:260] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.113185 4569 ts_tablet_manager.cc:1428] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.113440 4569 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.113839 4569 tablet_bootstrap.cc:654] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.114627 4663 tablet.cc:1721] T 74ab86571c3a469da7a51cf6033c5b10 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:04.115695 3215 consensus_peers.cc:487] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.115864 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 74ab86571c3a469da7a51cf6033c5b10 (table default.Table_b557d077a5384524b12ab5de762c3aea [id=03b48d4b08244c53bba7b29e9939212a]). Expected version 1 got 0
I20250115 10:12:04.116212 3413 raft_consensus.cc:3054] T 8191b81bdad74a9b8aa049473325720b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.116331 3770 raft_consensus.cc:491] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.116376 3770 raft_consensus.cc:513] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.116511 3770 leader_election.cc:290] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.116643 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.116758 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.116812 4335 raft_consensus.cc:491] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.116853 4335 raft_consensus.cc:513] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.116966 4335 leader_election.cc:290] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.117130 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.117228 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.117252 4575 tablet_bootstrap.cc:492] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.117292 4575 ts_tablet_manager.cc:1397] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.001s
W20250115 10:12:04.117388 3214 leader_election.cc:343] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.117429 4575 raft_consensus.cc:357] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.117483 4575 raft_consensus.cc:383] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.117501 4575 raft_consensus.cc:738] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.117537 4575 consensus_queue.cc:260] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.117625 4575 ts_tablet_manager.cc:1428] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.117650 4335 consensus_queue.cc:1035] T 8191b81bdad74a9b8aa049473325720b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.117689 4575 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.117800 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
I20250115 10:12:04.117844 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.118067 4575 tablet_bootstrap.cc:654] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.118211 3215 leader_election.cc:343] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.118245 3215 leader_election.cc:304] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.118636 4335 raft_consensus.cc:2743] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.119494 4575 tablet_bootstrap.cc:492] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.119541 4575 ts_tablet_manager.cc:1397] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.119660 4575 raft_consensus.cc:357] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.119752 4575 raft_consensus.cc:383] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.119773 4575 raft_consensus.cc:738] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.119803 4575 consensus_queue.cc:260] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.119910 4575 ts_tablet_manager.cc:1428] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.119961 4575 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.120102 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cd6b39cd88247bfa120903465b676b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.120162 3413 raft_consensus.cc:2388] T 7cd6b39cd88247bfa120903465b676b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.120328 4575 tablet_bootstrap.cc:654] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.120424 3214 leader_election.cc:304] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.120512 4335 raft_consensus.cc:3054] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.120604 4557 tablet_bootstrap.cc:492] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.120647 4557 ts_tablet_manager.cc:1397] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:04.120800 4557 raft_consensus.cc:357] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.120867 4557 raft_consensus.cc:383] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.120886 4557 raft_consensus.cc:738] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.120925 4557 consensus_queue.cc:260] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.121039 4557 ts_tablet_manager.cc:1428] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.121095 4557 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.121161 4335 raft_consensus.cc:2743] T 7cd6b39cd88247bfa120903465b676b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.121526 4557 tablet_bootstrap.cc:654] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.121590 4699 raft_consensus.cc:491] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.121632 4699 raft_consensus.cc:513] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.121753 4699 leader_election.cc:290] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.122146 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.122215 3280 raft_consensus.cc:2463] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.122195 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.122247 3549 raft_consensus.cc:2463] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.122501 4569 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.122502 3350 leader_election.cc:304] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.122550 4569 ts_tablet_manager.cc:1397] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:04.122579 4699 raft_consensus.cc:2798] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.122642 4699 raft_consensus.cc:491] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.122665 4699 raft_consensus.cc:3054] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.122715 4569 raft_consensus.cc:357] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.122769 4569 raft_consensus.cc:383] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.122787 4569 raft_consensus.cc:738] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.122825 4569 consensus_queue.cc:260] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.122902 4569 ts_tablet_manager.cc:1428] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.122948 4569 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.122967 4575 tablet_bootstrap.cc:492] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.123004 4575 ts_tablet_manager.cc:1397] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.123138 4575 raft_consensus.cc:357] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.123183 4575 raft_consensus.cc:383] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.123206 4575 raft_consensus.cc:738] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.123232 4575 consensus_queue.cc:260] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.123320 4575 ts_tablet_manager.cc:1428] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.123317 4569 tablet_bootstrap.cc:654] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.123340 4699 raft_consensus.cc:513] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.123382 4575 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.123453 4699 leader_election.cc:290] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.123826 4575 tablet_bootstrap.cc:654] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.123898 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.123951 3549 raft_consensus.cc:3054] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.123955 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d42535a811dc420b94527f7d81efdd13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.123999 3280 raft_consensus.cc:3054] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.123976 3770 consensus_queue.cc:1035] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.124531 3280 raft_consensus.cc:2463] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.124531 3549 raft_consensus.cc:2463] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.124833 3350 leader_election.cc:304] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.124899 4875 raft_consensus.cc:2798] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.124946 4875 raft_consensus.cc:695] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
W20250115 10:12:04.124964 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.124984 4875 consensus_queue.cc:237] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.125250 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]). Expected version 1 got 0
I20250115 10:12:04.125315 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]). Expected version 5 got 0
I20250115 10:12:04.125962 4575 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.125984 3411 raft_consensus.cc:3054] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.126045 4575 ts_tablet_manager.cc:1397] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.126174 4575 raft_consensus.cc:357] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.126220 4575 raft_consensus.cc:383] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.126238 4575 raft_consensus.cc:738] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.126266 4575 consensus_queue.cc:260] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.126368 4575 ts_tablet_manager.cc:1428] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.126425 4575 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.126410 3770 consensus_queue.cc:1035] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.126829 4575 tablet_bootstrap.cc:654] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.126961 4434 consensus_queue.cc:1035] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.127312 4468 catalog_manager.cc:5526] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.127409 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:04.128388 4575 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.128434 4575 ts_tablet_manager.cc:1397] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.128512 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_547a65dbda1749c082cfb2aa9f2a2285" } new_table_name: "default.Table_8efe8747d11e4af0a7df52864f2a926f" modify_external_catalogs: true
I20250115 10:12:04.128567 4575 raft_consensus.cc:357] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.128608 4575 raft_consensus.cc:383] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.128623 4575 raft_consensus.cc:738] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.128659 4575 consensus_queue.cc:260] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.128746 4575 ts_tablet_manager.cc:1428] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.128804 4575 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.129230 4575 tablet_bootstrap.cc:654] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.130174 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 60cc9a1b2c4348ada0d8dab958aded09 consensus state has no leader
I20250115 10:12:04.130416 4434 raft_consensus.cc:491] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.130462 4434 raft_consensus.cc:513] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.130549 4434 leader_election.cc:290] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.130741 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.130872 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.130909 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 0fbb9cfc01df408eaae41b38e8c62c86
W20250115 10:12:04.130945 3484 leader_election.cc:343] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.130975 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
W20250115 10:12:04.131013 3485 leader_election.cc:343] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.131049 3485 leader_election.cc:304] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.131096 4434 raft_consensus.cc:2743] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.131304 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_14d785779a8d4d4b91c4eaf2a2fd5f0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.131283 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8c164e3381824da3ade143c52e9c57f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.131417 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14d785779a8d4d4b91c4eaf2a2fd5f0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:04.131429 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c164e3381824da3ade143c52e9c57f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.133602 3415 raft_consensus.cc:1270] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.133620 3280 raft_consensus.cc:1270] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.133754 4434 consensus_queue.cc:1035] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.133859 4887 consensus_queue.cc:1035] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.134861 3394 tablet_service.cc:1467] Processing CreateTablet for tablet cd0918de246b4150bb919cc52fe48ac3 (DEFAULT_TABLE table=default.Table_14d785779a8d4d4b91c4eaf2a2fd5f0b [id=6e212410e31f4cad9a69097b5af7cb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.134891 3246 tablet_service.cc:1467] Processing CreateTablet for tablet cd0918de246b4150bb919cc52fe48ac3 (DEFAULT_TABLE table=default.Table_14d785779a8d4d4b91c4eaf2a2fd5f0b [id=6e212410e31f4cad9a69097b5af7cb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.134955 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0918de246b4150bb919cc52fe48ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.134967 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0918de246b4150bb919cc52fe48ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.135030 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:04.135102 3530 tablet_service.cc:1467] Processing CreateTablet for tablet cd0918de246b4150bb919cc52fe48ac3 (DEFAULT_TABLE table=default.Table_14d785779a8d4d4b91c4eaf2a2fd5f0b [id=6e212410e31f4cad9a69097b5af7cb27]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.135193 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0918de246b4150bb919cc52fe48ac3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.135229 4569 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.135283 4569 ts_tablet_manager.cc:1397] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:04.135408 4569 raft_consensus.cc:357] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.135458 4569 raft_consensus.cc:383] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.135475 4569 raft_consensus.cc:738] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.135531 4569 consensus_queue.cc:260] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.135622 4569 ts_tablet_manager.cc:1428] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.135669 4569 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.136056 4569 tablet_bootstrap.cc:654] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.136572 4569 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.136607 4569 ts_tablet_manager.cc:1397] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.136736 4569 raft_consensus.cc:357] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.136760 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0d603960b0604f3ebe288c27daa21c6f" } new_table_name: "default.Table_90ef46426add4005851c5eff0f43e3af" modify_external_catalogs: true
I20250115 10:12:04.136793 4569 raft_consensus.cc:383] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.136811 4569 raft_consensus.cc:738] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.136847 4569 consensus_queue.cc:260] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.136925 4569 ts_tablet_manager.cc:1428] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.136976 4569 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.137241 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_eb4ead8621074161aaa1f06e5ed31482" } new_table_name: "default.Table_5b722750808f41ac9670becff65dfcc9" modify_external_catalogs: true
I20250115 10:12:04.137393 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]). Expected version 2 got 0
I20250115 10:12:04.137471 4569 tablet_bootstrap.cc:654] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.138067 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9305b7ac82cd4393b28017831a0687ff consensus state has no leader
I20250115 10:12:04.138533 4663 tablet.cc:1721] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.138653 3389 tablet_service.cc:1467] Processing CreateTablet for tablet d3feec32271e4e519bbe3c512e790b3c (DEFAULT_TABLE table=default.Table_8c164e3381824da3ade143c52e9c57f7 [id=59362728451944019e7ea7bf12d98022]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.138744 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feec32271e4e519bbe3c512e790b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.138929 4662 tablet.cc:1721] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.139799 3530 tablet_service.cc:1467] Processing CreateTablet for tablet d3feec32271e4e519bbe3c512e790b3c (DEFAULT_TABLE table=default.Table_8c164e3381824da3ade143c52e9c57f7 [id=59362728451944019e7ea7bf12d98022]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.139884 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feec32271e4e519bbe3c512e790b3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.141127 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.141534 4569 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.141577 4569 ts_tablet_manager.cc:1397] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.141719 4569 raft_consensus.cc:357] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.141779 4569 raft_consensus.cc:383] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.141798 4569 raft_consensus.cc:738] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.141831 4569 consensus_queue.cc:260] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.141885 3246 tablet_service.cc:1467] Processing CreateTablet for tablet d3feec32271e4e519bbe3c512e790b3c (DEFAULT_TABLE table=default.Table_8c164e3381824da3ade143c52e9c57f7 [id=59362728451944019e7ea7bf12d98022]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.141906 4569 ts_tablet_manager.cc:1428] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.142014 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3feec32271e4e519bbe3c512e790b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.142014 4569 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.142096 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d31f180a3fc499fbd505c986593a7f5 consensus state has no leader
I20250115 10:12:04.142494 4569 tablet_bootstrap.cc:654] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.143133 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.143422 4569 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.143466 4569 ts_tablet_manager.cc:1397] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.143604 4569 raft_consensus.cc:357] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.143667 4569 raft_consensus.cc:383] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.143687 4569 raft_consensus.cc:738] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.143740 3770 raft_consensus.cc:491] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.143803 3770 raft_consensus.cc:513] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.143916 3770 leader_election.cc:290] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.144137 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.143743 4569 consensus_queue.cc:260] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.144259 4569 ts_tablet_manager.cc:1428] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.144256 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.144309 4569 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.144323 3214 leader_election.cc:343] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.144364 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883] alter complete (version 2)
W20250115 10:12:04.144500 3215 leader_election.cc:343] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.144544 3215 leader_election.cc:304] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.144625 4335 raft_consensus.cc:2743] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.144693 4569 tablet_bootstrap.cc:654] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.145254 4557 tablet_bootstrap.cc:492] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.145301 4557 ts_tablet_manager.cc:1397] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250115 10:12:04.145450 4557 raft_consensus.cc:357] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.145509 4557 raft_consensus.cc:383] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.145527 4557 raft_consensus.cc:738] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.145586 4557 consensus_queue.cc:260] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.145632 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.145681 4557 ts_tablet_manager.cc:1428] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.145741 4557 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.146145 4557 tablet_bootstrap.cc:654] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.146432 4569 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.146481 4569 ts_tablet_manager.cc:1397] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.146616 4569 raft_consensus.cc:357] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.146663 4569 raft_consensus.cc:383] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.146679 4569 raft_consensus.cc:738] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.146711 4569 consensus_queue.cc:260] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.146791 4569 ts_tablet_manager.cc:1428] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.147207 4569 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.148027 4569 tablet_bootstrap.cc:654] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.148650 4569 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.148698 4569 ts_tablet_manager.cc:1397] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.148833 4569 raft_consensus.cc:357] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.148900 4569 raft_consensus.cc:383] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.148918 4569 raft_consensus.cc:738] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.148959 4569 consensus_queue.cc:260] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.148983 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9eec2d8d491247178912089523c4f45a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.149055 4569 ts_tablet_manager.cc:1428] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.149087 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eec2d8d491247178912089523c4f45a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.149111 4569 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.149499 4569 tablet_bootstrap.cc:654] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.151084 4557 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.151131 4557 ts_tablet_manager.cc:1397] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.151371 4557 raft_consensus.cc:357] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.151449 4557 raft_consensus.cc:383] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.151492 4557 raft_consensus.cc:738] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.151537 4557 consensus_queue.cc:260] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.151638 4557 ts_tablet_manager.cc:1428] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.151744 4569 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.151784 4569 ts_tablet_manager.cc:1397] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.151907 4569 raft_consensus.cc:357] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.151952 4569 raft_consensus.cc:383] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.151970 4569 raft_consensus.cc:738] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.151996 4569 consensus_queue.cc:260] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.152094 4569 ts_tablet_manager.cc:1428] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.152160 4569 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.152585 4569 tablet_bootstrap.cc:654] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.152925 4335 raft_consensus.cc:491] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.152976 4335 raft_consensus.cc:513] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.153088 4335 leader_election.cc:290] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.153119 4335 raft_consensus.cc:491] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.153146 4335 raft_consensus.cc:513] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.153239 4335 leader_election.cc:290] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.153337 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.153616 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.153717 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.154232 3215 leader_election.cc:343] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.154301 3215 leader_election.cc:343] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.154738 3214 leader_election.cc:343] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.154783 3214 leader_election.cc:304] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.154795 3381 tablet_service.cc:1467] Processing CreateTablet for tablet edab5a12fb714e689abee39bcbadb86b (DEFAULT_TABLE table=default.Table_9eec2d8d491247178912089523c4f45a [id=dd70b028eac1438daa6f74ef6c1efd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.154909 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edab5a12fb714e689abee39bcbadb86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.154901 3770 raft_consensus.cc:2743] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.155722 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.155897 4575 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.155959 4575 ts_tablet_manager.cc:1397] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.001s
I20250115 10:12:04.156117 4575 raft_consensus.cc:357] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.156174 4575 raft_consensus.cc:383] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.156195 4575 raft_consensus.cc:738] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.156236 4575 consensus_queue.cc:260] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.156337 4575 ts_tablet_manager.cc:1428] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.156430 4575 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.156865 4575 tablet_bootstrap.cc:654] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.157141 4434 raft_consensus.cc:491] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.157199 4434 raft_consensus.cc:513] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.157334 4434 leader_election.cc:290] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.157368 4434 raft_consensus.cc:491] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.157397 4434 raft_consensus.cc:513] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.157466 4434 leader_election.cc:290] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.157563 3214 leader_election.cc:343] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.157622 3214 leader_election.cc:304] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.157688 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.157763 4335 raft_consensus.cc:2743] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.157781 3280 raft_consensus.cc:2388] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.158425 3530 tablet_service.cc:1467] Processing CreateTablet for tablet edab5a12fb714e689abee39bcbadb86b (DEFAULT_TABLE table=default.Table_9eec2d8d491247178912089523c4f45a [id=dd70b028eac1438daa6f74ef6c1efd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.158404 4335 consensus_queue.cc:1035] T 9bc7d63d8661445cb804762413eac194 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.158533 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edab5a12fb714e689abee39bcbadb86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.160177 4884 raft_consensus.cc:491] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.160210 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.160230 4884 raft_consensus.cc:513] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.160336 4884 leader_election.cc:290] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.161039 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 09db89ab7dd543559ae8a11e60c8a873 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:04.161339 3485 leader_election.cc:343] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:04.161394 4575 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.161427 4575 ts_tablet_manager.cc:1397] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.161540 4575 raft_consensus.cc:357] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.161584 4575 raft_consensus.cc:383] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.161600 4575 raft_consensus.cc:738] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.161623 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:12:04.161638 4575 consensus_queue.cc:260] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.161731 4575 ts_tablet_manager.cc:1428] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.161914 4569 tablet_bootstrap.cc:492] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.161963 4569 ts_tablet_manager.cc:1397] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:04.162185 4569 raft_consensus.cc:357] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.162237 4569 raft_consensus.cc:383] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.162256 4569 raft_consensus.cc:738] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.162297 4569 consensus_queue.cc:260] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.162335 3485 leader_election.cc:343] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 166e6390660c485c99b2e115fd1b272f
I20250115 10:12:04.162359 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35847dc829b4b3d94c0fb68ec6c2b31" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.162421 4569 ts_tablet_manager.cc:1428] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.162463 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc6b5ec8e472414789f9619ae958fa34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.162488 4569 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.162532 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e6390660c485c99b2e115fd1b272f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.163170 4434 consensus_queue.cc:1035] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.163379 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 10965ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:04.164076 3484 leader_election.cc:343] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.164132 3484 leader_election.cc:304] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.164212 3484 leader_election.cc:304] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.164281 3484 leader_election.cc:343] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.164304 3484 leader_election.cc:304] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.164315 4884 raft_consensus.cc:2743] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.164368 4884 raft_consensus.cc:3054] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.164397 4433 raft_consensus.cc:2743] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.164820 4575 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.165061 4884 raft_consensus.cc:2743] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.165231 4575 tablet_bootstrap.cc:654] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.165690 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 09db89ab7dd543559ae8a11e60c8a873
I20250115 10:12:04.165807 4472 catalog_manager.cc:6596] ReplaceTablet: tablet 09db89ab7dd543559ae8a11e60c8a873 deleted and replaced by tablet 0ecba5f150eb4d93b500a0ed3b56d97e
I20250115 10:12:04.165936 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ecba5f150eb4d93b500a0ed3b56d97e) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.166035 4589 tablet_replica.cc:331] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.166097 4589 raft_consensus.cc:2238] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.166169 4589 raft_consensus.cc:2267] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.166348 4589 ts_tablet_manager.cc:1905] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.166496 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ecba5f150eb4d93b500a0ed3b56d97e) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.166534 4557 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.166802 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:04.166939 4557 tablet_bootstrap.cc:654] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.166832 4569 tablet_bootstrap.cc:654] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.167121 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ecba5f150eb4d93b500a0ed3b56d97e) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.167281 4592 tablet_replica.cc:331] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.167359 4592 raft_consensus.cc:2238] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.167394 4592 raft_consensus.cc:2267] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.167949 4592 ts_tablet_manager.cc:1905] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.168181 4589 ts_tablet_manager.cc:1918] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.168219 4589 log.cc:1198] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/09db89ab7dd543559ae8a11e60c8a873
I20250115 10:12:04.168403 4589 ts_tablet_manager.cc:1939] T 09db89ab7dd543559ae8a11e60c8a873 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.168982 4557 tablet_bootstrap.cc:492] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.169019 4557 ts_tablet_manager.cc:1397] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20250115 10:12:04.169147 4557 raft_consensus.cc:357] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.169196 4557 raft_consensus.cc:383] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.169214 4557 raft_consensus.cc:738] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.169263 4557 consensus_queue.cc:260] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.169341 4592 ts_tablet_manager.cc:1918] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.169355 4557 ts_tablet_manager.cc:1428] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.169381 4592 log.cc:1198] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/09db89ab7dd543559ae8a11e60c8a873
I20250115 10:12:04.169409 4557 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.169579 4592 ts_tablet_manager.cc:1939] T 09db89ab7dd543559ae8a11e60c8a873 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.169787 4557 tablet_bootstrap.cc:654] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.170114 4908 raft_consensus.cc:491] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.170171 4908 raft_consensus.cc:513] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.170292 4908 leader_election.cc:290] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.170415 4569 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.170451 4569 ts_tablet_manager.cc:1397] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:04.170527 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc4e4d12dbc4e5aa240d9daab4afb1b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.170599 3546 raft_consensus.cc:2463] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.170584 4569 raft_consensus.cc:357] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.170634 4569 raft_consensus.cc:383] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.170650 4569 raft_consensus.cc:738] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.170706 4569 consensus_queue.cc:260] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.170769 3215 leader_election.cc:304] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.170861 4908 raft_consensus.cc:2798] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.170892 4908 raft_consensus.cc:491] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.170919 4908 raft_consensus.cc:3054] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.171165 4569 ts_tablet_manager.cc:1428] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.171236 4569 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.171656 4569 tablet_bootstrap.cc:654] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.171826 4908 raft_consensus.cc:513] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.171957 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 09db89ab7dd543559ae8a11e60c8a873 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 09db89ab7dd543559ae8a11e60c8a873 already in progress: creating tablet
I20250115 10:12:04.171993 4908 leader_election.cc:290] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.172035 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]) successfully deleted
I20250115 10:12:04.172183 3246 tablet_service.cc:1467] Processing CreateTablet for tablet edab5a12fb714e689abee39bcbadb86b (DEFAULT_TABLE table=default.Table_9eec2d8d491247178912089523c4f45a [id=dd70b028eac1438daa6f74ef6c1efd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.172286 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edab5a12fb714e689abee39bcbadb86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.172586 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc4e4d12dbc4e5aa240d9daab4afb1b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.172647 3412 raft_consensus.cc:2463] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.172765 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc4e4d12dbc4e5aa240d9daab4afb1b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.172842 3546 raft_consensus.cc:3054] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.172923 3413 raft_consensus.cc:3054] T 2836a492586e489daafc2da719455f39 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.173509 3546 raft_consensus.cc:2463] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.173743 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc4e4d12dbc4e5aa240d9daab4afb1b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.173804 3414 raft_consensus.cc:3054] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.174358 3414 raft_consensus.cc:2463] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.174489 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecba5f150eb4d93b500a0ed3b56d97e (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.174564 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecba5f150eb4d93b500a0ed3b56d97e (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.174659 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecba5f150eb4d93b500a0ed3b56d97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.174921 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 0ecba5f150eb4d93b500a0ed3b56d97e (DEFAULT_TABLE table=default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.175015 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecba5f150eb4d93b500a0ed3b56d97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.175858 4557 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.175897 4557 ts_tablet_manager.cc:1397] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.176046 4557 raft_consensus.cc:357] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.176097 4557 raft_consensus.cc:383] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.176115 4557 raft_consensus.cc:738] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.176159 4557 consensus_queue.cc:260] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.176271 4557 ts_tablet_manager.cc:1428] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.176337 4557 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.176788 4557 tablet_bootstrap.cc:654] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.177320 4557 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.177352 4557 ts_tablet_manager.cc:1397] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.177469 4557 raft_consensus.cc:357] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.177512 4557 raft_consensus.cc:383] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.177527 4557 raft_consensus.cc:738] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.177551 4557 consensus_queue.cc:260] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.177616 4557 ts_tablet_manager.cc:1428] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.177664 4557 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.178047 4557 tablet_bootstrap.cc:654] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.178220 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecba5f150eb4d93b500a0ed3b56d97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.179454 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:04.179787 4557 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.179819 4557 ts_tablet_manager.cc:1397] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.179944 4557 raft_consensus.cc:357] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.179983 4557 raft_consensus.cc:383] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.179998 4557 raft_consensus.cc:738] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.180047 4557 consensus_queue.cc:260] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.180136 4557 ts_tablet_manager.cc:1428] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.180126 3215 leader_election.cc:304] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.180188 4557 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.180526 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 46b8efd1622a4efcb009f999cb915dfc
I20250115 10:12:04.180564 4557 tablet_bootstrap.cc:654] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.180581 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.180809 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a18829801a1a425db66f31c40f95401b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.180946 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a18829801a1a425db66f31c40f95401b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.181367 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.181495 4335 raft_consensus.cc:2798] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.181553 4335 raft_consensus.cc:695] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.181600 4335 consensus_queue.cc:237] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.182157 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.183925 4575 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.183966 4575 ts_tablet_manager.cc:1397] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
I20250115 10:12:04.184123 4575 raft_consensus.cc:357] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.184175 4575 raft_consensus.cc:383] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.184187 4575 raft_consensus.cc:738] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.184206 4575 consensus_queue.cc:260] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.184304 4575 ts_tablet_manager.cc:1428] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.184427 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 6827c92eff1547739e4afaf6f5eca5d1 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.186473 4557 tablet_bootstrap.cc:492] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.186515 4557 ts_tablet_manager.cc:1397] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.186630 4557 raft_consensus.cc:357] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.186682 4557 raft_consensus.cc:383] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.186700 4557 raft_consensus.cc:738] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.186731 4557 consensus_queue.cc:260] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.186827 4557 ts_tablet_manager.cc:1428] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.187017 4557 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.187382 3394 tablet_service.cc:1467] Processing CreateTablet for tablet f82d295124504a7d811c628fca65f439 (DEFAULT_TABLE table=default.Table_a18829801a1a425db66f31c40f95401b [id=ca8c1966e6854503b373a6d6b649085f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.187525 4557 tablet_bootstrap.cc:654] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.188012 3246 tablet_service.cc:1467] Processing CreateTablet for tablet f82d295124504a7d811c628fca65f439 (DEFAULT_TABLE table=default.Table_a18829801a1a425db66f31c40f95401b [id=ca8c1966e6854503b373a6d6b649085f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.188112 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82d295124504a7d811c628fca65f439. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.188091 4472 catalog_manager.cc:5526] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.188249 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:04.189844 3530 tablet_service.cc:1467] Processing CreateTablet for tablet f82d295124504a7d811c628fca65f439 (DEFAULT_TABLE table=default.Table_a18829801a1a425db66f31c40f95401b [id=ca8c1966e6854503b373a6d6b649085f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.189958 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82d295124504a7d811c628fca65f439. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.190119 4667 tablet.cc:1721] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.191183 4575 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.191674 4575 tablet_bootstrap.cc:654] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.192049 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f82d295124504a7d811c628fca65f439. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.192404 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:04.192857 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6827c92eff1547739e4afaf6f5eca5d1
W20250115 10:12:04.192912 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:04.192952 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 6827c92eff1547739e4afaf6f5eca5d1 deleted and replaced by tablet 56a50b6076ee414685e3acac6a3da9d6
I20250115 10:12:04.193194 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 56a50b6076ee414685e3acac6a3da9d6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.193503 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]) successfully deleted
W20250115 10:12:04.193540 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 6827c92eff1547739e4afaf6f5eca5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6827c92eff1547739e4afaf6f5eca5d1 already in progress: creating tablet
W20250115 10:12:04.193583 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:04.193621 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 56a50b6076ee414685e3acac6a3da9d6) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.193851 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 6827c92eff1547739e4afaf6f5eca5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6827c92eff1547739e4afaf6f5eca5d1 already in progress: creating tablet
I20250115 10:12:04.193920 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 6827c92eff1547739e4afaf6f5eca5d1 with delete_type TABLET_DATA_DELETED (replaced by tablet 56a50b6076ee414685e3acac6a3da9d6) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.194255 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6827c92eff1547739e4afaf6f5eca5d1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6827c92eff1547739e4afaf6f5eca5d1 already in progress: creating tablet
I20250115 10:12:04.194527 4569 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.194581 4569 ts_tablet_manager.cc:1397] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.001s
I20250115 10:12:04.194758 4569 raft_consensus.cc:357] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.194828 4569 raft_consensus.cc:383] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.194852 4569 raft_consensus.cc:738] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.194892 4569 consensus_queue.cc:260] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.194916 4557 tablet_bootstrap.cc:492] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.194952 4557 ts_tablet_manager.cc:1397] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.194996 4569 ts_tablet_manager.cc:1428] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.195065 4569 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.195367 4338 raft_consensus.cc:491] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.195405 4338 raft_consensus.cc:513] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.195498 4338 leader_election.cc:290] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.195570 4569 tablet_bootstrap.cc:654] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.195701 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07f6f091ee847e49d1c64bee583a7a4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.195991 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07f6f091ee847e49d1c64bee583a7a4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.196079 3280 raft_consensus.cc:2463] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:04.196246 3484 leader_election.cc:343] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.196395 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 56a50b6076ee414685e3acac6a3da9d6 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.196467 3485 leader_election.cc:304] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.196504 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a50b6076ee414685e3acac6a3da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.196659 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 56a50b6076ee414685e3acac6a3da9d6 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.196767 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a50b6076ee414685e3acac6a3da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.196749 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.199400 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 698b856949484ae092d198e64e00634b from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.199987 4575 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.200035 4575 ts_tablet_manager.cc:1397] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:04.200088 4338 raft_consensus.cc:2798] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.200132 4338 raft_consensus.cc:491] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.200165 4338 raft_consensus.cc:3054] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.200158 3350 consensus_peers.cc:487] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.200187 4575 raft_consensus.cc:357] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.200251 4575 raft_consensus.cc:383] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.200275 4575 raft_consensus.cc:738] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.200322 4575 consensus_queue.cc:260] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.200438 4575 ts_tablet_manager.cc:1428] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.200515 4575 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.200852 4338 raft_consensus.cc:513] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.200949 4575 tablet_bootstrap.cc:654] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.200991 4338 leader_election.cc:290] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.201301 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 56a50b6076ee414685e3acac6a3da9d6 (DEFAULT_TABLE table=default.Table_555dca511fe44b2da3678c74932d205c [id=38ab4369abe943d9bcd2c92a48f0b13c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.201304 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 698b856949484ae092d198e64e00634b
I20250115 10:12:04.201392 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 698b856949484ae092d198e64e00634b deleted and replaced by tablet 96625c3a7d59404ca73a29454063b07e
I20250115 10:12:04.201371 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07f6f091ee847e49d1c64bee583a7a4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.201404 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56a50b6076ee414685e3acac6a3da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.201423 3280 raft_consensus.cc:3054] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.201547 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 698b856949484ae092d198e64e00634b with delete_type TABLET_DATA_DELETED (replaced by tablet 96625c3a7d59404ca73a29454063b07e) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.202049 3280 raft_consensus.cc:2463] T d07f6f091ee847e49d1c64bee583a7a4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.195245 4557 raft_consensus.cc:357] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.202179 4557 raft_consensus.cc:383] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.202208 4557 raft_consensus.cc:738] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.202247 4557 consensus_queue.cc:260] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.202853 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 698b856949484ae092d198e64e00634b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 698b856949484ae092d198e64e00634b already in progress: creating tablet
I20250115 10:12:04.203049 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d07f6f091ee847e49d1c64bee583a7a4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.203096 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 698b856949484ae092d198e64e00634b with delete_type TABLET_DATA_DELETED (replaced by tablet 96625c3a7d59404ca73a29454063b07e) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.203066 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 698b856949484ae092d198e64e00634b with delete_type TABLET_DATA_DELETED (replaced by tablet 96625c3a7d59404ca73a29454063b07e) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.203285 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
W20250115 10:12:04.203317 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
W20250115 10:12:04.203418 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 698b856949484ae092d198e64e00634b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 698b856949484ae092d198e64e00634b already in progress: creating tablet
I20250115 10:12:04.203424 4557 ts_tablet_manager.cc:1428] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:04.203491 4557 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.203573 3485 leader_election.cc:304] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.203661 4338 raft_consensus.cc:2798] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.203704 4338 raft_consensus.cc:695] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.203785 4338 consensus_queue.cc:237] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.203979 3484 leader_election.cc:343] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.204241 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 698b856949484ae092d198e64e00634b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 698b856949484ae092d198e64e00634b already in progress: creating tablet
W20250115 10:12:04.204715 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:04.205531 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:04.205590 4472 catalog_manager.cc:5526] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.205823 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 96625c3a7d59404ca73a29454063b07e (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.205950 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96625c3a7d59404ca73a29454063b07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.206151 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 96625c3a7d59404ca73a29454063b07e (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.206243 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96625c3a7d59404ca73a29454063b07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.207013 4557 tablet_bootstrap.cc:654] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.207659 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 96625c3a7d59404ca73a29454063b07e (DEFAULT_TABLE table=default.Table_f9afec8418444e6a9efd2a70f734c330 [id=65f463d53fa84798be316bab6af1ee81]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.207798 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96625c3a7d59404ca73a29454063b07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.209213 4557 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.209254 4557 ts_tablet_manager.cc:1397] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.209379 4557 raft_consensus.cc:357] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.209429 4557 raft_consensus.cc:383] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.209450 4557 raft_consensus.cc:738] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.209486 4557 consensus_queue.cc:260] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.209561 4557 ts_tablet_manager.cc:1428] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.209612 4557 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.210005 4557 tablet_bootstrap.cc:654] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.210294 4434 raft_consensus.cc:491] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.210332 4434 raft_consensus.cc:513] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.210438 4434 leader_election.cc:290] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.210801 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.210973 3485 leader_election.cc:343] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.211074 4477 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7f11f45ebda04d1d934c330ec17ceccf" } new_table_name: "default.Table_db89e915c0324473bf6dfc46c3a3dbe2" modify_external_catalogs: true
I20250115 10:12:04.211124 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1056c5778b5d4cab99ab769e53573c71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.211236 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1056c5778b5d4cab99ab769e53573c71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.211530 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.211601 4575 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.211623 4908 raft_consensus.cc:491] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:04.211647 4575 ts_tablet_manager.cc:1397] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:04.211676 4908 raft_consensus.cc:513] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.211817 4908 leader_election.cc:290] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.211851 4575 raft_consensus.cc:357] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.211925 4575 raft_consensus.cc:383] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.211959 4575 raft_consensus.cc:738] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.211946 4557 tablet_bootstrap.cc:492] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.212003 4557 ts_tablet_manager.cc:1397] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.211992 4575 consensus_queue.cc:260] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.212111 4575 ts_tablet_manager.cc:1428] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.212126 4557 raft_consensus.cc:357] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.212173 4557 raft_consensus.cc:383] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.212189 4557 raft_consensus.cc:738] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.212198 4575 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.212188 3215 leader_election.cc:343] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f889cc1201404c8691bf01256750e244
I20250115 10:12:04.212221 4557 consensus_queue.cc:260] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.212298 4557 ts_tablet_manager.cc:1428] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.212345 4557 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.212774 4575 tablet_bootstrap.cc:654] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.212795 4557 tablet_bootstrap.cc:654] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.213677 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.214078 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3a151d1a3a4f4bd89f2a1fec8a3caf42" } modify_external_catalogs: true
I20250115 10:12:04.214133 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_3a151d1a3a4f4bd89f2a1fec8a3caf42" } modify_external_catalogs: true
I20250115 10:12:04.214300 4557 tablet_bootstrap.cc:492] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.214334 4557 ts_tablet_manager.cc:1397] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.214468 4557 raft_consensus.cc:357] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.214509 4557 raft_consensus.cc:383] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.214522 4557 raft_consensus.cc:738] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.214552 4557 consensus_queue.cc:260] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.214619 4557 ts_tablet_manager.cc:1428] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.214663 4557 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.214978 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f809e15894942839dea32dcab30efa3 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.215044 4557 tablet_bootstrap.cc:654] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.215257 4477 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8decec5964f14766b997192fbf4f7051 consensus state has no leader
W20250115 10:12:04.215260 3214 leader_election.cc:343] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: f889cc1201404c8691bf01256750e244
I20250115 10:12:04.215320 3214 leader_election.cc:304] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.215425 4908 raft_consensus.cc:2743] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250115 10:12:04.216210 3484 leader_election.cc:343] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.216261 3484 leader_election.cc:304] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.216758 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 900475e1e900423c9b9205540f67e5de from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.216774 4884 raft_consensus.cc:2743] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.216924 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 36b19ae7373c4de688ae30eb7e1d9eab
I20250115 10:12:04.217224 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.217218 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.217327 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6f88aa1b8e7647eb981a2782c248902d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.217423 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 36b19ae7373c4de688ae30eb7e1d9eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36b19ae7373c4de688ae30eb7e1d9eab already in progress: creating tablet
W20250115 10:12:04.217514 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 36b19ae7373c4de688ae30eb7e1d9eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36b19ae7373c4de688ae30eb7e1d9eab already in progress: creating tablet
W20250115 10:12:04.217433 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f88aa1b8e7647eb981a2782c248902d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:04.218102 3484 consensus_peers.cc:487] T 3ab77abe34374a6ba6f30bf3a2bd67de P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ab77abe34374a6ba6f30bf3a2bd67de. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:04.218345 4477 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_03d97d69456b4383aad68de38c602d6c" } modify_external_catalogs: true
I20250115 10:12:04.218411 4477 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_03d97d69456b4383aad68de38c602d6c" } modify_external_catalogs: true
I20250115 10:12:04.218489 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 5f809e15894942839dea32dcab30efa3
I20250115 10:12:04.218567 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 5f809e15894942839dea32dcab30efa3 deleted and replaced by tablet 3d12ff2a471c4b639efa9ecefd911820
I20250115 10:12:04.218581 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.218688 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f809e15894942839dea32dcab30efa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12ff2a471c4b639efa9ecefd911820) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.218724 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f809e15894942839dea32dcab30efa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12ff2a471c4b639efa9ecefd911820) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.218868 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f809e15894942839dea32dcab30efa3 with delete_type TABLET_DATA_DELETED (replaced by tablet 3d12ff2a471c4b639efa9ecefd911820) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.219035 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:12:04.219080 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
W20250115 10:12:04.219102 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 5f809e15894942839dea32dcab30efa3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f809e15894942839dea32dcab30efa3 already in progress: creating tablet
W20250115 10:12:04.219187 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 36b19ae7373c4de688ae30eb7e1d9eab because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36b19ae7373c4de688ae30eb7e1d9eab already in progress: creating tablet
I20250115 10:12:04.219105 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a7058d7b7d5f448b81c27f06b321f7ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.219233 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7058d7b7d5f448b81c27f06b321f7ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:04.219332 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 5f809e15894942839dea32dcab30efa3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f809e15894942839dea32dcab30efa3 already in progress: creating tablet
W20250115 10:12:04.219386 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 5f809e15894942839dea32dcab30efa3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f809e15894942839dea32dcab30efa3 already in progress: creating tablet
I20250115 10:12:04.219141 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_db1241909a914ef09235e2ffb1c837ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.219523 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_db1241909a914ef09235e2ffb1c837ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.219729 4557 tablet_bootstrap.cc:492] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.219785 4557 ts_tablet_manager.cc:1397] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.219898 4557 raft_consensus.cc:357] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.219950 4557 raft_consensus.cc:383] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.219969 4557 raft_consensus.cc:738] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.220014 4557 consensus_queue.cc:260] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.220094 4557 ts_tablet_manager.cc:1428] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.220360 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c2adaa84739b46ce89b6276f774c9c01" } modify_external_catalogs: true
I20250115 10:12:04.220427 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c2adaa84739b46ce89b6276f774c9c01" } modify_external_catalogs: true
I20250115 10:12:04.220620 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_0262547e72d84b698d58d7a57f8cccb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.220702 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0262547e72d84b698d58d7a57f8cccb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.220873 4575 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.220914 4575 ts_tablet_manager.cc:1397] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:04.220958 4557 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.221063 4575 raft_consensus.cc:357] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.221127 4575 raft_consensus.cc:383] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.221146 4575 raft_consensus.cc:738] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.221190 4575 consensus_queue.cc:260] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.221282 4470 catalog_manager.cc:5359] Ignoring report from unknown tablet f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:04.221292 4575 ts_tablet_manager.cc:1428] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.221345 4557 tablet_bootstrap.cc:654] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.221369 4575 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.221812 4575 tablet_bootstrap.cc:654] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.222950 4557 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.222993 4557 ts_tablet_manager.cc:1397] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.223243 4557 raft_consensus.cc:357] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.223295 4557 raft_consensus.cc:383] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.223311 4557 raft_consensus.cc:738] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.223294 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 8cc5552447d348e58205a130d74eb808
I20250115 10:12:04.223351 4557 consensus_queue.cc:260] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.223448 4557 ts_tablet_manager.cc:1428] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.223528 4557 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.223590 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc5552447d348e58205a130d74eb808 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.223852 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 8cc5552447d348e58205a130d74eb808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cc5552447d348e58205a130d74eb808 already in progress: creating tablet
I20250115 10:12:04.223923 4557 tablet_bootstrap.cc:654] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.223958 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc5552447d348e58205a130d74eb808 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.224129 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8cc5552447d348e58205a130d74eb808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cc5552447d348e58205a130d74eb808 already in progress: creating tablet
W20250115 10:12:04.224205 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.224436 4569 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.224489 4569 ts_tablet_manager.cc:1397] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250115 10:12:04.224612 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc5552447d348e58205a130d74eb808 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.224645 4569 raft_consensus.cc:357] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.224725 4569 raft_consensus.cc:383] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.224759 4569 raft_consensus.cc:738] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.224798 4569 consensus_queue.cc:260] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.224892 4569 ts_tablet_manager.cc:1428] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.224970 4569 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.225432 4569 tablet_bootstrap.cc:654] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.226014 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 8cc5552447d348e58205a130d74eb808 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8cc5552447d348e58205a130d74eb808 already in progress: creating tablet
I20250115 10:12:04.226028 4569 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.226073 4569 ts_tablet_manager.cc:1397] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.226220 4569 raft_consensus.cc:357] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.226280 4569 raft_consensus.cc:383] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.226297 4569 raft_consensus.cc:738] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.226395 4569 consensus_queue.cc:260] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.226619 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.226804 4569 ts_tablet_manager.cc:1428] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.226886 4569 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.227192 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:04.227254 4569 tablet_bootstrap.cc:654] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.228173 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 900475e1e900423c9b9205540f67e5de
I20250115 10:12:04.228282 4473 catalog_manager.cc:6596] ReplaceTablet: tablet 900475e1e900423c9b9205540f67e5de deleted and replaced by tablet 1aa20c364a35456390841abdc2975001
I20250115 10:12:04.228430 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 900475e1e900423c9b9205540f67e5de with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa20c364a35456390841abdc2975001) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.228521 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 900475e1e900423c9b9205540f67e5de with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa20c364a35456390841abdc2975001) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.228547 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 900475e1e900423c9b9205540f67e5de with delete_type TABLET_DATA_DELETED (replaced by tablet 1aa20c364a35456390841abdc2975001) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.228684 4875 raft_consensus.cc:491] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:04.228740 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 900475e1e900423c9b9205540f67e5de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900475e1e900423c9b9205540f67e5de already in progress: creating tablet
I20250115 10:12:04.228778 4875 raft_consensus.cc:513] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.228825 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 900475e1e900423c9b9205540f67e5de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900475e1e900423c9b9205540f67e5de already in progress: creating tablet
W20250115 10:12:04.228778 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 900475e1e900423c9b9205540f67e5de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 900475e1e900423c9b9205540f67e5de already in progress: creating tablet
I20250115 10:12:04.228919 4875 leader_election.cc:290] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.229082 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.229388 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a6610d76f1e4d62a37a4da9a89c7dfc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.229454 3280 raft_consensus.cc:2388] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.229820 4875 raft_consensus.cc:491] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.229880 4875 raft_consensus.cc:513] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.229992 4875 leader_election.cc:290] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.230244 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d897f17628774187bcd9b716e7dd3717"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.230355 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d897f17628774187bcd9b716e7dd3717 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.230393 4884 consensus_queue.cc:1035] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.231176 3350 leader_election.cc:304] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.231272 4875 raft_consensus.cc:3054] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.231606 3350 leader_election.cc:343] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: f9256780f6e94b7ebd1276df07baf19d
W20250115 10:12:04.232117 3350 leader_election.cc:343] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:04.232173 3350 leader_election.cc:304] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.232244 4575 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.232290 4575 ts_tablet_manager.cc:1397] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:04.232578 4811 consensus_queue.cc:1035] T 1e9c62a11d4744e199765f855fd0840b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.232661 4575 raft_consensus.cc:357] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.232710 4575 raft_consensus.cc:383] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.232730 4575 raft_consensus.cc:738] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.232767 4575 consensus_queue.cc:260] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.232805 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2f58c731b132438cb439ebc2423f3769" } modify_external_catalogs: true
I20250115 10:12:04.232854 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2f58c731b132438cb439ebc2423f3769" } modify_external_catalogs: true
I20250115 10:12:04.232864 4575 ts_tablet_manager.cc:1428] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.232931 4575 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.232766 4811 raft_consensus.cc:2743] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.233421 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:04.233467 4908 raft_consensus.cc:491] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:04.233501 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 4a33ae08b3194c09a7ca5701c13da844 (DEFAULT_TABLE table=default.Table_1056c5778b5d4cab99ab769e53573c71 [id=600a5b9246924bbf908f4ade19aefdfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.233520 4908 raft_consensus.cc:513] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.233603 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a33ae08b3194c09a7ca5701c13da844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.233642 4908 leader_election.cc:290] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.233919 3215 leader_election.cc:343] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70
I20250115 10:12:04.234475 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
W20250115 10:12:04.234984 3214 leader_election.cc:343] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70
I20250115 10:12:04.235039 3214 leader_election.cc:304] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.235078 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:04.235108 3952 raft_consensus.cc:2743] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:04.235446 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 4a33ae08b3194c09a7ca5701c13da844 (DEFAULT_TABLE table=default.Table_1056c5778b5d4cab99ab769e53573c71 [id=600a5b9246924bbf908f4ade19aefdfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.235566 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a33ae08b3194c09a7ca5701c13da844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.235805 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 4a33ae08b3194c09a7ca5701c13da844 (DEFAULT_TABLE table=default.Table_1056c5778b5d4cab99ab769e53573c71 [id=600a5b9246924bbf908f4ade19aefdfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.235916 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a33ae08b3194c09a7ca5701c13da844. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.236347 4575 tablet_bootstrap.cc:654] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.237141 4699 consensus_queue.cc:1035] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.238505 4875 raft_consensus.cc:2743] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.238757 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:12:04.239807 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d5490db43ba14c039847a9326a7620c4
I20250115 10:12:04.240173 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet d5490db43ba14c039847a9326a7620c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.240185 4575 tablet_bootstrap.cc:492] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.240250 4575 ts_tablet_manager.cc:1397] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:04.240243 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4a0811cad8454c2e871aad2101224f34
I20250115 10:12:04.240373 4575 raft_consensus.cc:357] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.240433 4575 raft_consensus.cc:383] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.240456 4575 raft_consensus.cc:738] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.240459 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d5490db43ba14c039847a9326a7620c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5490db43ba14c039847a9326a7620c4 already in progress: creating tablet
I20250115 10:12:04.240468 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet d5490db43ba14c039847a9326a7620c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.240484 4575 consensus_queue.cc:260] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.240576 4575 ts_tablet_manager.cc:1428] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.240634 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet d5490db43ba14c039847a9326a7620c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5490db43ba14c039847a9326a7620c4 already in progress: creating tablet
I20250115 10:12:04.240653 4575 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.240826 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a0811cad8454c2e871aad2101224f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.241082 4575 tablet_bootstrap.cc:654] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.241169 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 4a0811cad8454c2e871aad2101224f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a0811cad8454c2e871aad2101224f34 already in progress: creating tablet
I20250115 10:12:04.241377 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a0811cad8454c2e871aad2101224f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.241530 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet d5490db43ba14c039847a9326a7620c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.241601 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a0811cad8454c2e871aad2101224f34 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.241886 4699 raft_consensus.cc:491] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.241928 4699 raft_consensus.cc:513] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.242022 4699 leader_election.cc:290] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.242383 3277 raft_consensus.cc:3054] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.242441 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.242513 3280 raft_consensus.cc:2388] T ae2368e4ae294470995667b87ad701fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.242571 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
W20250115 10:12:04.242995 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 4a0811cad8454c2e871aad2101224f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a0811cad8454c2e871aad2101224f34 already in progress: creating tablet
I20250115 10:12:04.243136 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa20c364a35456390841abdc2975001 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.243162 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12ff2a471c4b639efa9ecefd911820 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.243160 3414 raft_consensus.cc:3054] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.243237 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa20c364a35456390841abdc2975001. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.243257 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 99565f41c65d4b219bdf4bd009fd2eb2 (DEFAULT_TABLE table=default.Table_db1241909a914ef09235e2ffb1c837ee [id=377eaa364af44f3c8395f6ece8d121dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.243350 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f41c65d4b219bdf4bd009fd2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.243676 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 595f8aa14ea643e38fc594e9ae504815 (DEFAULT_TABLE table=default.Table_0262547e72d84b698d58d7a57f8cccb3 [id=953fcb41781d458c9dc0b817626c5a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.243801 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f8aa14ea643e38fc594e9ae504815. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.244349 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d12ff2a471c4b639efa9ecefd911820. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.243136 3241 tablet_service.cc:1467] Processing CreateTablet for tablet ac322279a7e845529e4771aedba8881b (DEFAULT_TABLE table=default.Table_a7058d7b7d5f448b81c27f06b321f7ef [id=44916aefda1a449da5e0b8762ae04ef5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.244460 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac322279a7e845529e4771aedba8881b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.245198 3389 tablet_service.cc:1467] Processing CreateTablet for tablet ac322279a7e845529e4771aedba8881b (DEFAULT_TABLE table=default.Table_a7058d7b7d5f448b81c27f06b321f7ef [id=44916aefda1a449da5e0b8762ae04ef5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245260 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 99565f41c65d4b219bdf4bd009fd2eb2 (DEFAULT_TABLE table=default.Table_db1241909a914ef09235e2ffb1c837ee [id=377eaa364af44f3c8395f6ece8d121dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245296 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac322279a7e845529e4771aedba8881b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.245379 3381 tablet_service.cc:1467] Processing CreateTablet for tablet bdc347f892a64f3e84c4414fce486de6 (DEFAULT_TABLE table=default.Table_6f88aa1b8e7647eb981a2782c248902d [id=29d0940b1937408da3a398d53d155f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245435 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa20c364a35456390841abdc2975001 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245522 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 595f8aa14ea643e38fc594e9ae504815 (DEFAULT_TABLE table=default.Table_0262547e72d84b698d58d7a57f8cccb3 [id=953fcb41781d458c9dc0b817626c5a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245435 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12ff2a471c4b639efa9ecefd911820 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.245563 4338 consensus_queue.cc:1035] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.245471 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc347f892a64f3e84c4414fce486de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.245813 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f8aa14ea643e38fc594e9ae504815. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.246968 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f41c65d4b219bdf4bd009fd2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.247331 3246 tablet_service.cc:1467] Processing CreateTablet for tablet bdc347f892a64f3e84c4414fce486de6 (DEFAULT_TABLE table=default.Table_6f88aa1b8e7647eb981a2782c248902d [id=29d0940b1937408da3a398d53d155f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.247411 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc347f892a64f3e84c4414fce486de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.247439 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d12ff2a471c4b639efa9ecefd911820. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.248471 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa20c364a35456390841abdc2975001. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.248495 4875 raft_consensus.cc:491] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.248543 4875 raft_consensus.cc:513] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.248567 4587 consensus_queue.cc:1035] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.248653 4875 leader_election.cc:290] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.248896 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:04.248916 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.249279 4575 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.249320 4575 ts_tablet_manager.cc:1397] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:04.249293 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 99565f41c65d4b219bdf4bd009fd2eb2 (DEFAULT_TABLE table=default.Table_db1241909a914ef09235e2ffb1c837ee [id=377eaa364af44f3c8395f6ece8d121dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.249399 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99565f41c65d4b219bdf4bd009fd2eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.249439 4575 raft_consensus.cc:357] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.249487 4575 raft_consensus.cc:383] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.249508 4575 raft_consensus.cc:738] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.249536 3513 tablet_service.cc:1467] Processing CreateTablet for tablet ac322279a7e845529e4771aedba8881b (DEFAULT_TABLE table=default.Table_a7058d7b7d5f448b81c27f06b321f7ef [id=44916aefda1a449da5e0b8762ae04ef5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.249548 4575 consensus_queue.cc:260] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.249612 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac322279a7e845529e4771aedba8881b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.249639 4575 ts_tablet_manager.cc:1428] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.249696 4575 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.250068 4575 tablet_bootstrap.cc:654] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.250355 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c23863beb24d27b337fa039d7f04cd" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.250595 3523 tablet_service.cc:1467] Processing CreateTablet for tablet bdc347f892a64f3e84c4414fce486de6 (DEFAULT_TABLE table=default.Table_6f88aa1b8e7647eb981a2782c248902d [id=29d0940b1937408da3a398d53d155f85]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.250648 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 1aa20c364a35456390841abdc2975001 (DEFAULT_TABLE table=default.Table_0556f36b9bc7462fadcbdbd50479b0db [id=5828f1dec57541ffb0b20dbc5b556d6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.250680 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc347f892a64f3e84c4414fce486de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.250734 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae2368e4ae294470995667b87ad701fe" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.251535 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa20c364a35456390841abdc2975001. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.251721 3770 raft_consensus.cc:491] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.251752 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 3d12ff2a471c4b639efa9ecefd911820 (DEFAULT_TABLE table=default.Table_b0d8c56db3114bd89d2d0c1547bcdead [id=dce3559b3a38406f969bf75c5d1f3cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.251770 3770 raft_consensus.cc:513] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.251833 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d12ff2a471c4b639efa9ecefd911820. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.251853 3770 leader_election.cc:290] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.251971 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf859ca6a22947ba80f99872d6dc6600" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.252033 3415 raft_consensus.cc:2463] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:04.252171 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet d5490db43ba14c039847a9326a7620c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5490db43ba14c039847a9326a7620c4 already in progress: creating tablet
W20250115 10:12:04.252229 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 4a0811cad8454c2e871aad2101224f34 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a0811cad8454c2e871aad2101224f34 already in progress: creating tablet
I20250115 10:12:04.252424 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf859ca6a22947ba80f99872d6dc6600" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.252602 3214 leader_election.cc:304] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.252682 3215 leader_election.cc:343] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.252835 3770 raft_consensus.cc:2798] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.252841 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 595f8aa14ea643e38fc594e9ae504815 (DEFAULT_TABLE table=default.Table_0262547e72d84b698d58d7a57f8cccb3 [id=953fcb41781d458c9dc0b817626c5a55]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.252867 3770 raft_consensus.cc:491] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.252889 3770 raft_consensus.cc:3054] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.252924 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f8aa14ea643e38fc594e9ae504815. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.253468 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_76c55fb917ec4bc69b74b6cc68bc6081" } modify_external_catalogs: true
I20250115 10:12:04.253541 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_76c55fb917ec4bc69b74b6cc68bc6081" } modify_external_catalogs: true
I20250115 10:12:04.253563 3770 raft_consensus.cc:513] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.253643 3770 leader_election.cc:290] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.253791 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf859ca6a22947ba80f99872d6dc6600" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.253847 3415 raft_consensus.cc:3054] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.254400 3350 leader_election.cc:304] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.254462 3415 raft_consensus.cc:2463] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.254487 3350 leader_election.cc:304] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.254534 4811 raft_consensus.cc:2743] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.254566 4811 raft_consensus.cc:2743] T ae2368e4ae294470995667b87ad701fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.254877 4338 consensus_queue.cc:1035] T 62aee0b0490e44a3aa820781bc9e4072 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.255127 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 140bf4fc35274f2284c24534d3644695
I20250115 10:12:04.255127 3214 leader_election.cc:304] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.255265 3952 raft_consensus.cc:2798] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.255316 3952 raft_consensus.cc:695] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.255359 3952 consensus_queue.cc:237] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.255396 4569 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.255450 4569 ts_tablet_manager.cc:1397] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.000s
I20250115 10:12:04.255765 4569 raft_consensus.cc:357] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.255843 4569 raft_consensus.cc:383] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.255867 4569 raft_consensus.cc:738] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.255913 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 140bf4fc35274f2284c24534d3644695 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.255937 4569 consensus_queue.cc:260] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.255985 4589 tablet_replica.cc:331] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.256053 4589 raft_consensus.cc:2238] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.256086 4589 raft_consensus.cc:2267] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.256145 4569 ts_tablet_manager.cc:1428] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.256225 4569 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.256494 4589 ts_tablet_manager.cc:1905] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.256691 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 00fa18377f0a479683673c43e6332d43 (DEFAULT_TABLE table=default.Table_d897f17628774187bcd9b716e7dd3717 [id=533c29d2a0ff48038fad3af0964c46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.256798 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa18377f0a479683673c43e6332d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.257701 4557 tablet_bootstrap.cc:492] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.257766 4557 ts_tablet_manager.cc:1397] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.001s
I20250115 10:12:04.257776 4589 ts_tablet_manager.cc:1918] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.257827 4589 log.cc:1198] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/140bf4fc35274f2284c24534d3644695
I20250115 10:12:04.257704 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf859ca6a22947ba80f99872d6dc6600" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.257922 4557 raft_consensus.cc:357] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.257979 4557 raft_consensus.cc:383] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.258001 4557 raft_consensus.cc:738] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.258038 4557 consensus_queue.cc:260] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.258074 4589 ts_tablet_manager.cc:1939] T 140bf4fc35274f2284c24534d3644695 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.258132 4557 ts_tablet_manager.cc:1428] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.258248 4557 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.258062 3215 leader_election.cc:343] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.258644 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 00fa18377f0a479683673c43e6332d43 (DEFAULT_TABLE table=default.Table_d897f17628774187bcd9b716e7dd3717 [id=533c29d2a0ff48038fad3af0964c46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.258692 3387 tablet_service.cc:1514] Processing DeleteTablet for tablet 140bf4fc35274f2284c24534d3644695 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.258810 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa18377f0a479683673c43e6332d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.258823 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 00fa18377f0a479683673c43e6332d43 (DEFAULT_TABLE table=default.Table_d897f17628774187bcd9b716e7dd3717 [id=533c29d2a0ff48038fad3af0964c46e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.258906 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00fa18377f0a479683673c43e6332d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.259421 4575 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.259469 4575 ts_tablet_manager.cc:1397] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:04.259613 4575 raft_consensus.cc:357] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.259661 4575 raft_consensus.cc:383] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.259678 4575 raft_consensus.cc:738] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.259735 4575 consensus_queue.cc:260] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.259832 4575 ts_tablet_manager.cc:1428] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.259966 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 140bf4fc35274f2284c24534d3644695 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.259984 4575 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.260043 4551 tablet_replica.cc:331] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.260102 4551 raft_consensus.cc:2238] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.260169 4551 raft_consensus.cc:2267] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.260339 4575 tablet_bootstrap.cc:654] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.260386 4551 ts_tablet_manager.cc:1905] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.260403 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:04.260471 4875 raft_consensus.cc:491] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.260463 4475 catalog_manager.cc:5526] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.260517 4875 raft_consensus.cc:513] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.260591 4875 leader_election.cc:290] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.260672 4592 tablet_replica.cc:331] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.260725 4592 raft_consensus.cc:2238] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.260757 4592 raft_consensus.cc:2267] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.261073 4592 ts_tablet_manager.cc:1905] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.261438 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 140bf4fc35274f2284c24534d3644695 (table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]) successfully deleted
I20250115 10:12:04.258663 4557 tablet_bootstrap.cc:654] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.261866 4551 ts_tablet_manager.cc:1918] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.261917 4551 log.cc:1198] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/140bf4fc35274f2284c24534d3644695
I20250115 10:12:04.262133 4551 ts_tablet_manager.cc:1939] T 140bf4fc35274f2284c24534d3644695 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.262431 4592 ts_tablet_manager.cc:1918] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.262473 4592 log.cc:1198] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/140bf4fc35274f2284c24534d3644695
I20250115 10:12:04.262715 4592 ts_tablet_manager.cc:1939] T 140bf4fc35274f2284c24534d3644695 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.262866 4569 tablet_bootstrap.cc:654] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.263088 4338 raft_consensus.cc:491] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.263132 4338 raft_consensus.cc:513] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.263227 4338 leader_election.cc:290] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.263240 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 140bf4fc35274f2284c24534d3644695 (table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]) successfully deleted
I20250115 10:12:04.263322 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.263365 3547 raft_consensus.cc:2463] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.263548 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.263590 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.263633 3276 raft_consensus.cc:2463] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.263769 3485 leader_election.cc:343] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.263828 3350 leader_election.cc:304] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.264194 4875 raft_consensus.cc:2798] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.264256 4875 raft_consensus.cc:491] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.264284 4875 raft_consensus.cc:3054] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.264372 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.265027 4875 raft_consensus.cc:513] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.265116 4338 raft_consensus.cc:491] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.265157 4875 leader_election.cc:290] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.265161 4338 raft_consensus.cc:513] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.265261 4338 leader_election.cc:290] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.265374 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.265436 3276 raft_consensus.cc:3054] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.266088 3276 raft_consensus.cc:2463] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.266175 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e2e034ea974448922f2cb0529bd196" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.266232 3350 leader_election.cc:304] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.265378 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e2e034ea974448922f2cb0529bd196" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.266322 3280 raft_consensus.cc:2463] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.266372 4875 raft_consensus.cc:2798] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
W20250115 10:12:04.266376 3484 leader_election.cc:343] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.266449 4875 raft_consensus.cc:695] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.266391 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b6621592191408cb1eeaf69869258a5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.266500 3547 raft_consensus.cc:3054] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.266506 4875 consensus_queue.cc:237] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.267089 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.267114 3547 raft_consensus.cc:2463] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:04.267274 3484 leader_election.cc:343] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.267311 3484 leader_election.cc:304] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.267349 3770 raft_consensus.cc:491] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.267369 4338 raft_consensus.cc:2743] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.267385 3770 raft_consensus.cc:513] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.267437 3485 leader_election.cc:304] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.267481 3770 leader_election.cc:290] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.267573 4338 raft_consensus.cc:2798] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.267602 4338 raft_consensus.cc:491] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.267621 4338 raft_consensus.cc:3054] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.267607 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.267814 3214 leader_election.cc:343] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.268190 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 140bf4fc35274f2284c24534d3644695 (table default.Table_76c55fb917ec4bc69b74b6cc68bc6081 [id=20e6395583c643d396293433933f19bf]) successfully deleted
I20250115 10:12:04.268240 4338 raft_consensus.cc:513] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.268328 4338 leader_election.cc:290] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.268520 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e2e034ea974448922f2cb0529bd196" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.268520 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41e2e034ea974448922f2cb0529bd196" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.268602 3280 raft_consensus.cc:3054] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.268754 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.268812 3547 raft_consensus.cc:2463] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.268915 3215 leader_election.cc:304] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.269007 3770 raft_consensus.cc:2798] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.269049 3770 raft_consensus.cc:491] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.269076 3770 raft_consensus.cc:3054] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.269176 4569 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.269210 4569 ts_tablet_manager.cc:1397] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:04.269263 3280 raft_consensus.cc:2463] T 41e2e034ea974448922f2cb0529bd196 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.269345 4569 raft_consensus.cc:357] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.269393 4569 raft_consensus.cc:383] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.269387 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.269416 4569 raft_consensus.cc:738] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.269493 3484 leader_election.cc:343] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.269486 4569 consensus_queue.cc:260] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.269723 3770 raft_consensus.cc:513] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.269829 3770 leader_election.cc:290] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.270076 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.270152 3547 raft_consensus.cc:3054] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.270474 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.270498 3485 leader_election.cc:304] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.270629 4433 raft_consensus.cc:2798] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.270684 4433 raft_consensus.cc:695] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:12:04.270675 3214 leader_election.cc:343] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.270713 3547 raft_consensus.cc:2463] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.270728 4433 consensus_queue.cc:237] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.270974 3215 leader_election.cc:304] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.271087 4569 ts_tablet_manager.cc:1428] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.271167 4569 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.271240 4575 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.271277 4575 ts_tablet_manager.cc:1397] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:04.271401 3952 raft_consensus.cc:2798] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.271448 3952 raft_consensus.cc:695] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.271482 3952 consensus_queue.cc:237] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.271492 4575 raft_consensus.cc:357] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.271545 4575 raft_consensus.cc:383] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.271564 4575 raft_consensus.cc:738] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.271595 4575 consensus_queue.cc:260] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.271675 4575 ts_tablet_manager.cc:1428] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.271741 4575 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.271771 4475 catalog_manager.cc:5526] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.271893 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
I20250115 10:12:04.272168 4575 tablet_bootstrap.cc:654] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.272294 4569 tablet_bootstrap.cc:654] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.272790 4468 catalog_manager.cc:5526] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.272886 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.273435 4884 consensus_queue.cc:1035] T ae2368e4ae294470995667b87ad701fe P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.274791 4575 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.274838 4575 ts_tablet_manager.cc:1397] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.274995 4575 raft_consensus.cc:357] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.275059 4575 raft_consensus.cc:383] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.275094 4575 raft_consensus.cc:738] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.275141 4575 consensus_queue.cc:260] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.275254 4575 ts_tablet_manager.cc:1428] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.275331 4575 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.275923 4557 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.275972 4557 ts_tablet_manager.cc:1397] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20250115 10:12:04.276012 4575 tablet_bootstrap.cc:654] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.276106 4557 raft_consensus.cc:357] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.276155 4557 raft_consensus.cc:383] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.276171 4557 raft_consensus.cc:738] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.276196 4557 consensus_queue.cc:260] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.276279 4557 ts_tablet_manager.cc:1428] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.276335 4557 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.276504 4569 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.276546 4569 ts_tablet_manager.cc:1397] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.276696 4569 raft_consensus.cc:357] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.276748 4569 raft_consensus.cc:383] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.276773 4569 raft_consensus.cc:738] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.276829 4569 consensus_queue.cc:260] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.276863 4557 tablet_bootstrap.cc:654] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.276924 4569 ts_tablet_manager.cc:1428] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.276975 4569 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.277333 4569 tablet_bootstrap.cc:654] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.277413 4557 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
W20250115 10:12:04.277416 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
W20250115 10:12:04.277464 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.277458 4557 ts_tablet_manager.cc:1397] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.277618 4557 raft_consensus.cc:357] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.277676 4557 raft_consensus.cc:383] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.277714 4557 raft_consensus.cc:738] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.277751 4557 consensus_queue.cc:260] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.277842 4557 ts_tablet_manager.cc:1428] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.277896 4557 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.278450 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
W20250115 10:12:04.279633 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:04.279683 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:04.280642 4335 raft_consensus.cc:491] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.280684 4335 raft_consensus.cc:513] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.280789 4335 leader_election.cc:290] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.280956 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.281088 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.281147 3547 raft_consensus.cc:2463] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:04.281140 3214 leader_election.cc:343] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.281271 3215 leader_election.cc:304] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:04.281409 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:04.281487 4335 raft_consensus.cc:2798] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.281515 4335 raft_consensus.cc:491] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.281503 4557 tablet_bootstrap.cc:654] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.281533 4335 raft_consensus.cc:3054] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.281641 4569 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.281684 4569 ts_tablet_manager.cc:1397] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.281863 4569 raft_consensus.cc:357] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.281909 4569 raft_consensus.cc:383] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.281924 4569 raft_consensus.cc:738] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.281960 4569 consensus_queue.cc:260] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.282059 4569 ts_tablet_manager.cc:1428] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.282106 4569 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.282137 4335 raft_consensus.cc:513] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.282285 4335 leader_election.cc:290] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.282500 4569 tablet_bootstrap.cc:654] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.282536 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:04.282980 3214 leader_election.cc:343] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.283180 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.283248 3547 raft_consensus.cc:3054] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.283943 3547 raft_consensus.cc:2463] T 6d8e47c05a4b46d9a032852ad67b29ae P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.284163 4335 raft_consensus.cc:491] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.284169 3215 leader_election.cc:304] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.284219 4335 raft_consensus.cc:513] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.284264 4569 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.284283 3952 raft_consensus.cc:2798] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.284298 4569 ts_tablet_manager.cc:1397] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.284309 4335 leader_election.cc:290] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.284323 3952 raft_consensus.cc:695] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.284365 3952 consensus_queue.cc:237] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.284415 4569 raft_consensus.cc:357] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.284473 4569 raft_consensus.cc:383] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.284493 4569 raft_consensus.cc:738] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.284518 4569 consensus_queue.cc:260] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.284528 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc423aad4e7a49eaacb21c73d5d8c341" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.284642 4569 ts_tablet_manager.cc:1428] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.284657 3214 leader_election.cc:343] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.284699 4569 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.285027 4569 tablet_bootstrap.cc:654] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.285494 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc423aad4e7a49eaacb21c73d5d8c341" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.285576 3547 raft_consensus.cc:2463] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.285712 3215 leader_election.cc:304] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.285707 4475 catalog_manager.cc:5526] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.285785 3952 raft_consensus.cc:2798] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.285822 3952 raft_consensus.cc:491] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.285849 3952 raft_consensus.cc:3054] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.286548 3952 raft_consensus.cc:513] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.286674 3952 leader_election.cc:290] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.286871 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc423aad4e7a49eaacb21c73d5d8c341" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.286893 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc423aad4e7a49eaacb21c73d5d8c341" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.286936 3547 raft_consensus.cc:3054] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.287161 3214 leader_election.cc:343] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.287551 3547 raft_consensus.cc:2463] T fc423aad4e7a49eaacb21c73d5d8c341 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.287698 3215 leader_election.cc:304] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.287791 3952 raft_consensus.cc:2798] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.287817 4569 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.287840 3952 raft_consensus.cc:695] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.287853 4569 ts_tablet_manager.cc:1397] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.287880 3952 consensus_queue.cc:237] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.288012 4569 raft_consensus.cc:357] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.288071 4569 raft_consensus.cc:383] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.288096 4569 raft_consensus.cc:738] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.288154 4569 consensus_queue.cc:260] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.288317 4569 ts_tablet_manager.cc:1428] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.288385 4569 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.288511 3770 consensus_queue.cc:1035] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.289000 4569 tablet_bootstrap.cc:654] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.289199 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.291999 4569 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.292049 4569 ts_tablet_manager.cc:1397] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:04.292160 4569 raft_consensus.cc:357] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.292222 4569 raft_consensus.cc:383] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.292241 4569 raft_consensus.cc:738] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.292285 4569 consensus_queue.cc:260] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.292322 4575 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.292371 4569 ts_tablet_manager.cc:1428] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.292374 4575 ts_tablet_manager.cc:1397] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250115 10:12:04.292434 4569 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.292563 4557 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.292526 4575 raft_consensus.cc:357] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.292594 4575 raft_consensus.cc:383] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.292608 4557 ts_tablet_manager.cc:1397] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s
I20250115 10:12:04.292618 4575 raft_consensus.cc:738] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.292670 4575 consensus_queue.cc:260] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.292717 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 10965ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:04.292776 4575 ts_tablet_manager.cc:1428] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.292735 4557 raft_consensus.cc:357] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.292804 4557 raft_consensus.cc:383] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.292826 4557 raft_consensus.cc:738] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.292831 4575 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.292866 4557 consensus_queue.cc:260] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.292950 4557 ts_tablet_manager.cc:1428] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.293023 4557 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.293233 4575 tablet_bootstrap.cc:654] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.293370 4557 tablet_bootstrap.cc:654] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.294963 3547 raft_consensus.cc:3054] T f0d6e064ac3645a0a855d97262f6e9ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.295346 4569 tablet_bootstrap.cc:654] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.295820 4569 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.295886 4569 ts_tablet_manager.cc:1397] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.295897 4884 consensus_queue.cc:1035] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.295979 4699 raft_consensus.cc:491] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.296028 4699 raft_consensus.cc:513] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.296126 4699 leader_election.cc:290] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.296336 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.296576 4569 raft_consensus.cc:357] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.296679 4557 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.296634 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cd70765e54417fbf6234fe59480518" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.296638 4569 raft_consensus.cc:383] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.296718 4557 ts_tablet_manager.cc:1397] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:04.296742 3277 raft_consensus.cc:2388] T 77cd70765e54417fbf6234fe59480518 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.296757 4569 raft_consensus.cc:738] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.296808 4569 consensus_queue.cc:260] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.296909 4569 ts_tablet_manager.cc:1428] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.296887 4557 raft_consensus.cc:357] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.296933 3350 leader_election.cc:304] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.296952 4557 raft_consensus.cc:383] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.296959 4569 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.296973 4557 raft_consensus.cc:738] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.297016 4699 raft_consensus.cc:3054] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.297019 4557 consensus_queue.cc:260] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.297129 4557 ts_tablet_manager.cc:1428] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.297202 4557 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.297326 4569 tablet_bootstrap.cc:654] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.297772 4557 tablet_bootstrap.cc:654] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.297802 4699 raft_consensus.cc:2743] T 77cd70765e54417fbf6234fe59480518 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.298712 4338 consensus_queue.cc:1035] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.298790 4335 consensus_queue.cc:1035] T f0d6e064ac3645a0a855d97262f6e9ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.298815 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_01cee5e7893944e280e7f3faa9b07f1c [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 2 got 0
I20250115 10:12:04.298924 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d90a16759f704e54a0e7cdef7960d41a" } new_table_name: "default.Table_d7ff7de245ff4122a4c8a8f56b54b796" modify_external_catalogs: true
I20250115 10:12:04.299232 4575 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.299281 4575 ts_tablet_manager.cc:1397] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.299410 4575 raft_consensus.cc:357] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.299461 4575 raft_consensus.cc:383] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.299480 4575 raft_consensus.cc:738] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.299520 4575 consensus_queue.cc:260] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.299566 3414 raft_consensus.cc:3054] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.299608 4575 ts_tablet_manager.cc:1428] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.299847 4575 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.300256 4575 tablet_bootstrap.cc:654] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.301040 4667 tablet.cc:1721] T 8a485231d2de4fab8b86b4900976c76c P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.301484 4569 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.301527 4569 ts_tablet_manager.cc:1397] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.301677 4569 raft_consensus.cc:357] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.301731 4569 raft_consensus.cc:383] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.301771 4569 raft_consensus.cc:738] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.301805 4569 consensus_queue.cc:260] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.301854 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_01cee5e7893944e280e7f3faa9b07f1c [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 2 got 0
I20250115 10:12:04.301909 4569 ts_tablet_manager.cc:1428] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.301956 4569 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.301949 4714 raft_consensus.cc:491] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.302003 4714 raft_consensus.cc:513] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.302093 4714 leader_election.cc:290] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.302066 4338 consensus_queue.cc:1035] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.302361 3547 raft_consensus.cc:1270] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.302372 4569 tablet_bootstrap.cc:654] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.302524 3546 raft_consensus.cc:1270] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.302695 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d841537abc2437c826e069cc0725ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.302757 3549 raft_consensus.cc:2463] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.302850 3350 leader_election.cc:304] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.303087 4587 consensus_queue.cc:1035] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.303131 4569 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.303164 4569 ts_tablet_manager.cc:1397] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.303200 4587 consensus_queue.cc:1035] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.303296 4587 raft_consensus.cc:2798] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.303285 4569 raft_consensus.cc:357] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.303331 4569 raft_consensus.cc:383] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.303334 4587 raft_consensus.cc:491] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.303351 4569 raft_consensus.cc:738] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.303361 4587 raft_consensus.cc:3054] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.303397 4569 consensus_queue.cc:260] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.303519 4569 ts_tablet_manager.cc:1428] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.303576 4569 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.304086 4587 raft_consensus.cc:513] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.304163 3280 raft_consensus.cc:1270] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.304230 4587 leader_election.cc:290] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.304262 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d841537abc2437c826e069cc0725ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.304307 3276 raft_consensus.cc:2463] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.304383 3277 raft_consensus.cc:1270] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.304447 4569 tablet_bootstrap.cc:654] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.304454 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 1 got 0
I20250115 10:12:04.305258 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5d0b60522b15489d9726af73a7bd1ee5 (table default.Table_d7ff7de245ff4122a4c8a8f56b54b796 [id=33c05baa94c64e3d8139905db7e98f85]). Expected version 1 got 0
I20250115 10:12:04.305635 4569 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.305678 4569 ts_tablet_manager.cc:1397] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.305805 4569 raft_consensus.cc:357] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.305853 4569 raft_consensus.cc:383] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.305871 4569 raft_consensus.cc:738] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.305895 4569 consensus_queue.cc:260] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.305905 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_5ae39ce8f73041e286b44226d541e7e6 [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 4 got 0
I20250115 10:12:04.305982 4569 ts_tablet_manager.cc:1428] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.306049 4569 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.306150 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
I20250115 10:12:04.306433 4569 tablet_bootstrap.cc:654] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.306442 4714 consensus_queue.cc:1035] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.306531 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:04.306552 4714 consensus_queue.cc:1035] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.306591 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.306643 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d841537abc2437c826e069cc0725ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.306699 3546 raft_consensus.cc:3054] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.307247 4569 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.307286 4569 ts_tablet_manager.cc:1397] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.307430 3546 raft_consensus.cc:2463] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.307497 4569 raft_consensus.cc:357] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.307516 4890 tablet.cc:1721] T 6b6621592191408cb1eeaf69869258a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.307559 4569 raft_consensus.cc:383] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.307585 4569 raft_consensus.cc:738] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.307626 4569 consensus_queue.cc:260] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.307715 4569 ts_tablet_manager.cc:1428] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.308007 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
I20250115 10:12:04.308630 4569 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.309052 4569 tablet_bootstrap.cc:654] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.309414 4557 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.309461 4557 ts_tablet_manager.cc:1397] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:04.309489 4575 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.309532 4575 ts_tablet_manager.cc:1397] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:04.309581 4557 raft_consensus.cc:357] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.309628 4557 raft_consensus.cc:383] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.309643 4557 raft_consensus.cc:738] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.309679 4557 consensus_queue.cc:260] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.309677 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d841537abc2437c826e069cc0725ad1" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.309672 4575 raft_consensus.cc:357] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.309732 3277 raft_consensus.cc:3054] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.309728 4575 raft_consensus.cc:383] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.309763 4575 raft_consensus.cc:738] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.309772 4557 ts_tablet_manager.cc:1428] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.309842 4557 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.309811 4575 consensus_queue.cc:260] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.309940 4575 ts_tablet_manager.cc:1428] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.309995 4575 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.310189 4557 tablet_bootstrap.cc:654] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.310377 4575 tablet_bootstrap.cc:654] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.310444 3277 raft_consensus.cc:2463] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.310593 3350 leader_election.cc:304] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.310849 4569 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.310885 4569 ts_tablet_manager.cc:1397] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.310930 4877 raft_consensus.cc:2798] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.310989 4877 raft_consensus.cc:695] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.310994 4569 raft_consensus.cc:357] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.311043 4569 raft_consensus.cc:383] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.311059 4569 raft_consensus.cc:738] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.311031 4877 consensus_queue.cc:237] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.311092 4569 consensus_queue.cc:260] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.311167 4569 ts_tablet_manager.cc:1428] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.311214 4569 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.311528 4569 tablet_bootstrap.cc:654] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.312179 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]). Expected version 1 got 0
I20250115 10:12:04.312230 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5d0b60522b15489d9726af73a7bd1ee5 (table default.Table_d7ff7de245ff4122a4c8a8f56b54b796 [id=33c05baa94c64e3d8139905db7e98f85]). Expected version 1 got 0
I20250115 10:12:04.312258 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6b6621592191408cb1eeaf69869258a5 (table default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977]). Expected version 1 got 0
I20250115 10:12:04.312718 4472 catalog_manager.cc:5526] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.312810 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.312952 4433 raft_consensus.cc:491] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.313006 4433 raft_consensus.cc:513] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.313088 4433 leader_election.cc:290] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.313289 4662 tablet.cc:1721] T 6b6621592191408cb1eeaf69869258a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.313383 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.313546 4569 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.313587 4569 ts_tablet_manager.cc:1397] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.313709 4909 mvcc.cc:204] Tried to move back new op lower bound from 7114489545936560128 to 7114489545796116480. Current Snapshot: MvccSnapshot[applied={T|T < 7114489545936560128}]
I20250115 10:12:04.313712 4569 raft_consensus.cc:357] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.313956 4569 raft_consensus.cc:383] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.313977 4569 raft_consensus.cc:738] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.314019 4569 consensus_queue.cc:260] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.314110 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcd888d924fd43b590710613560f16d5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.314116 4569 ts_tablet_manager.cc:1428] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.314313 4569 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.314688 4569 tablet_bootstrap.cc:654] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.314728 3485 leader_election.cc:304] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.314870 4887 raft_consensus.cc:2743] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.314924 4887 raft_consensus.cc:491] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.314953 4887 raft_consensus.cc:513] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.315061 4887 leader_election.cc:290] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.315486 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_e02abcc959ee4e66938eeb713ab5738c [id=4fdef59a83b241a785c3ed32b8eeb977] alter complete (version 1)
W20250115 10:12:04.315822 3484 leader_election.cc:343] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:04.315879 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_8166964273cd466883c47516ef68ef46 [id=988e12ca3c094601a1189d8558614dae]). Expected version 1 got 0
I20250115 10:12:04.316654 4667 tablet.cc:1721] T 5d0b60522b15489d9726af73a7bd1ee5 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.316748 4569 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.316787 4569 ts_tablet_manager.cc:1397] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.316946 4569 raft_consensus.cc:357] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.317011 4569 raft_consensus.cc:383] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.317030 4569 raft_consensus.cc:738] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.317065 4663 tablet.cc:1721] T 5d0b60522b15489d9726af73a7bd1ee5 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.317067 4569 consensus_queue.cc:260] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.317164 4569 ts_tablet_manager.cc:1428] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.317189 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:04.317226 4569 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.317303 4557 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.317358 4557 ts_tablet_manager.cc:1397] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:04.317520 4557 raft_consensus.cc:357] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.317584 4557 raft_consensus.cc:383] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.317602 4569 tablet_bootstrap.cc:654] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.317608 4557 raft_consensus.cc:738] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.317672 4557 consensus_queue.cc:260] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.317791 4557 ts_tablet_manager.cc:1428] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.317862 4557 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.318295 4557 tablet_bootstrap.cc:654] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.318792 4557 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.318836 4557 ts_tablet_manager.cc:1397] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.318858 4569 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
W20250115 10:12:04.318858 3485 leader_election.cc:343] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:04.318890 4569 ts_tablet_manager.cc:1397] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.318902 3485 leader_election.cc:304] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.319041 4569 raft_consensus.cc:357] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.319088 4569 raft_consensus.cc:383] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.319060 4557 raft_consensus.cc:357] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.319108 4569 raft_consensus.cc:738] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.319109 4557 raft_consensus.cc:383] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.319129 4557 raft_consensus.cc:738] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.319146 4569 consensus_queue.cc:260] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.319162 4557 consensus_queue.cc:260] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.319229 4569 ts_tablet_manager.cc:1428] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.319244 4557 ts_tablet_manager.cc:1428] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.319278 4569 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.319290 4557 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.319660 4569 tablet_bootstrap.cc:654] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.319660 4557 tablet_bootstrap.cc:654] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.320151 4887 raft_consensus.cc:2743] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.320222 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:04.320456 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.320528 4589 tablet_replica.cc:331] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.320603 4589 raft_consensus.cc:2238] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.320640 4589 raft_consensus.cc:2267] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.320748 4575 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.320806 4575 ts_tablet_manager.cc:1397] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:04.320901 4589 ts_tablet_manager.cc:1905] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.321682 4662 tablet.cc:1721] T 5d0b60522b15489d9726af73a7bd1ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.322245 4589 ts_tablet_manager.cc:1918] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.322291 4589 log.cc:1198] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/36b19ae7373c4de688ae30eb7e1d9eab
W20250115 10:12:04.322322 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:04.322331 4575 raft_consensus.cc:357] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.322407 4575 raft_consensus.cc:383] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.322429 4575 raft_consensus.cc:738] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.322439 4589 ts_tablet_manager.cc:1939] T 36b19ae7373c4de688ae30eb7e1d9eab P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.322467 4575 consensus_queue.cc:260] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.322502 4434 consensus_queue.cc:1035] T 77cd70765e54417fbf6234fe59480518 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.322559 4575 ts_tablet_manager.cc:1428] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.322640 4575 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.323108 4575 tablet_bootstrap.cc:654] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.324216 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_d7ff7de245ff4122a4c8a8f56b54b796 [id=33c05baa94c64e3d8139905db7e98f85] alter complete (version 1)
I20250115 10:12:04.324824 4908 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:04.324848 4557 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.324888 4557 ts_tablet_manager.cc:1397] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.324908 4569 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.324949 4569 ts_tablet_manager.cc:1397] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.325029 4557 raft_consensus.cc:357] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.325083 4557 raft_consensus.cc:383] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.325101 4557 raft_consensus.cc:738] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.325078 4569 raft_consensus.cc:357] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.325124 4569 raft_consensus.cc:383] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.325143 4569 raft_consensus.cc:738] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.325126 4557 consensus_queue.cc:260] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.325168 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 575f1a39f8a54c4cb21cd17d562c0542 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.325253 4557 ts_tablet_manager.cc:1428] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.325279 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 36b19ae7373c4de688ae30eb7e1d9eab (table default.Table_3a151d1a3a4f4bd89f2a1fec8a3caf42 [id=ee5989ff607243e38ee167a4d318eaaf]) successfully deleted
I20250115 10:12:04.325289 4551 tablet_replica.cc:331] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.325306 4557 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.325356 4551 raft_consensus.cc:2238] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.325392 4551 raft_consensus.cc:2267] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.325578 4551 ts_tablet_manager.cc:1905] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.324877 4908 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.325707 4557 tablet_bootstrap.cc:654] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.325793 4908 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.325825 4663 tablet.cc:1721] T 6b6621592191408cb1eeaf69869258a5 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.325907 4569 consensus_queue.cc:260] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.326033 4569 ts_tablet_manager.cc:1428] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.326094 4569 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.326961 4569 tablet_bootstrap.cc:654] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.327117 4551 ts_tablet_manager.cc:1918] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20250115 10:12:04.327138 3214 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:12:04.327188 4551 log.cc:1198] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/575f1a39f8a54c4cb21cd17d562c0542
I20250115 10:12:04.327369 4551 ts_tablet_manager.cc:1939] T 575f1a39f8a54c4cb21cd17d562c0542 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:04.327427 3215 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:12:04.327468 3215 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.327530 4908 raft_consensus.cc:2743] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250115 10:12:04.327526 3546 raft_consensus.cc:3054] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.328168 4569 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.328241 4569 ts_tablet_manager.cc:1397] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.328440 4908 consensus_queue.cc:1035] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.328397 4569 raft_consensus.cc:357] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.328570 4569 raft_consensus.cc:383] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.328612 4569 raft_consensus.cc:738] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.328677 4569 consensus_queue.cc:260] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.328820 4569 ts_tablet_manager.cc:1428] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.328893 4569 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.329344 4569 tablet_bootstrap.cc:654] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.329370 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]). Expected version 1 got 0
I20250115 10:12:04.329435 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:04.329375 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:04.330703 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]). Expected version 1 got 0
I20250115 10:12:04.330756 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:04.330806 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f448ab1cfae2403393f3884d0a50fd61" } new_table_name: "default.Table_3249ea9ae59247ca976f3c00dc0b4947" modify_external_catalogs: true
I20250115 10:12:04.330899 4575 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.330960 4575 ts_tablet_manager.cc:1397] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:04.331099 4575 raft_consensus.cc:357] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.331158 4575 raft_consensus.cc:383] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.331178 4575 raft_consensus.cc:738] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.331220 4575 consensus_queue.cc:260] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.331302 3770 consensus_queue.cc:1035] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.331331 4575 ts_tablet_manager.cc:1428] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.331421 4575 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.331501 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 616166bc9d5d4651999b1d2e0a1851bb
I20250115 10:12:04.331892 4575 tablet_bootstrap.cc:654] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.332422 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f37b29ba1cb4a0289268ba1241527b8 consensus state has no leader
I20250115 10:12:04.333407 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 575f1a39f8a54c4cb21cd17d562c0542 (table default.Table_3230c32afd0b4ef4ac496bafefed3a27 [id=4081902d538c43dd8272e0dfb365da67]) successfully deleted
I20250115 10:12:04.333494 3770 raft_consensus.cc:491] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.333549 3770 raft_consensus.cc:513] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.333657 3770 leader_election.cc:290] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.333673 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f4f0a9b37bc1491398b02d959c345582"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.333812 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4f0a9b37bc1491398b02d959c345582 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.333851 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.333899 4557 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.333904 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_418eac60e5e24190ba7bc18c3975b1de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.333940 4557 ts_tablet_manager.cc:1397] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
W20250115 10:12:04.333978 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_418eac60e5e24190ba7bc18c3975b1de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.334105 4557 raft_consensus.cc:357] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.334164 4557 raft_consensus.cc:383] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.334183 4557 raft_consensus.cc:738] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.334224 4557 consensus_queue.cc:260] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.334278 3214 leader_election.cc:343] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.334319 4557 ts_tablet_manager.cc:1428] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.334336 3770 raft_consensus.cc:491] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.334345 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.334367 3770 raft_consensus.cc:513] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.334383 4557 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.334444 3770 leader_election.cc:290] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.334527 3215 leader_election.cc:343] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.334556 3215 leader_election.cc:304] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.334656 3770 raft_consensus.cc:2743] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.334754 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.334867 4557 tablet_bootstrap.cc:654] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.335065 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:04.335386 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.335476 3415 raft_consensus.cc:2463] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:04.335470 3215 leader_election.cc:343] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.335628 3214 leader_election.cc:304] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.335743 3770 raft_consensus.cc:2798] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.335772 3770 raft_consensus.cc:491] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.335793 3770 raft_consensus.cc:3054] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.335932 4575 tablet_bootstrap.cc:492] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.335979 4575 ts_tablet_manager.cc:1397] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.336160 4575 raft_consensus.cc:357] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.336225 4575 raft_consensus.cc:383] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.336246 4575 raft_consensus.cc:738] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.336288 4575 consensus_queue.cc:260] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.336352 4569 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.336407 4575 ts_tablet_manager.cc:1428] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.336485 4575 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.336618 3770 raft_consensus.cc:513] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.336776 3770 leader_election.cc:290] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.337013 4575 tablet_bootstrap.cc:654] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.336997 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.337260 3215 leader_election.cc:343] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.336419 4569 ts_tablet_manager.cc:1397] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.337656 4569 raft_consensus.cc:357] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.337675 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.337716 4569 raft_consensus.cc:383] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.337738 3415 raft_consensus.cc:3054] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.337735 4569 raft_consensus.cc:738] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.337868 4569 consensus_queue.cc:260] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.337960 4569 ts_tablet_manager.cc:1428] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.338021 4569 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.338419 4569 tablet_bootstrap.cc:654] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.338467 3415 raft_consensus.cc:2463] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.339018 3214 leader_election.cc:304] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.339147 4731 raft_consensus.cc:2798] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.339192 4731 raft_consensus.cc:695] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.339231 4731 consensus_queue.cc:237] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.339440 4731 consensus_queue.cc:1035] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.340921 4569 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.340970 4569 ts_tablet_manager.cc:1397] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.341104 4569 raft_consensus.cc:357] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.341156 4569 raft_consensus.cc:383] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.341173 4569 raft_consensus.cc:738] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.341663 4569 consensus_queue.cc:260] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.341887 4569 ts_tablet_manager.cc:1428] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.342034 4569 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.342219 3517 tablet_service.cc:1467] Processing CreateTablet for tablet f9914b21a4bd476e9d5761652d0c1782 (DEFAULT_TABLE table=default.Table_418eac60e5e24190ba7bc18c3975b1de [id=007d1ea9dc0a4acb9bdf94ffef49e9d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.342257 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 2673915140824b308a1a4cce34d0fdac (DEFAULT_TABLE table=default.Table_f4f0a9b37bc1491398b02d959c345582 [id=dcd6d1252f444a01a638bf5a1e457efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.342337 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9914b21a4bd476e9d5761652d0c1782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.342264 3246 tablet_service.cc:1467] Processing CreateTablet for tablet f9914b21a4bd476e9d5761652d0c1782 (DEFAULT_TABLE table=default.Table_418eac60e5e24190ba7bc18c3975b1de [id=007d1ea9dc0a4acb9bdf94ffef49e9d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.342372 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673915140824b308a1a4cce34d0fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.342444 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9914b21a4bd476e9d5761652d0c1782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.342692 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:04.343277 4557 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.343318 4557 ts_tablet_manager.cc:1397] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:04.343462 4557 raft_consensus.cc:357] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.343513 4557 raft_consensus.cc:383] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.343537 4557 raft_consensus.cc:738] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.343590 4557 consensus_queue.cc:260] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.343636 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5b722750808f41ac9670becff65dfcc9" } new_table_name: "default.Table_04e0d5c168bb43f69631a4c3349ea8df" modify_external_catalogs: true
I20250115 10:12:04.343698 4557 ts_tablet_manager.cc:1428] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.343773 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 2673915140824b308a1a4cce34d0fdac (DEFAULT_TABLE table=default.Table_f4f0a9b37bc1491398b02d959c345582 [id=dcd6d1252f444a01a638bf5a1e457efc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.343880 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673915140824b308a1a4cce34d0fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.343776 4557 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.344296 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8093f8487b9844718707e2fcdd3ae833 (table default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea]). Expected version 1 got 0
I20250115 10:12:04.344316 4557 tablet_bootstrap.cc:654] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.344347 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 60cc9a1b2c4348ada0d8dab958aded09 (table default.Table_8efe8747d11e4af0a7df52864f2a926f [id=f93e7218dc4947b5bc778789c1be1480]). Expected version 2 got 0
I20250115 10:12:04.344810 4569 tablet_bootstrap.cc:654] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.345394 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 2673915140824b308a1a4cce34d0fdac (DEFAULT_TABLE table=default.Table_f4f0a9b37bc1491398b02d959c345582 [id=dcd6d1252f444a01a638bf5a1e457efc]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:04.345474 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.345504 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2673915140824b308a1a4cce34d0fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.345395 3386 tablet_service.cc:1467] Processing CreateTablet for tablet f9914b21a4bd476e9d5761652d0c1782 (DEFAULT_TABLE table=default.Table_418eac60e5e24190ba7bc18c3975b1de [id=007d1ea9dc0a4acb9bdf94ffef49e9d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.345822 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9914b21a4bd476e9d5761652d0c1782. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.346737 4472 catalog_manager.cc:5526] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.347210 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5ae39ce8f73041e286b44226d541e7e6" } new_table_name: "default.Table_14fa5aa998ee4f908cae7210960a689f" modify_external_catalogs: true
I20250115 10:12:04.347710 3770 consensus_queue.cc:1035] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.347822 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 367694b5edf143ef81e99e348543659a
W20250115 10:12:04.347954 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d31f180a3fc499fbd505c986593a7f5 consensus state has no leader
I20250115 10:12:04.348219 4569 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.348275 4569 ts_tablet_manager.cc:1397] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20250115 10:12:04.348284 4587 consensus_queue.cc:1035] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.350394 4699 consensus_queue.cc:1035] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.351104 3770 raft_consensus.cc:491] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.351152 3770 raft_consensus.cc:513] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.351197 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_92874b870d6846d9aba594f928fb4ba9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.351245 3770 leader_election.cc:290] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.351291 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92874b870d6846d9aba594f928fb4ba9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.351367 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.351421 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 497adb74fac84c1cb438ea6ba4adf211 consensus state has no leader
W20250115 10:12:04.351512 3214 leader_election.cc:343] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.352247 4569 raft_consensus.cc:357] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.352346 4569 raft_consensus.cc:383] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.352394 4569 raft_consensus.cc:738] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.352613 4569 consensus_queue.cc:260] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.352825 4569 ts_tablet_manager.cc:1428] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:04.352943 4569 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.352984 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.353262 3215 leader_election.cc:343] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.353320 3215 leader_election.cc:304] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.353370 3770 raft_consensus.cc:2743] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.353446 4569 tablet_bootstrap.cc:654] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.353955 4569 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.353993 4569 ts_tablet_manager.cc:1397] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.354107 4569 raft_consensus.cc:357] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.354151 4569 raft_consensus.cc:383] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.354166 4569 raft_consensus.cc:738] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.354159 4575 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.354202 4575 ts_tablet_manager.cc:1397] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250115 10:12:04.354199 4569 consensus_queue.cc:260] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.354282 4569 ts_tablet_manager.cc:1428] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.354344 4569 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.354331 4575 raft_consensus.cc:357] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.354382 4575 raft_consensus.cc:383] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.354399 4575 raft_consensus.cc:738] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.354436 4575 consensus_queue.cc:260] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.354522 4575 ts_tablet_manager.cc:1428] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.354580 4575 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.354717 4569 tablet_bootstrap.cc:654] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.354985 4575 tablet_bootstrap.cc:654] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.355340 4569 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.355389 4569 ts_tablet_manager.cc:1397] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.355607 4569 raft_consensus.cc:357] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.355674 4569 raft_consensus.cc:383] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.355695 4569 raft_consensus.cc:738] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.355767 4569 consensus_queue.cc:260] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.355876 4569 ts_tablet_manager.cc:1428] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.355943 4569 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.356370 4569 tablet_bootstrap.cc:654] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.357010 4557 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.357061 4557 ts_tablet_manager.cc:1397] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:12:04.357091 4575 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.357129 4575 ts_tablet_manager.cc:1397] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.357195 4557 raft_consensus.cc:357] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.357270 4557 raft_consensus.cc:383] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.357290 4557 raft_consensus.cc:738] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.357268 4575 raft_consensus.cc:357] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.357321 4575 raft_consensus.cc:383] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:04.357316 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:04.357352 4575 raft_consensus.cc:738] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.357331 4557 consensus_queue.cc:260] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.357388 4575 consensus_queue.cc:260] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.357432 4557 ts_tablet_manager.cc:1428] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.357473 4575 ts_tablet_manager.cc:1428] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.357499 4557 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.357527 4575 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.357892 4557 tablet_bootstrap.cc:654] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.357929 4575 tablet_bootstrap.cc:654] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.358101 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 710602ce9f814bedbf04771691cd11bf (DEFAULT_TABLE table=default.Table_92874b870d6846d9aba594f928fb4ba9 [id=3b8d7ffa79f347e1b2294d5cbee30638]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.358197 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710602ce9f814bedbf04771691cd11bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.358665 4434 raft_consensus.cc:491] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.358711 4434 raft_consensus.cc:513] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.358826 4434 leader_election.cc:290] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.359141 4434 consensus_queue.cc:1035] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.359325 3484 leader_election.cc:343] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: f6fe9bedd4b74166a4f4c34ec0b87f26
W20250115 10:12:04.359397 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet fd76846bc164480d9b77aa3d096260cb
I20250115 10:12:04.359601 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 710602ce9f814bedbf04771691cd11bf (DEFAULT_TABLE table=default.Table_92874b870d6846d9aba594f928fb4ba9 [id=3b8d7ffa79f347e1b2294d5cbee30638]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.359622 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 710602ce9f814bedbf04771691cd11bf (DEFAULT_TABLE table=default.Table_92874b870d6846d9aba594f928fb4ba9 [id=3b8d7ffa79f347e1b2294d5cbee30638]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.359702 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710602ce9f814bedbf04771691cd11bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.359702 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 710602ce9f814bedbf04771691cd11bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.359969 3485 leader_election.cc:343] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:04.360018 3485 leader_election.cc:304] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.360265 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet fd76846bc164480d9b77aa3d096260cb
I20250115 10:12:04.360754 4557 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.360795 4557 ts_tablet_manager.cc:1397] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.360934 4557 raft_consensus.cc:357] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.360984 4557 raft_consensus.cc:383] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.361002 4557 raft_consensus.cc:738] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.361034 4557 consensus_queue.cc:260] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.361110 4557 ts_tablet_manager.cc:1428] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.361162 4557 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.361513 4434 raft_consensus.cc:2743] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.361557 4557 tablet_bootstrap.cc:654] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.362123 4569 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.362169 4569 ts_tablet_manager.cc:1397] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.362304 4569 raft_consensus.cc:357] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.362368 4569 raft_consensus.cc:383] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.362387 4569 raft_consensus.cc:738] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.362457 4569 consensus_queue.cc:260] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.363199 4569 ts_tablet_manager.cc:1428] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.363298 4557 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.363307 4569 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.363345 4557 ts_tablet_manager.cc:1397] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.363479 4557 raft_consensus.cc:357] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.363551 4557 raft_consensus.cc:383] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.363570 4557 raft_consensus.cc:738] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.363611 4557 consensus_queue.cc:260] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.363699 4557 ts_tablet_manager.cc:1428] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.363970 4557 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.364020 4569 tablet_bootstrap.cc:654] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.364353 4557 tablet_bootstrap.cc:654] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.364765 4569 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.364830 4569 ts_tablet_manager.cc:1397] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.365042 4569 raft_consensus.cc:357] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.365121 4569 raft_consensus.cc:383] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.365175 4569 raft_consensus.cc:738] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.365149 4575 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.365207 4575 ts_tablet_manager.cc:1397] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.365512 4557 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.365556 4557 ts_tablet_manager.cc:1397] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.365489 4575 raft_consensus.cc:357] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.365597 4569 consensus_queue.cc:260] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.365681 4557 raft_consensus.cc:357] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.365741 4557 raft_consensus.cc:383] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.365662 4575 raft_consensus.cc:383] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.365777 4557 raft_consensus.cc:738] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.365795 4575 raft_consensus.cc:738] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.365818 4557 consensus_queue.cc:260] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.365860 4569 ts_tablet_manager.cc:1428] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.365897 4557 ts_tablet_manager.cc:1428] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.365944 4557 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.365945 4569 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.365959 4575 consensus_queue.cc:260] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.366333 4557 tablet_bootstrap.cc:654] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.366503 4575 ts_tablet_manager.cc:1428] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.366648 4575 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.367129 4575 tablet_bootstrap.cc:654] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.367179 4569 tablet_bootstrap.cc:654] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.367717 4557 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.367765 3770 raft_consensus.cc:491] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.367781 4557 ts_tablet_manager.cc:1397] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.367806 3770 raft_consensus.cc:513] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.367910 3770 leader_election.cc:290] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.367916 4557 raft_consensus.cc:357] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.367965 4557 raft_consensus.cc:383] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.367985 4557 raft_consensus.cc:738] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.368019 4557 consensus_queue.cc:260] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.368108 4557 ts_tablet_manager.cc:1428] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.368158 4557 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.368618 4557 tablet_bootstrap.cc:654] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.368876 4569 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.368923 4569 ts_tablet_manager.cc:1397] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.369071 4569 raft_consensus.cc:357] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.369154 4569 raft_consensus.cc:383] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.369186 4557 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.369192 4569 raft_consensus.cc:738] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.369235 4557 ts_tablet_manager.cc:1397] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.369267 4569 consensus_queue.cc:260] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.369381 4569 ts_tablet_manager.cc:1428] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.369390 4557 raft_consensus.cc:357] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.369431 4569 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.369436 4557 raft_consensus.cc:383] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.369453 4557 raft_consensus.cc:738] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.369488 4557 consensus_queue.cc:260] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.369586 4557 ts_tablet_manager.cc:1428] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.369628 4557 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.369686 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.369818 4569 tablet_bootstrap.cc:654] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.370024 3215 leader_election.cc:343] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.370136 4557 tablet_bootstrap.cc:654] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.371098 4557 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.371143 4557 ts_tablet_manager.cc:1397] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.371261 4557 raft_consensus.cc:357] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.371309 4557 raft_consensus.cc:383] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.371330 4557 raft_consensus.cc:738] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.371369 4557 consensus_queue.cc:260] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.371483 4557 ts_tablet_manager.cc:1428] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.371621 4557 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.371933 4569 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.371997 4569 ts_tablet_manager.cc:1397] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.372174 4569 raft_consensus.cc:357] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.372336 4557 tablet_bootstrap.cc:654] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.372556 4569 raft_consensus.cc:383] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.372609 4569 raft_consensus.cc:738] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.372663 4569 consensus_queue.cc:260] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.372774 4569 ts_tablet_manager.cc:1428] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.372857 4569 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.373452 4887 raft_consensus.cc:491] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.373443 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.373497 4887 raft_consensus.cc:513] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.373612 4887 leader_election.cc:290] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.373837 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:04.374069 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6cdec27e9941ed9b485228f93b4d60" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.374208 3484 leader_election.cc:343] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.374320 4575 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.374361 4575 ts_tablet_manager.cc:1397] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.374476 4569 tablet_bootstrap.cc:654] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.374511 4575 raft_consensus.cc:357] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.374557 4575 raft_consensus.cc:383] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.374573 4575 raft_consensus.cc:738] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.374595 4575 consensus_queue.cc:260] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.374684 4575 ts_tablet_manager.cc:1428] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.374730 4575 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.374914 3214 leader_election.cc:343] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.374951 3214 leader_election.cc:304] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.375015 4569 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.375059 4569 ts_tablet_manager.cc:1397] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.375186 4569 raft_consensus.cc:357] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.375243 4569 raft_consensus.cc:383] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.375236 4575 tablet_bootstrap.cc:654] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.375263 4569 raft_consensus.cc:738] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.375305 4569 consensus_queue.cc:260] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.375406 4731 raft_consensus.cc:2743] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.375439 4569 ts_tablet_manager.cc:1428] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.375504 4569 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.375852 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 424956b90563455d8140a49fcaa05206
I20250115 10:12:04.375870 4575 tablet_bootstrap.cc:492] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
W20250115 10:12:04.375897 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 1650bac5bd96467fb3d586b23ebd77be
I20250115 10:12:04.375907 4575 ts_tablet_manager.cc:1397] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.375936 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_e2336efa12724d77804d65cd42e446df [id=a917e062f0334d9ab4cd3ee08ba2ce98]). Expected version 2 got 0
I20250115 10:12:04.376021 4575 raft_consensus.cc:357] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.376097 4569 tablet_bootstrap.cc:654] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.376087 4575 raft_consensus.cc:383] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.376127 4575 raft_consensus.cc:738] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.376157 4575 consensus_queue.cc:260] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.376238 4575 ts_tablet_manager.cc:1428] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.376282 4575 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.376657 4575 tablet_bootstrap.cc:654] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.377044 3770 raft_consensus.cc:491] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.377089 3770 raft_consensus.cc:513] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.377192 3770 leader_election.cc:290] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.377318 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4831e3d84c4d4f08bc5e6fa145a3c1a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.377482 3215 leader_election.cc:343] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.377732 4575 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.377779 4575 ts_tablet_manager.cc:1397] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.377914 4575 raft_consensus.cc:357] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.377964 4575 raft_consensus.cc:383] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.377979 4575 raft_consensus.cc:738] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.378002 4575 consensus_queue.cc:260] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.378108 4575 ts_tablet_manager.cc:1428] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.378154 4575 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.378441 4557 tablet_bootstrap.cc:492] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.378491 4557 ts_tablet_manager.cc:1397] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.378548 4575 tablet_bootstrap.cc:654] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.378767 4557 raft_consensus.cc:357] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.378826 4557 raft_consensus.cc:383] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.378849 4557 raft_consensus.cc:738] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.378890 4557 consensus_queue.cc:260] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.378984 4557 ts_tablet_manager.cc:1428] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.379496 4557 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.379897 4557 tablet_bootstrap.cc:654] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.379946 4575 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.379987 4575 ts_tablet_manager.cc:1397] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.380117 4575 raft_consensus.cc:357] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.380174 4575 raft_consensus.cc:383] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.380194 4575 raft_consensus.cc:738] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.380231 4575 consensus_queue.cc:260] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.380317 4575 ts_tablet_manager.cc:1428] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.380370 4575 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.380371 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec6cdec27e9941ed9b485228f93b4d60" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.380482 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.380748 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_90ef46426add4005851c5eff0f43e3af [id=3078581f1b544badaeded5f2ab32f05e]). Expected version 2 got 0
I20250115 10:12:04.380791 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 2d5da557a18648719980469579c3979f (table default.Table_697427e611684f2b8af110cb304cb29b [id=05a4145d590f48448b42be36cd362a43]). Expected version 3 got 0
I20250115 10:12:04.380831 4575 tablet_bootstrap.cc:654] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.381083 4877 raft_consensus.cc:491] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.381134 4877 raft_consensus.cc:513] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.381239 4877 leader_election.cc:290] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.381300 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4831e3d84c4d4f08bc5e6fa145a3c1a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.381352 3413 raft_consensus.cc:2463] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.381701 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:04.381752 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.381956 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.382095 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.382568 3214 leader_election.cc:304] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.382596 3350 leader_election.cc:343] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.382704 3952 raft_consensus.cc:2798] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.382735 3952 raft_consensus.cc:491] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.382755 3952 raft_consensus.cc:3054] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.383021 4587 raft_consensus.cc:491] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.383091 4587 raft_consensus.cc:513] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.383198 4587 leader_election.cc:290] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.383450 3952 raft_consensus.cc:513] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.383566 3952 leader_election.cc:290] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.383558 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.383807 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4831e3d84c4d4f08bc5e6fa145a3c1a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.383984 3215 leader_election.cc:343] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.384394 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.384464 3276 raft_consensus.cc:2463] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.384476 3350 leader_election.cc:343] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.384536 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.384567 3277 raft_consensus.cc:2463] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.384706 3350 leader_election.cc:304] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.384697 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_31b2efef8cc44cccbf5dac2674a4c2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.384802 3350 leader_election.cc:304] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.384814 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31b2efef8cc44cccbf5dac2674a4c2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:04.384959 3485 leader_election.cc:343] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.385005 3485 leader_election.cc:304] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.385111 4338 raft_consensus.cc:2743] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.385161 4338 consensus_queue.cc:1035] T 7cd6b39cd88247bfa120903465b676b2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.385465 4877 raft_consensus.cc:2798] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.385509 4877 raft_consensus.cc:491] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250115 10:12:04.385509 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:04.385532 4877 raft_consensus.cc:3054] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.385540 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
I20250115 10:12:04.385883 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4831e3d84c4d4f08bc5e6fa145a3c1a5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.385947 3415 raft_consensus.cc:3054] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.386404 4877 raft_consensus.cc:513] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.386509 4569 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.386556 4877 leader_election.cc:290] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.386600 4877 raft_consensus.cc:2798] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.386626 4877 raft_consensus.cc:491] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.386647 4877 raft_consensus.cc:3054] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.386677 3415 raft_consensus.cc:2463] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.386725 4569 ts_tablet_manager.cc:1397] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:04.387172 3214 leader_election.cc:304] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.387241 4569 raft_consensus.cc:357] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.387351 4569 raft_consensus.cc:383] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.387313 4877 raft_consensus.cc:513] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.387373 4569 raft_consensus.cc:738] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.387434 4877 leader_election.cc:290] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.387463 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.387516 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.387598 4569 consensus_queue.cc:260] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.387645 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.387761 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.387835 4338 raft_consensus.cc:491] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.387871 4338 raft_consensus.cc:513] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.387964 4338 leader_election.cc:290] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.387764 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.388590 4575 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.388628 4575 ts_tablet_manager.cc:1397] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:04.388741 4575 raft_consensus.cc:357] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.388799 4575 raft_consensus.cc:383] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.388821 4575 raft_consensus.cc:738] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.388872 4575 consensus_queue.cc:260] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.388955 4575 ts_tablet_manager.cc:1428] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.389003 4575 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.389056 3280 raft_consensus.cc:3054] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.389086 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:04.389348 4575 tablet_bootstrap.cc:654] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.389700 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55439e91f284175a59d35160668fa6c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.390177 3350 leader_election.cc:343] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.390233 3350 leader_election.cc:343] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.391080 3484 leader_election.cc:343] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.391178 3280 raft_consensus.cc:2463] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.391359 4433 raft_consensus.cc:491] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.391398 4433 raft_consensus.cc:513] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.391494 4433 leader_election.cc:290] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.391677 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.391779 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55439e91f284175a59d35160668fa6c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.391839 3279 raft_consensus.cc:2463] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:04.391938 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.392050 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f81769b500149f7b2bf7cdf76f7ee27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.392102 3277 raft_consensus.cc:3054] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.392238 3485 leader_election.cc:304] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.392349 4433 raft_consensus.cc:2798] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.392376 4433 raft_consensus.cc:491] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.392351 3350 leader_election.cc:304] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.392395 4433 raft_consensus.cc:3054] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.392740 3277 raft_consensus.cc:2463] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.392761 4587 raft_consensus.cc:2798] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.392805 4587 raft_consensus.cc:695] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.392869 4587 consensus_queue.cc:237] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.393050 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet cff61c5261f44b12b0da4cd3b6e58ddc from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.393082 4433 raft_consensus.cc:513] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.393179 4433 leader_election.cc:290] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.393182 3350 leader_election.cc:304] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.393543 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55439e91f284175a59d35160668fa6c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.393628 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74a62d026bb94c0fb908b36b38aa0f7f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.393663 3413 raft_consensus.cc:2388] T 74a62d026bb94c0fb908b36b38aa0f7f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:04.393695 4587 raft_consensus.cc:2798] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.393721 4587 raft_consensus.cc:695] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.393750 4587 consensus_queue.cc:237] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.394016 3484 leader_election.cc:343] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.394083 3484 leader_election.cc:304] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.394987 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55439e91f284175a59d35160668fa6c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.395042 3277 raft_consensus.cc:3054] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.395639 3277 raft_consensus.cc:2463] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.395881 3485 leader_election.cc:304] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.395882 4434 raft_consensus.cc:3054] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.396026 4884 raft_consensus.cc:2798] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.396109 4884 raft_consensus.cc:695] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.396154 4884 consensus_queue.cc:237] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.396623 3952 consensus_queue.cc:1035] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.396760 4434 raft_consensus.cc:2743] T 74a62d026bb94c0fb908b36b38aa0f7f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.397513 4338 raft_consensus.cc:491] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.397562 4338 raft_consensus.cc:513] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.397637 4338 leader_election.cc:290] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.397662 4338 consensus_queue.cc:1035] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.397962 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.398103 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.398138 3484 leader_election.cc:343] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.398334 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
W20250115 10:12:04.398626 3485 leader_election.cc:343] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.398667 3485 leader_election.cc:304] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.399284 3386 tablet_service.cc:1467] Processing CreateTablet for tablet d969e18112464753bb51d02357c57bfa (DEFAULT_TABLE table=default.Table_31b2efef8cc44cccbf5dac2674a4c2e3 [id=b1a1d9c293a040518a0b5cd4cf63fe7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.399413 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969e18112464753bb51d02357c57bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.399617 3246 tablet_service.cc:1467] Processing CreateTablet for tablet d969e18112464753bb51d02357c57bfa (DEFAULT_TABLE table=default.Table_31b2efef8cc44cccbf5dac2674a4c2e3 [id=b1a1d9c293a040518a0b5cd4cf63fe7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.399704 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969e18112464753bb51d02357c57bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.399961 3770 consensus_queue.cc:1035] T 74a62d026bb94c0fb908b36b38aa0f7f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.400607 4433 raft_consensus.cc:2743] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.400738 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet cf859ca6a22947ba80f99872d6dc6600 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.400878 4557 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.400916 4557 ts_tablet_manager.cc:1397] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:04.401057 4557 raft_consensus.cc:357] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.401109 4557 raft_consensus.cc:383] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.401130 4557 raft_consensus.cc:738] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.401160 4557 consensus_queue.cc:260] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.401208 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:04.401266 4557 ts_tablet_manager.cc:1428] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.401327 4557 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.401530 4887 raft_consensus.cc:491] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.401573 4887 raft_consensus.cc:513] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.401695 4887 leader_election.cc:290] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.401773 4557 tablet_bootstrap.cc:654] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.401836 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cff61c5261f44b12b0da4cd3b6e58ddc
I20250115 10:12:04.401916 4472 catalog_manager.cc:6596] ReplaceTablet: tablet cff61c5261f44b12b0da4cd3b6e58ddc deleted and replaced by tablet 76796bdbd05c48de93c1b6336568bc2d
I20250115 10:12:04.402247 4587 raft_consensus.cc:491] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.402297 4587 raft_consensus.cc:513] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.402369 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc with delete_type TABLET_DATA_DELETED (replaced by tablet 76796bdbd05c48de93c1b6336568bc2d) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.402392 4587 leader_election.cc:290] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.402434 4589 tablet_replica.cc:331] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.402489 4589 raft_consensus.cc:2238] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.402522 4589 raft_consensus.cc:2267] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.402513 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.402799 4589 ts_tablet_manager.cc:1905] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.402840 3484 leader_election.cc:343] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.403355 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.403425 3280 raft_consensus.cc:2463] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.403410 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.403468 3548 raft_consensus.cc:2463] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.403957 4473 catalog_manager.cc:5526] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.404070 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:04.404178 3528 tablet_service.cc:1467] Processing CreateTablet for tablet d969e18112464753bb51d02357c57bfa (DEFAULT_TABLE table=default.Table_31b2efef8cc44cccbf5dac2674a4c2e3 [id=b1a1d9c293a040518a0b5cd4cf63fe7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.404282 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d969e18112464753bb51d02357c57bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.404579 3350 leader_election.cc:304] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.404661 4587 raft_consensus.cc:2798] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.404696 4587 raft_consensus.cc:491] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.404687 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.404721 4587 raft_consensus.cc:3054] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.405007 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cf859ca6a22947ba80f99872d6dc6600
I20250115 10:12:04.405073 4475 catalog_manager.cc:6596] ReplaceTablet: tablet cf859ca6a22947ba80f99872d6dc6600 deleted and replaced by tablet 22800d4454c94fe6a8a0b163d2f630b1
I20250115 10:12:04.405299 3387 tablet_service.cc:1514] Processing DeleteTablet for tablet cf859ca6a22947ba80f99872d6dc6600 with delete_type TABLET_DATA_DELETED (replaced by tablet 22800d4454c94fe6a8a0b163d2f630b1) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.405431 4587 raft_consensus.cc:513] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.405479 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc with delete_type TABLET_DATA_DELETED (replaced by tablet 76796bdbd05c48de93c1b6336568bc2d) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.405527 4587 leader_election.cc:290] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.405550 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet cff61c5261f44b12b0da4cd3b6e58ddc with delete_type TABLET_DATA_DELETED (replaced by tablet 76796bdbd05c48de93c1b6336568bc2d) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.405587 4592 tablet_replica.cc:331] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.405643 4592 raft_consensus.cc:2238] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.405674 4592 raft_consensus.cc:2267] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.405668 4551 tablet_replica.cc:331] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.405726 4551 raft_consensus.cc:2238] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.405791 4551 raft_consensus.cc:2267] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.405866 4592 ts_tablet_manager.cc:1905] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.405951 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet cf859ca6a22947ba80f99872d6dc6600 with delete_type TABLET_DATA_DELETED (replaced by tablet 22800d4454c94fe6a8a0b163d2f630b1) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.406035 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.406083 3280 raft_consensus.cc:3054] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.406646 3280 raft_consensus.cc:2463] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.406816 3350 leader_election.cc:304] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.407339 4589 ts_tablet_manager.cc:1918] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.407383 4589 log.cc:1198] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/cff61c5261f44b12b0da4cd3b6e58ddc
I20250115 10:12:04.407519 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2e5a7a6cd0a4f09b5a66f1f817c6193" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.407572 4589 ts_tablet_manager.cc:1939] T cff61c5261f44b12b0da4cd3b6e58ddc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.407577 3548 raft_consensus.cc:3054] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.407851 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet cf859ca6a22947ba80f99872d6dc6600 with delete_type TABLET_DATA_DELETED (replaced by tablet 22800d4454c94fe6a8a0b163d2f630b1) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.408254 3548 raft_consensus.cc:2463] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.408392 4551 ts_tablet_manager.cc:1905] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.408406 4811 raft_consensus.cc:2798] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.408469 4811 raft_consensus.cc:695] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.408504 4811 consensus_queue.cc:237] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.410475 4811 raft_consensus.cc:491] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.410521 4811 raft_consensus.cc:513] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.410614 4811 leader_election.cc:290] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.410975 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.411255 3770 raft_consensus.cc:491] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.411301 3770 raft_consensus.cc:513] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.411324 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet cff61c5261f44b12b0da4cd3b6e58ddc (table default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]) successfully deleted
I20250115 10:12:04.411398 3770 leader_election.cc:290] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.388200 4569 ts_tablet_manager.cc:1428] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.388200 4731 raft_consensus.cc:2798] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.411546 4731 raft_consensus.cc:695] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.411556 4569 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.411600 4731 consensus_queue.cc:237] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.412171 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.412165 4473 catalog_manager.cc:5526] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.412249 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:04.412297 4473 catalog_manager.cc:5526] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:04.412467 3485 leader_election.cc:343] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.412524 3485 leader_election.cc:304] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.412609 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 22800d4454c94fe6a8a0b163d2f630b1 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.412696 4433 raft_consensus.cc:2743] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.412724 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 76796bdbd05c48de93c1b6336568bc2d (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.412811 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 7c3e1f44b1794f398f07bf767d54652f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.412859 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 76796bdbd05c48de93c1b6336568bc2d (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.412976 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 22800d4454c94fe6a8a0b163d2f630b1 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.413077 3415 raft_consensus.cc:3054] T b3e3be71c4324a5589a397ae76198f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.413472 4877 raft_consensus.cc:491] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.413465 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.413523 4877 raft_consensus.cc:513] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.413630 4877 leader_election.cc:290] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.412341 3214 leader_election.cc:343] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.412719 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 76796bdbd05c48de93c1b6336568bc2d (DEFAULT_TABLE table=default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.412966 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 22800d4454c94fe6a8a0b163d2f630b1 (DEFAULT_TABLE table=default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:04.413828 3215 leader_election.cc:343] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.413862 3215 leader_election.cc:304] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.413892 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.413920 3770 raft_consensus.cc:2743] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.413947 3548 raft_consensus.cc:2388] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:04.413993 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5185ff7621e742eb81fa8964ec9ff20b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.412997 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4cbd61aec79d479d9eea8d807cd5fb0e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.412130 4569 tablet_bootstrap.cc:654] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.414172 4434 consensus_queue.cc:1035] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.414250 4551 ts_tablet_manager.cc:1918] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.414294 4551 log.cc:1198] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/cff61c5261f44b12b0da4cd3b6e58ddc
I20250115 10:12:04.414342 3350 leader_election.cc:304] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.414366 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22800d4454c94fe6a8a0b163d2f630b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.414419 4877 raft_consensus.cc:2743] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.414505 4551 ts_tablet_manager.cc:1939] T cff61c5261f44b12b0da4cd3b6e58ddc P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.414620 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76796bdbd05c48de93c1b6336568bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.414702 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 7c3e1f44b1794f398f07bf767d54652f
I20250115 10:12:04.414433 3350 leader_election.cc:304] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.414788 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 7c3e1f44b1794f398f07bf767d54652f deleted and replaced by tablet 76ff18e2880341ebbbb5aa8946f4cf35
I20250115 10:12:04.414938 3394 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3e1f44b1794f398f07bf767d54652f with delete_type TABLET_DATA_DELETED (replaced by tablet 76ff18e2880341ebbbb5aa8946f4cf35) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.414991 4468 catalog_manager.cc:5526] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.415074 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.415103 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]). Expected version 1 got 0
I20250115 10:12:04.415203 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3e1f44b1794f398f07bf767d54652f with delete_type TABLET_DATA_DELETED (replaced by tablet 76ff18e2880341ebbbb5aa8946f4cf35) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.415393 4877 raft_consensus.cc:3054] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.416095 4877 raft_consensus.cc:2743] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.416894 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_418eac60e5e24190ba7bc18c3975b1de" } new_table_name: "default.Table_436f2b2c84734e6599e1190169ef9b77" modify_external_catalogs: true
I20250115 10:12:04.417032 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c3e1f44b1794f398f07bf767d54652f with delete_type TABLET_DATA_DELETED (replaced by tablet 76ff18e2880341ebbbb5aa8946f4cf35) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.417517 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_eb69c0c8537540c4bbab9a78ee05a648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.417603 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8d48bd824ad4478492174f65bbb8e5ea" } modify_external_catalogs: true
W20250115 10:12:04.417637 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb69c0c8537540c4bbab9a78ee05a648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.417641 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8d48bd824ad4478492174f65bbb8e5ea" } modify_external_catalogs: true
I20250115 10:12:04.418061 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 76ff18e2880341ebbbb5aa8946f4cf35 (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.418077 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 76ff18e2880341ebbbb5aa8946f4cf35 (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:04.418169 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f9914b21a4bd476e9d5761652d0c1782 consensus state has no leader
I20250115 10:12:04.418164 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 76ff18e2880341ebbbb5aa8946f4cf35 (DEFAULT_TABLE table=default.Table_c2d66bce975b44c4960bef247ac2c745 [id=27d30043981749b9a78ce501241fd6db]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.418242 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ff18e2880341ebbbb5aa8946f4cf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.419518 4434 raft_consensus.cc:491] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.419569 4434 raft_consensus.cc:513] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.419653 4434 leader_election.cc:290] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.419692 4433 raft_consensus.cc:491] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.419765 4433 raft_consensus.cc:513] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.419847 4433 leader_election.cc:290] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.419896 4731 raft_consensus.cc:491] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.419934 4731 raft_consensus.cc:513] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.420025 4731 leader_election.cc:290] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.420176 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.420217 4592 ts_tablet_manager.cc:1918] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.420261 4592 log.cc:1198] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/cf859ca6a22947ba80f99872d6dc6600
I20250115 10:12:04.420272 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.420320 3215 leader_election.cc:343] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.420450 4592 ts_tablet_manager.cc:1939] T cf859ca6a22947ba80f99872d6dc6600 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.420517 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22800d4454c94fe6a8a0b163d2f630b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.420552 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d21906d23acc4ab8b81eceb87ead049f
I20250115 10:12:04.420572 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76796bdbd05c48de93c1b6336568bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.421484 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ff18e2880341ebbbb5aa8946f4cf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.421542 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet d21906d23acc4ab8b81eceb87ead049f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.421748 3377 tablet_service.cc:1467] Processing CreateTablet for tablet d8f5b1cb90c3422e9c144975522e2aec (DEFAULT_TABLE table=default.Table_eb69c0c8537540c4bbab9a78ee05a648 [id=619175e005354fa3a52c738dabcc23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.421805 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d8f5b1cb90c3422e9c144975522e2aec (DEFAULT_TABLE table=default.Table_eb69c0c8537540c4bbab9a78ee05a648 [id=619175e005354fa3a52c738dabcc23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.421840 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f5b1cb90c3422e9c144975522e2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.421900 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f5b1cb90c3422e9c144975522e2aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.422760 3242 tablet_service.cc:1467] Processing CreateTablet for tablet d8f5b1cb90c3422e9c144975522e2aec (DEFAULT_TABLE table=default.Table_eb69c0c8537540c4bbab9a78ee05a648 [id=619175e005354fa3a52c738dabcc23b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.423014 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet d21906d23acc4ab8b81eceb87ead049f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.423146 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet d21906d23acc4ab8b81eceb87ead049f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.423115 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_47d9314439b54b5e8d5f8017f3aaca5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.423213 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47d9314439b54b5e8d5f8017f3aaca5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.423270 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.423347 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.423408 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.423489 3484 leader_election.cc:343] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.423511 3214 leader_election.cc:343] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.423550 3214 leader_election.cc:304] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.423595 3484 leader_election.cc:343] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.423691 4908 raft_consensus.cc:2743] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.423888 3485 leader_election.cc:343] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.423931 3485 leader_election.cc:304] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.424000 4434 raft_consensus.cc:2743] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.424000 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.424207 4551 tablet_replica.cc:331] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:04.424224 3485 leader_election.cc:343] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.424261 3485 leader_election.cc:304] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.424271 4551 raft_consensus.cc:2238] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.424292 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet cff61c5261f44b12b0da4cd3b6e58ddc (table default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]) successfully deleted
I20250115 10:12:04.424327 4551 raft_consensus.cc:2267] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:04.424360 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet cf859ca6a22947ba80f99872d6dc6600 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf859ca6a22947ba80f99872d6dc6600 already in progress: creating tablet
W20250115 10:12:04.424409 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 7c3e1f44b1794f398f07bf767d54652f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3e1f44b1794f398f07bf767d54652f already in progress: creating tablet
I20250115 10:12:04.424536 4434 raft_consensus.cc:2743] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.424863 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_678ef7dde9ff47eb8784ba89b357b3e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.424927 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8c3be9ad849f479dbc770b2d6ec9f237" } modify_external_catalogs: true
I20250115 10:12:04.424962 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8c3be9ad849f479dbc770b2d6ec9f237" } modify_external_catalogs: true
W20250115 10:12:04.424970 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_678ef7dde9ff47eb8784ba89b357b3e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.424880 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_4d2e4487144a4e9bafdd396a1ed16ae0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.425086 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d2e4487144a4e9bafdd396a1ed16ae0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.426017 4592 tablet_replica.cc:331] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.426092 4592 raft_consensus.cc:2238] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.426134 4592 raft_consensus.cc:2267] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.426380 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet cf859ca6a22947ba80f99872d6dc6600 (table default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]) successfully deleted
I20250115 10:12:04.426532 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet dacd2778d9e54877b8ef6d52529c3539
I20250115 10:12:04.426721 3258 tablet_service.cc:1514] Processing DeleteTablet for tablet dacd2778d9e54877b8ef6d52529c3539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.426721 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet dacd2778d9e54877b8ef6d52529c3539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.426745 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet dacd2778d9e54877b8ef6d52529c3539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.427012 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8fde0f2dd6344dc580bd3f78af638d71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.427091 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fde0f2dd6344dc580bd3f78af638d71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.429227 4877 raft_consensus.cc:491] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.429280 4877 raft_consensus.cc:513] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.429368 4877 leader_election.cc:290] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.429512 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6a615c0c5d4815b540d81ef3357eb4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.429570 3548 raft_consensus.cc:2463] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.429625 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6a615c0c5d4815b540d81ef3357eb4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.429672 3280 raft_consensus.cc:2463] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.429780 3350 leader_election.cc:304] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.429872 4877 raft_consensus.cc:2798] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.429904 4877 raft_consensus.cc:491] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.429920 4877 raft_consensus.cc:3054] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.430441 4877 raft_consensus.cc:513] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.430537 4877 leader_election.cc:290] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.430648 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6a615c0c5d4815b540d81ef3357eb4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.430711 3280 raft_consensus.cc:3054] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.411260 4589 tablet_replica.cc:331] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.430809 4589 raft_consensus.cc:2238] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.430861 4589 pending_rounds.cc:62] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:04.430881 4589 pending_rounds.cc:69] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489545747456000 op_type: NO_OP noop_request { }
I20250115 10:12:04.430915 4589 raft_consensus.cc:2883] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:04.430938 4589 raft_consensus.cc:2267] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.431281 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76796bdbd05c48de93c1b6336568bc2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.431416 3280 raft_consensus.cc:2463] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.431541 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6a615c0c5d4815b540d81ef3357eb4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.431589 3548 raft_consensus.cc:3054] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.431607 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 963fb6e6b1724506a3a451b0d5e66ce6 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.431892 4575 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.431934 4575 ts_tablet_manager.cc:1397] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.000s
I20250115 10:12:04.432031 4575 raft_consensus.cc:357] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.432085 4575 raft_consensus.cc:383] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.432101 4575 raft_consensus.cc:738] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.432139 4575 consensus_queue.cc:260] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.432222 4575 ts_tablet_manager.cc:1428] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.432240 3548 raft_consensus.cc:2463] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.432269 4575 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.432675 3350 leader_election.cc:304] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.432739 4575 tablet_bootstrap.cc:654] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.432798 4587 raft_consensus.cc:2798] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.432840 4587 raft_consensus.cc:695] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.432879 4587 consensus_queue.cc:237] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.434317 4434 raft_consensus.cc:491] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.434367 4434 raft_consensus.cc:513] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.434468 4434 leader_election.cc:290] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.434489 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0d0892491e4671a3b1f50259ee9572 (DEFAULT_TABLE table=default.Table_47d9314439b54b5e8d5f8017f3aaca5e [id=ee50cafad26c4b97a31ca9b8d5b21ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.434494 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0d0892491e4671a3b1f50259ee9572 (DEFAULT_TABLE table=default.Table_47d9314439b54b5e8d5f8017f3aaca5e [id=ee50cafad26c4b97a31ca9b8d5b21ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.434712 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22800d4454c94fe6a8a0b163d2f630b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.435186 3280 raft_consensus.cc:1270] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.435297 3770 raft_consensus.cc:491] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.435364 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 5d0d0892491e4671a3b1f50259ee9572 (DEFAULT_TABLE table=default.Table_47d9314439b54b5e8d5f8017f3aaca5e [id=ee50cafad26c4b97a31ca9b8d5b21ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.435341 3770 raft_consensus.cc:513] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.435424 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.435463 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0d0892491e4671a3b1f50259ee9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.435460 3770 leader_election.cc:290] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.435623 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.435808 3215 leader_election.cc:343] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.434721 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.435942 3277 raft_consensus.cc:2463] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.436090 3485 leader_election.cc:304] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.436107 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 963fb6e6b1724506a3a451b0d5e66ce6
I20250115 10:12:04.436175 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 963fb6e6b1724506a3a451b0d5e66ce6 deleted and replaced by tablet 412cd37ccc6e4b15a1d3eba5af3af9e9
I20250115 10:12:04.436195 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0d0892491e4671a3b1f50259ee9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.436168 4433 consensus_queue.cc:1035] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.436266 4433 raft_consensus.cc:2798] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.436295 4433 raft_consensus.cc:491] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.436313 4433 raft_consensus.cc:3054] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.436458 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 with delete_type TABLET_DATA_DELETED (replaced by tablet 412cd37ccc6e4b15a1d3eba5af3af9e9) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.436874 4433 raft_consensus.cc:513] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.436977 4433 leader_election.cc:290] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.437091 4338 raft_consensus.cc:491] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.437122 4338 raft_consensus.cc:513] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.437114 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.437175 3280 raft_consensus.cc:3054] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.437208 4338 leader_election.cc:290] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.437338 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 with delete_type TABLET_DATA_DELETED (replaced by tablet 412cd37ccc6e4b15a1d3eba5af3af9e9) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.437455 3484 leader_election.cc:343] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.437536 3484 consensus_peers.cc:487] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.437549 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.437592 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.437858 3280 raft_consensus.cc:2463] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.438136 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a811ea50fa444ccf88fe4240a7c848ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.438244 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a811ea50fa444ccf88fe4240a7c848ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.438252 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.438433 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 963fb6e6b1724506a3a451b0d5e66ce6 with delete_type TABLET_DATA_DELETED (replaced by tablet 412cd37ccc6e4b15a1d3eba5af3af9e9) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.438513 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.438593 3214 leader_election.cc:343] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.438627 3214 leader_election.cc:304] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.438444 3485 leader_election.cc:304] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.438658 4551 ts_tablet_manager.cc:1905] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.438694 3770 raft_consensus.cc:2743] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.438714 3485 leader_election.cc:343] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.438741 3484 leader_election.cc:343] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.438721 4338 raft_consensus.cc:2798] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.438815 4338 raft_consensus.cc:695] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:12:04.438827 3484 leader_election.cc:343] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.438854 3484 leader_election.cc:304] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.438846 4338 consensus_queue.cc:237] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.438957 4434 raft_consensus.cc:2743] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.440438 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.440676 4472 catalog_manager.cc:5526] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.440778 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.441058 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8f5b1cb90c3422e9c144975522e2aec. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.441277 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:04.441325 4468 catalog_manager.cc:5526] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.441396 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:04.441639 3377 tablet_service.cc:1467] Processing CreateTablet for tablet e21235d57f084015accfee0e31f36918 (DEFAULT_TABLE table=default.Table_678ef7dde9ff47eb8784ba89b357b3e1 [id=c360cd54ca8246758d5db23520fa6831]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.441754 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21235d57f084015accfee0e31f36918. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.441764 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d" } modify_external_catalogs: true
I20250115 10:12:04.441814 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d" } modify_external_catalogs: true
I20250115 10:12:04.441987 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e0f1a11511f24abc9a4d094b016522fe" } modify_external_catalogs: true
I20250115 10:12:04.442049 4699 consensus_queue.cc:1035] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.442090 3528 tablet_service.cc:1467] Processing CreateTablet for tablet e21235d57f084015accfee0e31f36918 (DEFAULT_TABLE table=default.Table_678ef7dde9ff47eb8784ba89b357b3e1 [id=c360cd54ca8246758d5db23520fa6831]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.442175 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21235d57f084015accfee0e31f36918. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.442188 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 16f457ed43fa4fbf8baba0967d327483 (DEFAULT_TABLE table=default.Table_4d2e4487144a4e9bafdd396a1ed16ae0 [id=9de582d058444febbd8d03eebc4bef3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.442283 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f457ed43fa4fbf8baba0967d327483. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.442310 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 16f457ed43fa4fbf8baba0967d327483 (DEFAULT_TABLE table=default.Table_4d2e4487144a4e9bafdd396a1ed16ae0 [id=9de582d058444febbd8d03eebc4bef3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.442389 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f457ed43fa4fbf8baba0967d327483. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.443271 3246 tablet_service.cc:1467] Processing CreateTablet for tablet eccc2e0ea2b147ffaf42e7c8895641b5 (DEFAULT_TABLE table=default.Table_8fde0f2dd6344dc580bd3f78af638d71 [id=1190be5f21cb4237b24f1de3ff918bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.443362 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccc2e0ea2b147ffaf42e7c8895641b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.443616 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 16f457ed43fa4fbf8baba0967d327483 (DEFAULT_TABLE table=default.Table_4d2e4487144a4e9bafdd396a1ed16ae0 [id=9de582d058444febbd8d03eebc4bef3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.443645 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0d0892491e4671a3b1f50259ee9572. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.443746 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f457ed43fa4fbf8baba0967d327483. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.444829 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e0f1a11511f24abc9a4d094b016522fe" } modify_external_catalogs: true
I20250115 10:12:04.445091 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76ff18e2880341ebbbb5aa8946f4cf35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.445492 3517 tablet_service.cc:1467] Processing CreateTablet for tablet eccc2e0ea2b147ffaf42e7c8895641b5 (DEFAULT_TABLE table=default.Table_8fde0f2dd6344dc580bd3f78af638d71 [id=1190be5f21cb4237b24f1de3ff918bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.445590 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccc2e0ea2b147ffaf42e7c8895641b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.446532 4699 raft_consensus.cc:491] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.446578 4699 raft_consensus.cc:513] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.446679 4699 leader_election.cc:290] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.446882 4592 ts_tablet_manager.cc:1905] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.445092 3242 tablet_service.cc:1467] Processing CreateTablet for tablet e21235d57f084015accfee0e31f36918 (DEFAULT_TABLE table=default.Table_678ef7dde9ff47eb8784ba89b357b3e1 [id=c360cd54ca8246758d5db23520fa6831]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.447077 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21235d57f084015accfee0e31f36918. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.447091 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.447145 3276 raft_consensus.cc:2463] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.447826 4589 ts_tablet_manager.cc:1905] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.448467 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4ab498e7789d4ae18a9f62be2fa2514a
I20250115 10:12:04.448624 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9fbcd4787a734c5bba29f8a600abf874
I20250115 10:12:04.448705 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.448836 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.448848 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.448930 4589 ts_tablet_manager.cc:1918] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.448964 4589 log.cc:1198] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/cf859ca6a22947ba80f99872d6dc6600
I20250115 10:12:04.449193 3350 leader_election.cc:304] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.449290 4699 raft_consensus.cc:2798] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.449321 4699 raft_consensus.cc:491] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.449337 4699 raft_consensus.cc:3054] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.449165 4589 ts_tablet_manager.cc:1939] T cf859ca6a22947ba80f99872d6dc6600 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.449599 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.449620 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.449748 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.449780 4589 tablet_replica.cc:331] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.449851 4589 raft_consensus.cc:2238] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.449889 4589 raft_consensus.cc:2267] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:04.449879 3350 leader_election.cc:343] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.449980 4699 raft_consensus.cc:513] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.450083 4699 leader_election.cc:290] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.450214 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.450275 3280 raft_consensus.cc:3054] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.450412 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.450557 4589 ts_tablet_manager.cc:1905] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.450644 3350 consensus_peers.cc:487] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:04.450699 3350 leader_election.cc:343] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.450872 3280 raft_consensus.cc:2463] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.450995 3350 leader_election.cc:304] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.451030 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet cf859ca6a22947ba80f99872d6dc6600 (table default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]) successfully deleted
W20250115 10:12:04.451103 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 7c3e1f44b1794f398f07bf767d54652f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3e1f44b1794f398f07bf767d54652f already in progress: creating tablet
I20250115 10:12:04.451129 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.451153 4714 raft_consensus.cc:2798] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.451189 4714 raft_consensus.cc:695] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.451223 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.451228 4714 consensus_queue.cc:237] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.451666 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.451718 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9 (DEFAULT_TABLE table=default.Table_cc424a5cc8454391917b164fe51eb1f5 [id=a1ca951e2a9c4e77a48bc6d000117c6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.451831 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.452117 3387 tablet_service.cc:1467] Processing CreateTablet for tablet eccc2e0ea2b147ffaf42e7c8895641b5 (DEFAULT_TABLE table=default.Table_8fde0f2dd6344dc580bd3f78af638d71 [id=1190be5f21cb4237b24f1de3ff918bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.452204 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eccc2e0ea2b147ffaf42e7c8895641b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.452291 4908 raft_consensus.cc:491] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.452327 4908 raft_consensus.cc:513] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.452407 4908 leader_election.cc:290] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.452728 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.452996 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.453100 3215 leader_election.cc:343] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.453219 3214 leader_election.cc:343] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.453254 3214 leader_election.cc:304] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.453275 3280 raft_consensus.cc:1270] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.453303 4335 raft_consensus.cc:2743] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.453428 4714 consensus_queue.cc:1035] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.453491 3350 consensus_peers.cc:487] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.454790 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.454849 4472 catalog_manager.cc:5526] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.454932 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.455005 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 423d75ebc8c14463909940ecbc1da4d4 (DEFAULT_TABLE table=default.Table_a811ea50fa444ccf88fe4240a7c848ed [id=4e8a0de0ea884dd2bb3af14bb76fadf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.455235 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 423d75ebc8c14463909940ecbc1da4d4 (DEFAULT_TABLE table=default.Table_a811ea50fa444ccf88fe4240a7c848ed [id=4e8a0de0ea884dd2bb3af14bb76fadf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.455339 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d75ebc8c14463909940ecbc1da4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.455824 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.455864 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 423d75ebc8c14463909940ecbc1da4d4 (DEFAULT_TABLE table=default.Table_a811ea50fa444ccf88fe4240a7c848ed [id=4e8a0de0ea884dd2bb3af14bb76fadf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.455952 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d75ebc8c14463909940ecbc1da4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.456089 4557 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.456125 4557 ts_tablet_manager.cc:1397] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.000s
W20250115 10:12:04.456269 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:04.456272 4557 raft_consensus.cc:357] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.456321 4557 raft_consensus.cc:383] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.456329 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.456339 4557 raft_consensus.cc:738] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.456358 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:04.456377 4557 consensus_queue.cc:260] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.456429 4587 raft_consensus.cc:491] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.456487 4557 ts_tablet_manager.cc:1428] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.456476 4587 raft_consensus.cc:513] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.456547 4557 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.456573 4587 leader_election.cc:290] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.456698 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:12:04.456780 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.456945 3350 leader_election.cc:343] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.456957 4557 tablet_bootstrap.cc:654] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.457599 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4d31f180a3fc499fbd505c986593a7f5 (table default.Table_04e0d5c168bb43f69631a4c3349ea8df [id=270edc3310cd4a09aaa6f46e4f889188]). Expected version 2 got 0
I20250115 10:12:04.457787 4557 tablet_bootstrap.cc:492] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.457824 4557 ts_tablet_manager.cc:1397] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.458012 4557 raft_consensus.cc:357] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.458091 4557 raft_consensus.cc:383] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.458122 4557 raft_consensus.cc:738] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.458184 4557 consensus_queue.cc:260] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.458316 4557 ts_tablet_manager.cc:1428] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.458376 4557 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.458513 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:04.458750 4557 tablet_bootstrap.cc:654] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.458886 3548 raft_consensus.cc:1270] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.459025 4335 raft_consensus.cc:491] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.459105 3276 raft_consensus.cc:1270] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.459071 4335 raft_consensus.cc:513] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.459129 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.459197 4335 leader_election.cc:290] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.459136 4908 raft_consensus.cc:491] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.459277 4908 raft_consensus.cc:513] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.459281 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a" } modify_external_catalogs: true
I20250115 10:12:04.459329 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6e3cd287f35c4be8a8e4cd3ae14d160a" } modify_external_catalogs: true
I20250115 10:12:04.459359 4908 leader_election.cc:290] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.459461 4557 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.459498 4557 ts_tablet_manager.cc:1397] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.459633 4557 raft_consensus.cc:357] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.459690 4557 raft_consensus.cc:383] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.459708 4557 raft_consensus.cc:738] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.459753 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.459806 4908 raft_consensus.cc:491] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.459792 4557 consensus_queue.cc:260] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.459853 4908 raft_consensus.cc:513] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.459896 4557 ts_tablet_manager.cc:1428] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.459957 4908 leader_election.cc:290] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.460032 4587 consensus_queue.cc:1035] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.460079 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.460110 4587 consensus_queue.cc:1035] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.460209 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.460350 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:04.460407 4557 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.460403 4592 ts_tablet_manager.cc:1918] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.460443 4592 log.cc:1198] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/cff61c5261f44b12b0da4cd3b6e58ddc
W20250115 10:12:04.460619 3350 leader_election.cc:343] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.460670 4592 ts_tablet_manager.cc:1939] T cff61c5261f44b12b0da4cd3b6e58ddc P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.460711 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.460837 4557 tablet_bootstrap.cc:654] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.460662 3350 leader_election.cc:304] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.460866 3214 leader_election.cc:343] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.460912 3214 leader_election.cc:343] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.461071 3215 leader_election.cc:343] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.461107 3215 leader_election.cc:304] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.461123 4714 raft_consensus.cc:2743] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.461160 3215 leader_election.cc:343] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.461180 3215 leader_election.cc:304] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.461196 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.461268 4731 raft_consensus.cc:2743] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.461311 4335 raft_consensus.cc:2743] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.461426 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.461448 4551 ts_tablet_manager.cc:1918] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.461548 4551 log.cc:1198] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d21906d23acc4ab8b81eceb87ead049f
W20250115 10:12:04.461580 3215 leader_election.cc:343] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.461751 4551 ts_tablet_manager.cc:1939] T d21906d23acc4ab8b81eceb87ead049f P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:04.461828 3214 leader_election.cc:343] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.461897 3214 leader_election.cc:304] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.461975 4908 raft_consensus.cc:2743] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.461994 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cd37ccc6e4b15a1d3eba5af3af9e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.462021 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.462173 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet cff61c5261f44b12b0da4cd3b6e58ddc (table default.Table_8010a5c5fc7649488137372787886dd5 [id=f7bb0c9dd1da4e2689b83c769af99971]) successfully deleted
I20250115 10:12:04.462255 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423d75ebc8c14463909940ecbc1da4d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.462267 4557 tablet_bootstrap.cc:492] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.462306 4557 ts_tablet_manager.cc:1397] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
W20250115 10:12:04.462424 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 7c3e1f44b1794f398f07bf767d54652f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c3e1f44b1794f398f07bf767d54652f already in progress: creating tablet
I20250115 10:12:04.462443 4557 raft_consensus.cc:357] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.462503 4557 raft_consensus.cc:383] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.462499 4592 tablet_replica.cc:331] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.462525 4557 raft_consensus.cc:738] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.462571 4592 raft_consensus.cc:2238] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.462554 4557 consensus_queue.cc:260] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.462625 4592 raft_consensus.cc:2267] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.462675 4557 ts_tablet_manager.cc:1428] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.462724 4575 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.462751 4557 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.462772 4575 ts_tablet_manager.cc:1397] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.000s
I20250115 10:12:04.462945 4575 raft_consensus.cc:357] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.463001 4575 raft_consensus.cc:383] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.463024 4575 raft_consensus.cc:738] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.463068 4575 consensus_queue.cc:260] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.463160 4575 ts_tablet_manager.cc:1428] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.463233 4575 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.463266 4557 tablet_bootstrap.cc:654] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.463644 4575 tablet_bootstrap.cc:654] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.464231 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]). Expected version 1 got 0
I20250115 10:12:04.464524 4592 ts_tablet_manager.cc:1905] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.465595 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.465772 4569 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.465844 4569 ts_tablet_manager.cc:1397] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.001s
I20250115 10:12:04.465924 5031 mvcc.cc:204] Tried to move back new op lower bound from 7114489546559373312 to 7114489546313449472. Current Snapshot: MvccSnapshot[applied={T|T < 7114489546559373312}]
I20250115 10:12:04.466043 4667 tablet.cc:1721] T 5d841537abc2437c826e069cc0725ad1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.466073 4662 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.466367 4569 raft_consensus.cc:357] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.466585 4589 ts_tablet_manager.cc:1918] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.466625 4589 log.cc:1198] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d21906d23acc4ab8b81eceb87ead049f
I20250115 10:12:04.466475 4569 raft_consensus.cc:383] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.466691 4569 raft_consensus.cc:738] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.466822 4589 ts_tablet_manager.cc:1939] T d21906d23acc4ab8b81eceb87ead049f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.466780 4569 consensus_queue.cc:260] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.467012 4569 ts_tablet_manager.cc:1428] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.467101 4569 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.467140 4890 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.467350 4589 tablet_replica.cc:331] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.467509 4589 raft_consensus.cc:2238] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.467541 4589 raft_consensus.cc:2267] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.467628 4589 ts_tablet_manager.cc:1905] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.467674 4569 tablet_bootstrap.cc:654] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.468323 4592 ts_tablet_manager.cc:1918] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.468366 4592 log.cc:1198] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d21906d23acc4ab8b81eceb87ead049f
I20250115 10:12:04.468559 4592 ts_tablet_manager.cc:1939] T d21906d23acc4ab8b81eceb87ead049f P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.468595 4662 tablet.cc:1721] T 5d841537abc2437c826e069cc0725ad1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.468868 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]) successfully deleted
W20250115 10:12:04.468923 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet dacd2778d9e54877b8ef6d52529c3539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dacd2778d9e54877b8ef6d52529c3539 already in progress: creating tablet
W20250115 10:12:04.468957 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 963fb6e6b1724506a3a451b0d5e66ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 963fb6e6b1724506a3a451b0d5e66ce6 already in progress: creating tablet
W20250115 10:12:04.468982 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 4ab498e7789d4ae18a9f62be2fa2514a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab498e7789d4ae18a9f62be2fa2514a already in progress: creating tablet
W20250115 10:12:04.469022 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 9fbcd4787a734c5bba29f8a600abf874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fbcd4787a734c5bba29f8a600abf874 already in progress: creating tablet
I20250115 10:12:04.469089 4557 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.469126 4557 ts_tablet_manager.cc:1397] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.469274 4557 raft_consensus.cc:357] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.469331 4557 raft_consensus.cc:383] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.469348 4557 raft_consensus.cc:738] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.469383 4557 consensus_queue.cc:260] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.469482 4557 ts_tablet_manager.cc:1428] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.469533 4557 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.469660 4589 ts_tablet_manager.cc:1918] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.469704 4589 log.cc:1198] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/9fbcd4787a734c5bba29f8a600abf874
I20250115 10:12:04.469869 4589 ts_tablet_manager.cc:1939] T 9fbcd4787a734c5bba29f8a600abf874 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.469907 4557 tablet_bootstrap.cc:654] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.470604 4557 tablet_bootstrap.cc:492] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
W20250115 10:12:04.470598 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.470642 4557 ts_tablet_manager.cc:1397] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.470719 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]) successfully deleted
W20250115 10:12:04.470762 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet dacd2778d9e54877b8ef6d52529c3539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dacd2778d9e54877b8ef6d52529c3539 already in progress: creating tablet
W20250115 10:12:04.470791 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 963fb6e6b1724506a3a451b0d5e66ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 963fb6e6b1724506a3a451b0d5e66ce6 already in progress: creating tablet
I20250115 10:12:04.470759 4557 raft_consensus.cc:357] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.470809 4557 raft_consensus.cc:383] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:04.470819 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 4ab498e7789d4ae18a9f62be2fa2514a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab498e7789d4ae18a9f62be2fa2514a already in progress: creating tablet
I20250115 10:12:04.470829 4557 raft_consensus.cc:738] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.470856 4557 consensus_queue.cc:260] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.470907 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 9fbcd4787a734c5bba29f8a600abf874 (table default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]) successfully deleted
I20250115 10:12:04.470942 4557 ts_tablet_manager.cc:1428] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.470994 4557 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.471050 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 8f0a903ed9f34aaeacf5de038ec4e34d
I20250115 10:12:04.471232 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.471671 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8f0a903ed9f34aaeacf5de038ec4e34d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f0a903ed9f34aaeacf5de038ec4e34d already in progress: creating tablet
I20250115 10:12:04.471925 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5d841537abc2437c826e069cc0725ad1 (table default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77]). Expected version 2 got 0
I20250115 10:12:04.471977 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:04.472582 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 1 got 0
I20250115 10:12:04.472628 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:04.472658 4575 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.472697 4575 ts_tablet_manager.cc:1397] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:04.472829 4575 raft_consensus.cc:357] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.472898 4575 raft_consensus.cc:383] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.472870 4662 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.472916 4575 raft_consensus.cc:738] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.472958 4575 consensus_queue.cc:260] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.473068 4575 ts_tablet_manager.cc:1428] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.473124 4575 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.473150 4557 tablet_bootstrap.cc:654] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.473491 4575 tablet_bootstrap.cc:654] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.473949 4890 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.474761 4575 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.474799 4575 ts_tablet_manager.cc:1397] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.474910 4575 raft_consensus.cc:357] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.474951 4575 raft_consensus.cc:383] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.474965 4575 raft_consensus.cc:738] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.474998 4575 consensus_queue.cc:260] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.475068 4575 ts_tablet_manager.cc:1428] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.475108 4575 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.475347 4663 tablet.cc:1721] T 5d841537abc2437c826e069cc0725ad1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.475497 4575 tablet_bootstrap.cc:654] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.476142 4575 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.476184 4575 ts_tablet_manager.cc:1397] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.476303 4575 raft_consensus.cc:357] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.476347 4575 raft_consensus.cc:383] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.476364 4575 raft_consensus.cc:738] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.476389 4575 consensus_queue.cc:260] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.476411 4663 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.476461 4575 ts_tablet_manager.cc:1428] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.476506 4575 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.476861 4433 raft_consensus.cc:491] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.476902 4433 raft_consensus.cc:513] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.476928 4575 tablet_bootstrap.cc:654] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.476984 4433 leader_election.cc:290] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.477012 4433 raft_consensus.cc:491] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.477035 4433 raft_consensus.cc:513] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.477093 4433 leader_election.cc:290] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.477263 4873 tablet.cc:1721] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:04.478467 4335 raft_consensus.cc:491] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.478452 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.478502 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33c7ecdd251412eaeed45e378e5cc75" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.478520 4335 raft_consensus.cc:513] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.478562 3415 raft_consensus.cc:2463] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.478684 4335 leader_election.cc:290] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.478946 4575 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.478987 4575 ts_tablet_manager.cc:1397] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.479117 4575 raft_consensus.cc:357] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.479113 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.479175 4575 raft_consensus.cc:383] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.479193 4575 raft_consensus.cc:738] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.479220 4575 consensus_queue.cc:260] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.479286 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.479310 4575 ts_tablet_manager.cc:1428] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.479378 3484 leader_election.cc:343] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.479427 4575 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.479450 3484 leader_election.cc:304] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.479526 4884 raft_consensus.cc:2798] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.479554 4884 raft_consensus.cc:491] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.479574 4884 raft_consensus.cc:3054] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.479848 4575 tablet_bootstrap.cc:654] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.480018 3214 leader_election.cc:343] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.480120 3770 consensus_queue.cc:1035] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.480183 3412 raft_consensus.cc:1270] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.480278 4884 raft_consensus.cc:513] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.480324 3770 consensus_queue.cc:1035] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.480384 4884 leader_election.cc:290] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.480737 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.480947 3215 leader_election.cc:343] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.481009 3215 leader_election.cc:304] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.481026 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f0a903ed9f34aaeacf5de038ec4e34d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.481210 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:04.481277 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33c7ecdd251412eaeed45e378e5cc75" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.481329 3415 raft_consensus.cc:3054] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.481356 4731 raft_consensus.cc:2743] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.481716 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.481768 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33c7ecdd251412eaeed45e378e5cc75" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.482038 3415 raft_consensus.cc:2463] T b33c7ecdd251412eaeed45e378e5cc75 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.482144 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b33c7ecdd251412eaeed45e378e5cc75" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.482340 3770 consensus_queue.cc:1035] T 576e273ac51f4eb498faccab336c479d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.482432 3548 raft_consensus.cc:1270] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.482673 3770 consensus_queue.cc:1035] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.483314 4811 raft_consensus.cc:491] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.483377 3484 leader_election.cc:304] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.483371 4811 raft_consensus.cc:513] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.483493 4811 leader_election.cc:290] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.483872 3350 leader_election.cc:343] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:04.483862 4662 tablet.cc:1721] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:04.484055 3279 raft_consensus.cc:1270] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.484054 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35847dc829b4b3d94c0fb68ec6c2b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.484109 3547 raft_consensus.cc:2463] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.484064 3549 raft_consensus.cc:1270] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250115 10:12:04.484222 3485 leader_election.cc:343] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.484272 3485 leader_election.cc:304] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.484336 3485 leader_election.cc:343] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.484385 3485 leader_election.cc:343] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.484891 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8 [id=b9a846c94c034630930c3a4bc001f20b] alter complete (version 1)
I20250115 10:12:04.484982 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_fc5c5a9312fb4fbcbac72a38b5220bb4 [id=5516f7131dec4a698fcfabd2457bbd77] alter complete (version 2)
I20250115 10:12:04.485123 4434 raft_consensus.cc:2798] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.485184 4434 raft_consensus.cc:695] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.485224 4434 consensus_queue.cc:237] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.485495 4434 raft_consensus.cc:2743] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.486176 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.486215 2918 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskjHaIeY/build/release/bin/kudu with pid 4341
I20250115 10:12:04.486445 3415 raft_consensus.cc:1270] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.486948 3350 leader_election.cc:304] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.486997 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:04.487090 4699 raft_consensus.cc:2798] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.487115 4699 raft_consensus.cc:491] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.487133 4699 raft_consensus.cc:3054] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.487147 3770 consensus_queue.cc:1035] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.487350 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d21906d23acc4ab8b81eceb87ead049f (table default.Table_8d48bd824ad4478492174f65bbb8e5ea [id=3c5ff02ab44a4c96a39bdc88f43b1883]) successfully deleted
W20250115 10:12:04.487403 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet dacd2778d9e54877b8ef6d52529c3539 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dacd2778d9e54877b8ef6d52529c3539 already in progress: creating tablet
W20250115 10:12:04.487442 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 963fb6e6b1724506a3a451b0d5e66ce6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 963fb6e6b1724506a3a451b0d5e66ce6 already in progress: creating tablet
W20250115 10:12:04.487478 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9fbcd4787a734c5bba29f8a600abf874 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9fbcd4787a734c5bba29f8a600abf874 already in progress: creating tablet
W20250115 10:12:04.487517 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 4ab498e7789d4ae18a9f62be2fa2514a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ab498e7789d4ae18a9f62be2fa2514a already in progress: creating tablet
W20250115 10:12:04.487565 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 8f0a903ed9f34aaeacf5de038ec4e34d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f0a903ed9f34aaeacf5de038ec4e34d already in progress: creating tablet
W20250115 10:12:04.487603 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 8f0a903ed9f34aaeacf5de038ec4e34d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8f0a903ed9f34aaeacf5de038ec4e34d already in progress: creating tablet
I20250115 10:12:04.487775 4714 consensus_queue.cc:1035] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.487884 4714 consensus_queue.cc:1035] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.488412 4569 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.488458 4569 ts_tablet_manager.cc:1397] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:04.488646 4569 raft_consensus.cc:357] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.488700 4569 raft_consensus.cc:383] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.488720 4569 raft_consensus.cc:738] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.488773 4569 consensus_queue.cc:260] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.488865 4569 ts_tablet_manager.cc:1428] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.488863 4474 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_2a85e863471b4a48b3b2c9df1bdd0341 [id=33d165e5c2314779a6b968e1db48feea] alter complete (version 1)
I20250115 10:12:04.488924 4569 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.487689 4699 raft_consensus.cc:513] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.489096 4699 leader_election.cc:290] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.489437 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d35847dc829b4b3d94c0fb68ec6c2b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.489463 4569 tablet_bootstrap.cc:654] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.489493 3550 raft_consensus.cc:1270] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.490005 4434 raft_consensus.cc:491] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.490054 4434 raft_consensus.cc:513] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.490149 4434 leader_election.cc:290] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.490248 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet ac8b3c397070467196b73dedcacf22de from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.489493 3547 raft_consensus.cc:3054] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.490343 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.490471 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.490643 3485 leader_election.cc:343] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.490888 3484 leader_election.cc:343] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.490933 3547 raft_consensus.cc:2463] T d35847dc829b4b3d94c0fb68ec6c2b31 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.490942 3484 leader_election.cc:304] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.491075 4434 raft_consensus.cc:2743] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.491683 4908 consensus_queue.cc:1035] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.491813 3952 consensus_queue.cc:1035] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.492362 4474 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6] alter complete (version 3)
I20250115 10:12:04.492475 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
W20250115 10:12:04.493991 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:12:04.494060 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bdc4e4d12dbc4e5aa240d9daab4afb1b (table default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610]). Expected version 1 got 0
I20250115 10:12:04.494107 4468 catalog_manager.cc:5526] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.494215 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
I20250115 10:12:04.494254 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.496444 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ac8b3c397070467196b73dedcacf22de
I20250115 10:12:04.496534 4472 catalog_manager.cc:6596] ReplaceTablet: tablet ac8b3c397070467196b73dedcacf22de deleted and replaced by tablet 03d897d86e1b456b973c9b689bd4d7c6
I20250115 10:12:04.496752 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8b3c397070467196b73dedcacf22de with delete_type TABLET_DATA_DELETED (replaced by tablet 03d897d86e1b456b973c9b689bd4d7c6) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.496809 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8b3c397070467196b73dedcacf22de with delete_type TABLET_DATA_DELETED (replaced by tablet 03d897d86e1b456b973c9b689bd4d7c6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.496893 4589 tablet_replica.cc:331] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
W20250115 10:12:04.496912 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet ac8b3c397070467196b73dedcacf22de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac8b3c397070467196b73dedcacf22de already in progress: creating tablet
I20250115 10:12:04.496953 4589 raft_consensus.cc:2238] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.496997 4589 raft_consensus.cc:2267] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.497120 4589 ts_tablet_manager.cc:1905] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.497323 3350 leader_election.cc:343] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:04.497380 3350 leader_election.cc:304] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.497423 4811 raft_consensus.cc:2798] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.497462 4811 raft_consensus.cc:695] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.497509 4811 consensus_queue.cc:237] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.498158 4811 consensus_queue.cc:1035] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.498821 3770 raft_consensus.cc:491] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.498870 3770 raft_consensus.cc:513] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.498929 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8b3c397070467196b73dedcacf22de with delete_type TABLET_DATA_DELETED (replaced by tablet 03d897d86e1b456b973c9b689bd4d7c6) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.498986 3770 leader_election.cc:290] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.499289 3280 raft_consensus.cc:1270] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.499356 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3326a9a37a64e9a9485e5abadc2e493" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.499541 3215 leader_election.cc:343] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.499557 4887 consensus_queue.cc:1035] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.499590 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet ac8b3c397070467196b73dedcacf22de because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac8b3c397070467196b73dedcacf22de already in progress: creating tablet
I20250115 10:12:04.499884 3770 raft_consensus.cc:491] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.499939 3770 raft_consensus.cc:513] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.500056 3770 leader_election.cc:290] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.500162 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba609491f7ed4686b374fd7c0a5e39f8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.500222 3545 raft_consensus.cc:2463] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.500341 3215 leader_election.cc:304] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.500324 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3326a9a37a64e9a9485e5abadc2e493" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.500372 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba609491f7ed4686b374fd7c0a5e39f8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.500419 3413 raft_consensus.cc:2463] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.500458 3411 raft_consensus.cc:1270] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.500486 4731 raft_consensus.cc:2798] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.500521 4731 raft_consensus.cc:491] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.500566 4731 raft_consensus.cc:3054] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.501314 4731 raft_consensus.cc:513] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.501466 4731 leader_election.cc:290] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.501574 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba609491f7ed4686b374fd7c0a5e39f8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.501645 3545 raft_consensus.cc:3054] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.501732 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_205ef4bd277848d7947bf4073aedd705" } new_table_name: "default.Table_8d2aaffd738a4ff28336f4a1b64e913c" modify_external_catalogs: true
W20250115 10:12:04.502208 3214 leader_election.cc:343] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.502259 3214 leader_election.cc:304] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.502383 3545 raft_consensus.cc:2463] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.502401 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba609491f7ed4686b374fd7c0a5e39f8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.502463 3411 raft_consensus.cc:3054] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.502763 3215 leader_election.cc:304] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:04.503378 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 28afafb99f264b0d9798222cb0e6556a consensus state has no leader
I20250115 10:12:04.503391 3411 raft_consensus.cc:2463] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.503481 3770 raft_consensus.cc:2743] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.503542 3770 raft_consensus.cc:2798] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.503584 3770 raft_consensus.cc:695] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.503634 3770 consensus_queue.cc:237] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.503819 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 03d897d86e1b456b973c9b689bd4d7c6 (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.503969 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d897d86e1b456b973c9b689bd4d7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.504009 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 03d897d86e1b456b973c9b689bd4d7c6 (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.504109 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d897d86e1b456b973c9b689bd4d7c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.504153 4434 consensus_queue.cc:1035] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.504309 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.505422 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 03d897d86e1b456b973c9b689bd4d7c6 (DEFAULT_TABLE table=default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.505589 4434 raft_consensus.cc:491] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.505643 4434 raft_consensus.cc:513] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.505766 4434 leader_election.cc:290] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.505894 4731 raft_consensus.cc:491] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.505941 4731 raft_consensus.cc:513] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.505975 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:04.506075 4731 leader_election.cc:290] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.506233 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.506309 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
W20250115 10:12:04.506364 3215 leader_election.cc:343] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.506337 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.506356 4473 catalog_manager.cc:5526] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.506412 3413 raft_consensus.cc:2463] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.506541 4662 tablet.cc:1721] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.506541 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.506631 4589 ts_tablet_manager.cc:1918] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.506676 4589 log.cc:1198] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/ac8b3c397070467196b73dedcacf22de
I20250115 10:12:04.506798 3214 leader_election.cc:304] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.506879 4589 ts_tablet_manager.cc:1939] T ac8b3c397070467196b73dedcacf22de P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.506904 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.506881 4908 raft_consensus.cc:2798] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.507014 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03d897d86e1b456b973c9b689bd4d7c6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.507061 3485 leader_election.cc:343] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.507022 4908 raft_consensus.cc:491] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.508038 4908 raft_consensus.cc:3054] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.508498 4890 tablet.cc:1721] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.508716 4908 raft_consensus.cc:513] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.508828 4908 leader_election.cc:290] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.508883 3350 connection.cc:537] client connection to 127.2.217.189:36717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250115 10:12:04.509029 3484 leader_election.cc:343] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.509071 3484 leader_election.cc:304] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.509163 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.509297 3215 leader_election.cc:343] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.509349 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.509404 3415 raft_consensus.cc:3054] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.509402 4569 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.509449 4569 ts_tablet_manager.cc:1397] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:04.509510 4434 raft_consensus.cc:2743] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.509603 4569 raft_consensus.cc:357] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.509680 4569 raft_consensus.cc:383] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.509701 4569 raft_consensus.cc:738] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.509755 4569 consensus_queue.cc:260] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.509883 4569 ts_tablet_manager.cc:1428] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.509897 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet ac8b3c397070467196b73dedcacf22de (table default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]) successfully deleted
I20250115 10:12:04.509940 4569 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.510069 3415 raft_consensus.cc:2463] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.510377 4569 tablet_bootstrap.cc:654] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.510496 4557 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.510535 4557 ts_tablet_manager.cc:1397] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.001s
I20250115 10:12:04.510659 4557 raft_consensus.cc:357] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.510708 4557 raft_consensus.cc:383] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.510730 4557 raft_consensus.cc:738] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.510769 4557 consensus_queue.cc:260] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.510876 3214 leader_election.cc:304] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.510901 4557 ts_tablet_manager.cc:1428] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.510967 4557 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.510957 3215 connection.cc:537] client connection to 127.2.217.189:36717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20250115 10:12:04.511122 3485 connection.cc:537] client connection to 127.2.217.189:36717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250115 10:12:04.511345 4557 tablet_bootstrap.cc:654] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.511657 4908 raft_consensus.cc:491] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.511708 4908 raft_consensus.cc:513] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.511821 4908 leader_election.cc:290] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.511852 4908 raft_consensus.cc:2798] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.511879 4908 raft_consensus.cc:695] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.511912 4908 consensus_queue.cc:237] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.511951 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet cc395ae76a494a8eb682b7ef34dcb169
I20250115 10:12:04.512404 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.512583 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_ba48c200fcf543a7bb4412fef7ee0393 [id=e155dcc575234dbf91a9f09a89cc3610] alter complete (version 1)
W20250115 10:12:04.512614 3215 leader_election.cc:343] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.513036 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet cc395ae76a494a8eb682b7ef34dcb169
I20250115 10:12:04.513515 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.513585 3415 raft_consensus.cc:2463] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.514006 4472 catalog_manager.cc:5526] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.514106 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
I20250115 10:12:04.514293 4575 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.514334 4575 ts_tablet_manager.cc:1397] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.000s
I20250115 10:12:04.514463 4575 raft_consensus.cc:357] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.514509 4575 raft_consensus.cc:383] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.514524 4575 raft_consensus.cc:738] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.514571 4575 consensus_queue.cc:260] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.514671 4575 ts_tablet_manager.cc:1428] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.514689 4890 tablet.cc:1721] T 1b6a615c0c5d4815b540d81ef3357eb4 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.514719 4575 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.515144 4575 tablet_bootstrap.cc:654] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.515571 3214 leader_election.cc:304] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.515746 4873 tablet.cc:1721] T 1b6a615c0c5d4815b540d81ef3357eb4 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.515852 3952 raft_consensus.cc:2798] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.515893 3952 raft_consensus.cc:491] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.515921 3952 raft_consensus.cc:3054] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.516654 3952 raft_consensus.cc:513] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.516789 3952 leader_election.cc:290] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.517141 4662 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.517292 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.517349 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:04.517552 4714 consensus_queue.cc:1035] T fb04f46a17134bc28719be34085f714f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.518697 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57] alter complete (version 2)
W20250115 10:12:04.519014 3215 leader_election.cc:343] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.519237 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.519315 3414 raft_consensus.cc:3054] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.519594 4890 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.519999 3414 raft_consensus.cc:2463] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.520437 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094] alter complete (version 1)
I20250115 10:12:04.520671 3214 leader_election.cc:304] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.520759 4908 raft_consensus.cc:2798] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.520797 4908 raft_consensus.cc:695] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.520833 4908 consensus_queue.cc:237] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.521875 4434 raft_consensus.cc:491] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.521927 4434 raft_consensus.cc:513] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.522037 4434 leader_election.cc:290] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.522122 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
W20250115 10:12:04.522150 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.522367 4873 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:04.522513 3485 leader_election.cc:343] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:04.522787 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_7c4a2c54e77f4b99aafa437a104a0a58 [id=147b41dfa10b45599d423ceac25e8094]). Expected version 1 got 0
W20250115 10:12:04.523633 3484 leader_election.cc:343] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:04.523677 3484 leader_election.cc:304] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.523806 4434 raft_consensus.cc:2743] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.523857 4908 raft_consensus.cc:491] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.523906 4908 raft_consensus.cc:513] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.524003 4908 leader_election.cc:290] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.524314 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.524498 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.524996 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:04.525033 3215 leader_election.cc:343] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.525327 3214 leader_election.cc:343] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.525385 3214 leader_election.cc:304] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.525478 3770 raft_consensus.cc:2743] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.525540 3770 raft_consensus.cc:491] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.525571 3770 raft_consensus.cc:513] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.525609 4557 tablet_bootstrap.cc:492] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.525645 4557 ts_tablet_manager.cc:1397] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s
I20250115 10:12:04.525671 3770 leader_election.cc:290] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.525803 4557 raft_consensus.cc:357] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.525861 4557 raft_consensus.cc:383] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.525838 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bf4d0bb3c847d5bf0b0697f8334e0a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.525890 4557 raft_consensus.cc:738] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.525928 3770 raft_consensus.cc:491] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.525930 4557 consensus_queue.cc:260] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.525986 3770 raft_consensus.cc:513] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.526047 4557 ts_tablet_manager.cc:1428] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.526091 3770 leader_election.cc:290] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.526108 4557 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.526213 4873 tablet.cc:1721] T af48bf64e2ca4a3197805c75fb0a12a6 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.526556 4557 tablet_bootstrap.cc:654] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.526712 4662 tablet.cc:1721] T af48bf64e2ca4a3197805c75fb0a12a6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.526687 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3402dc674ab0402f8e0bdd7b8db4b88d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.526775 3414 raft_consensus.cc:2463] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.526818 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bf4d0bb3c847d5bf0b0697f8334e0a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.526866 3411 raft_consensus.cc:2463] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.527101 3214 leader_election.cc:304] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.527173 3214 leader_election.cc:304] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.527244 4908 raft_consensus.cc:2798] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.527269 4908 raft_consensus.cc:491] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.527294 4908 raft_consensus.cc:3054] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.527364 3952 raft_consensus.cc:2798] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.527385 3952 raft_consensus.cc:491] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.527407 3952 raft_consensus.cc:3054] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.527951 3215 leader_election.cc:343] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.528126 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3402dc674ab0402f8e0bdd7b8db4b88d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.528606 3215 leader_election.cc:343] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.528894 4890 tablet.cc:1721] T af48bf64e2ca4a3197805c75fb0a12a6 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250115 10:12:04.529245 4463 consensus_peers.cc:487] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 -> Peer efd4346420bb4a5abb9cf66799e35565 (127.2.217.189:36717): Couldn't send request to peer efd4346420bb4a5abb9cf66799e35565. Status: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.529455 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet af48bf64e2ca4a3197805c75fb0a12a6 (table default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787]). Expected version 2 got 0
I20250115 10:12:04.529455 3414 raft_consensus.cc:1270] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:04.529750 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_bfd274906ff64c15923a398e7b1928b7 [id=34df5dd8b54449b6a5794cffff1bd787] alter complete (version 2)
I20250115 10:12:04.529827 4557 tablet_bootstrap.cc:492] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.529863 4557 ts_tablet_manager.cc:1397] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:04.529989 4557 raft_consensus.cc:357] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.530050 4557 raft_consensus.cc:383] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.530067 4557 raft_consensus.cc:738] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.530098 4557 consensus_queue.cc:260] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.530216 4557 ts_tablet_manager.cc:1428] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.530665 5143 negotiation.cc:337] Failed RPC negotiation. Trace:
0115 10:12:04.509511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.217.189:36717 (local address 127.2.217.130:41497)
0115 10:12:04.530492 (+ 20981us) negotiation.cc:107] Waiting for socket to connect
0115 10:12:04.530530 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.217.189:36717: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":19531,"thread_start_us":64,"threads_started":1}
W20250115 10:12:04.531062 3215 consensus_peers.cc:487] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.531133 4731 consensus_queue.cc:1035] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.531234 4731 raft_consensus.cc:491] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.531270 4731 raft_consensus.cc:513] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.531365 4731 leader_election.cc:290] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.531934 4557 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.532539 4557 tablet_bootstrap.cc:654] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.533044 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c99788dae6421b8b2dd4f40e2b63b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.533221 3215 leader_election.cc:343] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.533274 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
W20250115 10:12:04.533635 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:04.534081 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0e49cd66dc9547a3be177283a5c1cb9c" } new_table_name: "default.Table_cab9252630814ab69c879985e3c01f06" modify_external_catalogs: true
I20250115 10:12:04.534535 4557 tablet_bootstrap.cc:492] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.534575 4557 ts_tablet_manager.cc:1397] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.531683 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c99788dae6421b8b2dd4f40e2b63b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.534729 4557 raft_consensus.cc:357] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.534781 4557 raft_consensus.cc:383] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.534765 3411 raft_consensus.cc:2463] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.534813 4557 raft_consensus.cc:738] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.534902 4557 consensus_queue.cc:260] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.535107 4557 ts_tablet_manager.cc:1428] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.535199 4557 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.535353 4575 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.535401 4575 ts_tablet_manager.cc:1397] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:04.535589 4575 raft_consensus.cc:357] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.535663 4575 raft_consensus.cc:383] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.535665 4557 tablet_bootstrap.cc:654] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.535686 4575 raft_consensus.cc:738] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.535764 4575 consensus_queue.cc:260] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.535885 4575 ts_tablet_manager.cc:1428] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.536113 3214 leader_election.cc:304] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.536542 4575 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.536623 3770 raft_consensus.cc:2798] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.536659 3770 raft_consensus.cc:491] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.536680 3770 raft_consensus.cc:3054] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.537333 4575 tablet_bootstrap.cc:654] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.538542 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_30b3e0325fa54d5281f683f1b664c721"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.538666 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_30b3e0325fa54d5281f683f1b664c721 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.539022 4873 tablet.cc:1721] T bdc4e4d12dbc4e5aa240d9daab4afb1b P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.540189 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9ff66254df664c3ebde2bfb9440108e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.540287 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ff66254df664c3ebde2bfb9440108e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.540313 4557 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.540344 4557 ts_tablet_manager.cc:1397] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.540472 4557 raft_consensus.cc:357] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.540524 4557 raft_consensus.cc:383] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.540546 4557 raft_consensus.cc:738] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.540583 4557 consensus_queue.cc:260] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.540673 4557 ts_tablet_manager.cc:1428] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.540727 4557 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.541134 4557 tablet_bootstrap.cc:654] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.542229 4557 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.542270 4557 ts_tablet_manager.cc:1397] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.542392 4557 raft_consensus.cc:357] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.542455 4557 raft_consensus.cc:383] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.542486 4557 raft_consensus.cc:738] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.542518 4557 consensus_queue.cc:260] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.542599 4557 ts_tablet_manager.cc:1428] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.542695 4557 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.542781 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 347621ded3fd4380b1502d1a8c5b0c4a consensus state has no leader
I20250115 10:12:04.543200 4557 tablet_bootstrap.cc:654] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.543480 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 2cff85958d3c46069b1dd9bf5cb75ca4
W20250115 10:12:04.544451 3214 consensus_peers.cc:487] T a154d22681d34329b497747e84ce41cf P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.545007 4557 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.545045 4557 ts_tablet_manager.cc:1397] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.545065 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 4f463f01967047228f944c907a162056 (DEFAULT_TABLE table=default.Table_30b3e0325fa54d5281f683f1b664c721 [id=1e1ac1a58e574da5bdd1d23d45b98717]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.545178 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f463f01967047228f944c907a162056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.545250 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 4f463f01967047228f944c907a162056 (DEFAULT_TABLE table=default.Table_30b3e0325fa54d5281f683f1b664c721 [id=1e1ac1a58e574da5bdd1d23d45b98717]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.545356 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f463f01967047228f944c907a162056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.545162 4557 raft_consensus.cc:357] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.545535 4557 raft_consensus.cc:383] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.545567 4557 raft_consensus.cc:738] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.545624 4557 consensus_queue.cc:260] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.545732 4557 ts_tablet_manager.cc:1428] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.545787 4557 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.546159 4557 tablet_bootstrap.cc:654] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.546561 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 4f463f01967047228f944c907a162056 (DEFAULT_TABLE table=default.Table_30b3e0325fa54d5281f683f1b664c721 [id=1e1ac1a58e574da5bdd1d23d45b98717]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.546649 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f463f01967047228f944c907a162056. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.547848 4335 raft_consensus.cc:491] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.547892 4335 raft_consensus.cc:513] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.548010 4335 leader_election.cc:290] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.548166 4575 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.548203 4575 ts_tablet_manager.cc:1397] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:04.548344 4575 raft_consensus.cc:357] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.548395 4575 raft_consensus.cc:383] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.548410 4575 raft_consensus.cc:738] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.548434 4575 consensus_queue.cc:260] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.548520 4575 ts_tablet_manager.cc:1428] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.548578 4575 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.549047 4575 tablet_bootstrap.cc:654] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.549404 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.549494 4731 raft_consensus.cc:491] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:04.549541 4731 raft_consensus.cc:513] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:04.549623 4731 leader_election.cc:290] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.549757 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
W20250115 10:12:04.550172 3214 leader_election.cc:343] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.550302 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.550424 4811 raft_consensus.cc:491] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.550468 4811 raft_consensus.cc:513] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.550544 3215 leader_election.cc:343] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.550557 4811 leader_election.cc:290] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.550580 3215 leader_election.cc:304] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.550683 4731 raft_consensus.cc:2743] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.550751 3214 leader_election.cc:343] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7
W20250115 10:12:04.550871 3215 leader_election.cc:343] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:12:04.550902 3215 leader_election.cc:304] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.550966 4731 raft_consensus.cc:2743] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:04.551151 4569 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.551204 4569 ts_tablet_manager.cc:1397] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.000s
I20250115 10:12:04.550172 3770 raft_consensus.cc:513] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.551390 4569 raft_consensus.cc:357] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.551440 3770 leader_election.cc:290] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.551455 4569 raft_consensus.cc:383] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.551497 4569 raft_consensus.cc:738] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.551541 4569 consensus_queue.cc:260] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.551584 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c99788dae6421b8b2dd4f40e2b63b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.551651 4569 ts_tablet_manager.cc:1428] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.551749 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c99788dae6421b8b2dd4f40e2b63b2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.551803 3414 raft_consensus.cc:3054] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.552356 3414 raft_consensus.cc:2463] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:04.551699 3215 leader_election.cc:343] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.552484 3214 leader_election.cc:304] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.552554 4731 raft_consensus.cc:2798] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.552585 4731 raft_consensus.cc:695] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.552623 4731 consensus_queue.cc:237] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.552673 4557 tablet_bootstrap.cc:492] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.552707 4557 ts_tablet_manager.cc:1397] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:04.552884 4434 raft_consensus.cc:491] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.552917 4434 raft_consensus.cc:513] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.552983 4434 leader_election.cc:290] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.552999 4908 raft_consensus.cc:513] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.553104 4908 leader_election.cc:290] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.553222 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3402dc674ab0402f8e0bdd7b8db4b88d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.553365 3215 leader_election.cc:343] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.551723 4569 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.553666 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3402dc674ab0402f8e0bdd7b8db4b88d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.553761 3411 raft_consensus.cc:3054] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.553867 4569 tablet_bootstrap.cc:654] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.552366 3952 raft_consensus.cc:513] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.554219 3952 leader_election.cc:290] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.554355 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bf4d0bb3c847d5bf0b0697f8334e0a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.554411 3415 raft_consensus.cc:3054] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.554512 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bf4d0bb3c847d5bf0b0697f8334e0a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.554525 3411 raft_consensus.cc:2463] T 3402dc674ab0402f8e0bdd7b8db4b88d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:04.554638 3215 leader_election.cc:343] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.554695 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.554822 4557 raft_consensus.cc:357] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.554872 4557 raft_consensus.cc:383] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.554914 4557 raft_consensus.cc:738] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.554960 4557 consensus_queue.cc:260] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.555085 4557 ts_tablet_manager.cc:1428] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.555119 3415 raft_consensus.cc:2463] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.555146 4557 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.555191 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.555555 4557 tablet_bootstrap.cc:654] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.555640 4575 tablet_bootstrap.cc:492] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.555682 4575 ts_tablet_manager.cc:1397] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.555840 4575 raft_consensus.cc:357] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.555908 4575 raft_consensus.cc:383] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.555930 4575 raft_consensus.cc:738] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.555941 3484 leader_election.cc:343] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.555968 4575 consensus_queue.cc:260] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.556082 4575 ts_tablet_manager.cc:1428] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.556142 4575 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.556216 3485 leader_election.cc:343] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.556254 3485 leader_election.cc:304] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.556357 4434 raft_consensus.cc:2743] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.556541 3214 leader_election.cc:304] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.556623 4575 tablet_bootstrap.cc:654] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.556635 3770 raft_consensus.cc:2798] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.556703 3770 raft_consensus.cc:695] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.556761 3770 consensus_queue.cc:237] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.556962 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a20c21609d3f41ec98698a4bc198dcf1" } new_table_name: "default.Table_79b67e4487a144728cdd614905baf575" modify_external_catalogs: true
I20250115 10:12:04.556634 3214 leader_election.cc:304] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.557150 3770 raft_consensus.cc:2798] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.557166 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_fec7184706584f6ba7fe4a6fc4596962" } new_table_name: "default.Table_9a526e66b6da46c6a70efda61f98c0cc" modify_external_catalogs: true
I20250115 10:12:04.557194 3770 raft_consensus.cc:695] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.557236 3770 consensus_queue.cc:237] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.557334 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_76cdc2481e3d4a8d83b5302e76d7480b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.557435 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76cdc2481e3d4a8d83b5302e76d7480b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.558032 4569 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.558068 4569 ts_tablet_manager.cc:1397] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.558195 4569 raft_consensus.cc:357] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.558226 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 4283a096b18b4be69e1f57e60c3efd3e
I20250115 10:12:04.558238 4569 raft_consensus.cc:383] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.558255 4569 raft_consensus.cc:738] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.558293 4569 consensus_queue.cc:260] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.558426 4569 ts_tablet_manager.cc:1428] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.558490 4569 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.558882 4569 tablet_bootstrap.cc:654] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.559170 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.559166 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 5507e6db082f4618aea2dcb6ee16c61f (DEFAULT_TABLE table=default.Table_9ff66254df664c3ebde2bfb9440108e1 [id=3209b7024aeb438da0b1d4cdda1602ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.559278 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5507e6db082f4618aea2dcb6ee16c61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.560159 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.560238 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 5507e6db082f4618aea2dcb6ee16c61f (DEFAULT_TABLE table=default.Table_9ff66254df664c3ebde2bfb9440108e1 [id=3209b7024aeb438da0b1d4cdda1602ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.560329 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5507e6db082f4618aea2dcb6ee16c61f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.560482 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:04.560659 4475 catalog_manager.cc:5526] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.560736 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:04.560722 3952 raft_consensus.cc:491] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.560798 3952 raft_consensus.cc:513] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.560895 3952 leader_election.cc:290] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.561704 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 5507e6db082f4618aea2dcb6ee16c61f (DEFAULT_TABLE table=default.Table_9ff66254df664c3ebde2bfb9440108e1 [id=3209b7024aeb438da0b1d4cdda1602ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.561851 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5507e6db082f4618aea2dcb6ee16c61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.561878 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.562037 3215 leader_election.cc:343] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.562150 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.562252 4557 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.562290 4557 ts_tablet_manager.cc:1397] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.562515 4557 raft_consensus.cc:357] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.562580 4557 raft_consensus.cc:383] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.562624 4557 raft_consensus.cc:738] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.562676 4557 consensus_queue.cc:260] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.562776 4557 ts_tablet_manager.cc:1428] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.562836 4557 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.563253 4557 tablet_bootstrap.cc:654] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.563547 4887 raft_consensus.cc:491] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.563613 4887 raft_consensus.cc:513] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.563853 4887 leader_election.cc:290] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.563930 4557 tablet_bootstrap.cc:492] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.563988 4557 ts_tablet_manager.cc:1397] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
W20250115 10:12:04.563977 3214 leader_election.cc:343] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.563994 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.564035 3214 leader_election.cc:304] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.564131 4557 raft_consensus.cc:357] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.564189 4557 raft_consensus.cc:383] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.564210 4557 raft_consensus.cc:738] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.564236 3485 leader_election.cc:343] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.564255 3952 raft_consensus.cc:2743] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.564340 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.564504 3484 leader_election.cc:343] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.564543 3484 leader_election.cc:304] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.564240 4557 consensus_queue.cc:260] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.564760 4557 ts_tablet_manager.cc:1428] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.564815 4557 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.564826 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 11390ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:04.565114 3350 leader_election.cc:343] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.565176 3350 leader_election.cc:343] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.565179 4557 tablet_bootstrap.cc:654] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.565203 3350 leader_election.cc:304] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.565287 4811 raft_consensus.cc:2743] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.565461 4434 raft_consensus.cc:2743] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.566362 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b07efa65ed754b75abfbe4869593ab78 consensus state has no leader
W20250115 10:12:04.566462 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8dde69ff2f574d838d81bea5a53700f5 consensus state has no leader
I20250115 10:12:04.567183 4557 tablet_bootstrap.cc:492] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.567224 4557 ts_tablet_manager.cc:1397] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.567405 4557 raft_consensus.cc:357] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.567473 4557 raft_consensus.cc:383] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.567493 4557 raft_consensus.cc:738] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.567523 4557 consensus_queue.cc:260] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.567620 4557 ts_tablet_manager.cc:1428] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.567672 4557 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.567987 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.568162 4557 tablet_bootstrap.cc:654] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.569641 4557 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.569685 4557 ts_tablet_manager.cc:1397] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.569816 4557 raft_consensus.cc:357] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.569868 4557 raft_consensus.cc:383] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.569890 4557 raft_consensus.cc:738] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.569926 4557 consensus_queue.cc:260] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.570019 4557 ts_tablet_manager.cc:1428] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.570068 4557 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.570374 3257 tablet_service.cc:1467] Processing CreateTablet for tablet a2bd6997efe8433ab1fa1951e4147695 (DEFAULT_TABLE table=default.Table_76cdc2481e3d4a8d83b5302e76d7480b [id=e28c5ed56be143b6a81c382b13616328]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.570405 4557 tablet_bootstrap.cc:654] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.570492 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bd6997efe8433ab1fa1951e4147695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.570645 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_9a526e66b6da46c6a70efda61f98c0cc [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]). Expected version 2 got 0
I20250115 10:12:04.570698 4468 catalog_manager.cc:5526] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.570817 4468 catalog_manager.cc:5526] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.570873 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.570925 3386 tablet_service.cc:1467] Processing CreateTablet for tablet a2bd6997efe8433ab1fa1951e4147695 (DEFAULT_TABLE table=default.Table_76cdc2481e3d4a8d83b5302e76d7480b [id=e28c5ed56be143b6a81c382b13616328]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.571027 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bd6997efe8433ab1fa1951e4147695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.571192 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]). Expected version 1 got 0
I20250115 10:12:04.571877 4569 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.571933 4569 ts_tablet_manager.cc:1397] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:04.572062 4569 raft_consensus.cc:357] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.572127 4569 raft_consensus.cc:383] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.572149 4569 raft_consensus.cc:738] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.572196 4569 consensus_queue.cc:260] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.572291 4569 ts_tablet_manager.cc:1428] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.572336 4569 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.572696 4569 tablet_bootstrap.cc:654] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.573072 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet cf859ca6a22947ba80f99872d6dc6600 with delete_type TABLET_DATA_DELETED (replaced by tablet 22800d4454c94fe6a8a0b163d2f630b1) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.573269 4551 tablet_replica.cc:331] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.573333 4551 raft_consensus.cc:2238] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.573370 4551 raft_consensus.cc:2267] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.573575 4551 ts_tablet_manager.cc:1905] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.573621 4557 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.573649 4557 ts_tablet_manager.cc:1397] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:04.573762 4557 raft_consensus.cc:357] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.573803 4557 raft_consensus.cc:383] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.573819 4557 raft_consensus.cc:738] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.573853 4557 consensus_queue.cc:260] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.573923 4557 ts_tablet_manager.cc:1428] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.573987 4557 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.574199 3514 tablet_service.cc:1467] Processing CreateTablet for tablet a2bd6997efe8433ab1fa1951e4147695 (DEFAULT_TABLE table=default.Table_76cdc2481e3d4a8d83b5302e76d7480b [id=e28c5ed56be143b6a81c382b13616328]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.574313 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2bd6997efe8433ab1fa1951e4147695. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.574374 4557 tablet_bootstrap.cc:654] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.575083 4569 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.575137 4569 ts_tablet_manager.cc:1397] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.575253 4551 ts_tablet_manager.cc:1918] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.575307 4551 log.cc:1198] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/cf859ca6a22947ba80f99872d6dc6600
I20250115 10:12:04.575282 4569 raft_consensus.cc:357] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.575353 3770 raft_consensus.cc:491] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.575403 3770 raft_consensus.cc:513] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.575513 3770 leader_election.cc:290] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.575564 4551 ts_tablet_manager.cc:1939] T cf859ca6a22947ba80f99872d6dc6600 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.575613 4557 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.575657 4557 ts_tablet_manager.cc:1397] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.575721 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.575835 4557 raft_consensus.cc:357] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.575901 4557 raft_consensus.cc:383] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.575925 4557 raft_consensus.cc:738] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.575938 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.575944 3214 leader_election.cc:343] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.575975 4557 consensus_queue.cc:260] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.576081 4557 ts_tablet_manager.cc:1428] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.576144 4557 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.576418 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet 09db89ab7dd543559ae8a11e60c8a873 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ecba5f150eb4d93b500a0ed3b56d97e) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.576489 4557 tablet_bootstrap.cc:654] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.575361 4569 raft_consensus.cc:383] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.576818 4569 raft_consensus.cc:738] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.576861 4569 consensus_queue.cc:260] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.576987 4569 ts_tablet_manager.cc:1428] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.577057 4569 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.577524 4569 tablet_bootstrap.cc:654] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.578181 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
W20250115 10:12:04.578234 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
W20250115 10:12:04.578516 3215 leader_election.cc:343] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.578557 3215 leader_election.cc:304] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.578673 3770 raft_consensus.cc:2743] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.578874 4551 tablet_replica.cc:331] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.578933 4551 raft_consensus.cc:2238] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.578959 4551 raft_consensus.cc:2267] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:04.579449 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 0e033d609eef46a792b1a568ec2936de
W20250115 10:12:04.579563 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:04.579730 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet cf859ca6a22947ba80f99872d6dc6600 (table default.Table_b8abe6f792f84722953b88b54d7516be [id=1a044e4377f944cebf3d6b242638f1ff]) successfully deleted
I20250115 10:12:04.579756 4890 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.580114 4569 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.580147 4569 ts_tablet_manager.cc:1397] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.580264 4569 raft_consensus.cc:357] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.580307 4569 raft_consensus.cc:383] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.580325 4569 raft_consensus.cc:738] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.580365 4569 consensus_queue.cc:260] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.580469 4569 ts_tablet_manager.cc:1428] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.580549 4569 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.581171 3550 raft_consensus.cc:3054] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.581580 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 0e033d609eef46a792b1a568ec2936de
I20250115 10:12:04.581769 4569 tablet_bootstrap.cc:654] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.582089 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
I20250115 10:12:04.582136 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:04.582487 4908 raft_consensus.cc:491] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.582535 4908 raft_consensus.cc:513] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.582685 4908 leader_election.cc:290] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.582777 4557 tablet_bootstrap.cc:492] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.582815 4557 ts_tablet_manager.cc:1397] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:04.582846 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9acac6e5e8a486ea8e269359498c3a7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.582912 3415 raft_consensus.cc:2463] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.582943 4557 raft_consensus.cc:357] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.583009 4557 raft_consensus.cc:383] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.583029 4557 raft_consensus.cc:738] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.583019 3214 leader_election.cc:304] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.583073 4557 consensus_queue.cc:260] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.583117 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9acac6e5e8a486ea8e269359498c3a7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.583174 4557 ts_tablet_manager.cc:1428] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.583209 3547 raft_consensus.cc:2463] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.583245 4557 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.583405 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
I20250115 10:12:04.583629 4557 tablet_bootstrap.cc:654] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.583660 4908 raft_consensus.cc:2798] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.583695 4908 raft_consensus.cc:491] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.583738 4908 raft_consensus.cc:3054] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.584517 4908 raft_consensus.cc:513] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.584654 4908 leader_election.cc:290] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.584707 4811 raft_consensus.cc:491] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.584753 4811 raft_consensus.cc:513] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.584797 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9acac6e5e8a486ea8e269359498c3a7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.584846 4811 leader_election.cc:290] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.584869 3547 raft_consensus.cc:3054] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.585031 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9acac6e5e8a486ea8e269359498c3a7" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.585088 3415 raft_consensus.cc:3054] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.585608 3547 raft_consensus.cc:2463] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.585698 3415 raft_consensus.cc:2463] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.585845 3215 leader_election.cc:304] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.585927 4908 raft_consensus.cc:2798] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.585980 4908 raft_consensus.cc:695] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.586025 4908 consensus_queue.cc:237] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.586932 4551 ts_tablet_manager.cc:1905] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.587015 4475 catalog_manager.cc:5526] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.587080 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae4f2e19e4443b38430cdb95bd82f91" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.587328 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae4f2e19e4443b38430cdb95bd82f91" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.587388 3276 raft_consensus.cc:2463] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.587805 3350 leader_election.cc:304] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.587862 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c] alter complete (version 1)
W20250115 10:12:04.587890 3350 leader_election.cc:343] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.587890 4811 raft_consensus.cc:2798] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.587962 4811 raft_consensus.cc:491] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.587980 4811 raft_consensus.cc:3054] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.588537 4811 raft_consensus.cc:513] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.588615 4811 leader_election.cc:290] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.588898 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.588956 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae4f2e19e4443b38430cdb95bd82f91" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.589249 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ae4f2e19e4443b38430cdb95bd82f91" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.589289 3276 raft_consensus.cc:3054] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.589485 3350 leader_election.cc:343] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.589776 3276 raft_consensus.cc:2463] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.590212 3350 leader_election.cc:304] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.590284 4551 ts_tablet_manager.cc:1918] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.590340 4811 raft_consensus.cc:2798] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.590377 4811 raft_consensus.cc:695] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.590409 4811 consensus_queue.cc:237] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.590571 4662 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.590793 4551 log.cc:1198] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/09db89ab7dd543559ae8a11e60c8a873
I20250115 10:12:04.590951 4551 ts_tablet_manager.cc:1939] T 09db89ab7dd543559ae8a11e60c8a873 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.591217 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 09db89ab7dd543559ae8a11e60c8a873 (table default.Table_f44f6ee3640e4db084bd2fa9ab7e94d2 [id=bdf262ee2f404aabb07a33c5c7d73b6c]) successfully deleted
I20250115 10:12:04.592386 4575 tablet_bootstrap.cc:492] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.592444 4575 ts_tablet_manager.cc:1397] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.001s
I20250115 10:12:04.592406 4475 catalog_manager.cc:5526] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.592563 4575 raft_consensus.cc:357] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.592613 4575 raft_consensus.cc:383] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.592629 4575 raft_consensus.cc:738] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.592661 4575 consensus_queue.cc:260] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.592767 4575 ts_tablet_manager.cc:1428] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.592830 4575 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.592849 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_41455aacdb2a4371bd9cb4be0b5b88fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.592948 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41455aacdb2a4371bd9cb4be0b5b88fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.593200 4575 tablet_bootstrap.cc:654] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.593510 3770 raft_consensus.cc:491] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.593549 3770 raft_consensus.cc:513] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.593650 3770 leader_election.cc:290] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.593786 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.593953 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.593997 3215 leader_election.cc:343] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.594221 3214 leader_election.cc:343] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.594260 3214 leader_election.cc:304] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.594323 3770 raft_consensus.cc:2743] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.594815 4575 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.594858 4575 ts_tablet_manager.cc:1397] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.595041 4575 raft_consensus.cc:357] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.595109 4575 raft_consensus.cc:383] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.595129 4575 raft_consensus.cc:738] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.595163 4575 consensus_queue.cc:260] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.595248 4575 ts_tablet_manager.cc:1428] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.595297 4575 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.595687 4575 tablet_bootstrap.cc:654] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.596359 4575 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.596398 4575 ts_tablet_manager.cc:1397] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.596506 4575 raft_consensus.cc:357] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.596572 4575 raft_consensus.cc:383] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.596589 4575 raft_consensus.cc:738] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.596630 4575 consensus_queue.cc:260] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.596709 4575 ts_tablet_manager.cc:1428] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.596777 4575 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.597141 4575 tablet_bootstrap.cc:654] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.597425 4877 raft_consensus.cc:491] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.597469 4877 raft_consensus.cc:513] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.597559 4877 leader_election.cc:290] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.597538 4662 tablet.cc:1721] T 1b6a615c0c5d4815b540d81ef3357eb4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.598194 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.598299 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:04.598338 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.598367 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 1 got 0
I20250115 10:12:04.598448 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a154d22681d34329b497747e84ce41cf" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.598554 4877 raft_consensus.cc:491] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.598589 4877 raft_consensus.cc:513] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.598660 4877 leader_election.cc:290] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.598671 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 0aadd331ae75466a9177553caf87d5b8 (DEFAULT_TABLE table=default.Table_41455aacdb2a4371bd9cb4be0b5b88fd [id=dc4af68463664e5984ca1413acffd12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.598762 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aadd331ae75466a9177553caf87d5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.598800 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 0aadd331ae75466a9177553caf87d5b8 (DEFAULT_TABLE table=default.Table_41455aacdb2a4371bd9cb4be0b5b88fd [id=dc4af68463664e5984ca1413acffd12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.598912 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aadd331ae75466a9177553caf87d5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.599012 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 1b6a615c0c5d4815b540d81ef3357eb4 (table default.Table_5e5e262748054ec6851819b936dc6fbd [id=0e1a322d63c049d6878a7a7a7a80de57]). Expected version 2 got 0
I20250115 10:12:04.600548 3350 leader_election.cc:304] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.600684 4811 raft_consensus.cc:2743] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.600698 3770 raft_consensus.cc:491] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.600824 3770 raft_consensus.cc:513] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.600953 3770 leader_election.cc:290] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.601128 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.601187 3415 raft_consensus.cc:2463] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.601161 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.601323 3214 leader_election.cc:304] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.601466 3952 raft_consensus.cc:2798] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.601504 3952 raft_consensus.cc:491] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.601521 3952 raft_consensus.cc:3054] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.601550 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.601615 3279 raft_consensus.cc:2463] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.601648 4575 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.601687 4575 ts_tablet_manager.cc:1397] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.601686 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.601837 4575 raft_consensus.cc:357] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.601899 4575 raft_consensus.cc:383] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.601920 4575 raft_consensus.cc:738] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.601960 3215 leader_election.cc:343] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.601959 4575 consensus_queue.cc:260] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.602066 4575 ts_tablet_manager.cc:1428] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.602144 4575 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.602149 3550 raft_consensus.cc:3054] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.602128 3952 raft_consensus.cc:513] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.602236 3952 leader_election.cc:290] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.602557 4575 tablet_bootstrap.cc:654] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.603456 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.603693 3215 leader_election.cc:343] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.603965 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 0aadd331ae75466a9177553caf87d5b8 (DEFAULT_TABLE table=default.Table_41455aacdb2a4371bd9cb4be0b5b88fd [id=dc4af68463664e5984ca1413acffd12f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.604084 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aadd331ae75466a9177553caf87d5b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.604099 4557 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.604146 4557 ts_tablet_manager.cc:1397] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:04.604264 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73af05d7fd349b083eb74352a62a1fe" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.604316 3415 raft_consensus.cc:3054] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.604295 4557 raft_consensus.cc:357] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.604347 4557 raft_consensus.cc:383] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.604367 4557 raft_consensus.cc:738] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.604411 4557 consensus_queue.cc:260] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.604509 4557 ts_tablet_manager.cc:1428] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.604562 4557 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.604956 4557 tablet_bootstrap.cc:654] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.604948 3415 raft_consensus.cc:2463] T d73af05d7fd349b083eb74352a62a1fe P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.605671 3350 leader_election.cc:304] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.605762 3350 leader_election.cc:343] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.605772 4877 raft_consensus.cc:491] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.605839 4877 raft_consensus.cc:513] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.605931 4877 leader_election.cc:290] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.605953 4877 raft_consensus.cc:2798] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.605968 4877 raft_consensus.cc:491] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.605980 4877 raft_consensus.cc:3054] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.606519 4877 raft_consensus.cc:513] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.606595 4877 leader_election.cc:290] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.607987 3214 leader_election.cc:304] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.608086 4908 raft_consensus.cc:2798] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.608126 4908 raft_consensus.cc:695] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.608171 4908 consensus_queue.cc:237] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.609380 4811 raft_consensus.cc:491] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.609429 4811 raft_consensus.cc:513] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.609503 4811 leader_election.cc:290] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.609602 4468 catalog_manager.cc:5526] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.609751 4557 tablet_bootstrap.cc:492] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.609789 4557 ts_tablet_manager.cc:1397] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:04.609941 4569 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.609931 4557 raft_consensus.cc:357] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.610000 4557 raft_consensus.cc:383] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.609977 4569 ts_tablet_manager.cc:1397] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.000s
I20250115 10:12:04.610018 4557 raft_consensus.cc:738] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.610057 4557 consensus_queue.cc:260] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.610141 4557 ts_tablet_manager.cc:1428] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.610131 4569 raft_consensus.cc:357] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.610183 4569 raft_consensus.cc:383] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.610199 4569 raft_consensus.cc:738] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.610199 4557 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.610234 4569 consensus_queue.cc:260] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.610323 4569 ts_tablet_manager.cc:1428] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.610345 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.610397 4569 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.610632 4557 tablet_bootstrap.cc:654] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.610625 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.610901 4569 tablet_bootstrap.cc:654] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.611466 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.611523 3276 raft_consensus.cc:3054] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.612206 3276 raft_consensus.cc:2463] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.612318 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.612670 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.612805 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.613198 3350 leader_election.cc:343] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.613263 3350 leader_election.cc:304] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.613322 4811 raft_consensus.cc:2798] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
W20250115 10:12:04.613350 3350 leader_election.cc:343] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.613364 4811 raft_consensus.cc:695] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.613405 4811 consensus_queue.cc:237] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.613399 4877 consensus_queue.cc:1035] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.614027 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet dc7e96ba921d4fbb96afbbf8c5f354f2 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:04.614281 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
W20250115 10:12:04.613399 3350 leader_election.cc:343] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.614399 3350 leader_election.cc:343] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.614425 3350 leader_election.cc:304] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.614694 4875 raft_consensus.cc:2743] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.610409 3280 raft_consensus.cc:2463] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.615144 3350 leader_election.cc:304] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.616815 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 10c5cf464dcd484191838d56253ded0b from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.617167 3952 raft_consensus.cc:491] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.617213 3952 raft_consensus.cc:513] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.617312 3952 leader_election.cc:290] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.617422 4875 raft_consensus.cc:2798] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.617458 4875 raft_consensus.cc:491] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.617481 4875 raft_consensus.cc:3054] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.617496 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.617766 3215 leader_election.cc:343] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.618166 4875 raft_consensus.cc:513] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.618275 4875 leader_election.cc:290] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.618449 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.618508 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:04.618592 4475 catalog_manager.cc:6596] ReplaceTablet: tablet dc7e96ba921d4fbb96afbbf8c5f354f2 deleted and replaced by tablet 21e2a71f1a0145309b037e34f1b398d6
I20250115 10:12:04.618763 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21e2a71f1a0145309b037e34f1b398d6) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.618942 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc7e96ba921d4fbb96afbbf8c5f354f2 already in progress: creating tablet
I20250115 10:12:04.619087 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7b236b5787d24e138bfad3c30003b316" } new_table_name: "default.Table_99fc538b849348e19ef1968953d83866" modify_external_catalogs: true
W20250115 10:12:04.619146 3350 leader_election.cc:343] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.619341 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "497adb74fac84c1cb438ea6ba4adf211" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.619390 3280 raft_consensus.cc:3054] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.620018 3280 raft_consensus.cc:2463] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.620143 3350 leader_election.cc:304] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.620290 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c4fdd4041cdf4d79919209b6c66dce68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.620383 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4fdd4041cdf4d79919209b6c66dce68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.620409 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21e2a71f1a0145309b037e34f1b398d6) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.620648 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc7e96ba921d4fbb96afbbf8c5f354f2 already in progress: creating tablet
I20250115 10:12:04.620663 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21e2a71f1a0145309b037e34f1b398d6) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.621258 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dc7e96ba921d4fbb96afbbf8c5f354f2 already in progress: creating tablet
I20250115 10:12:04.621688 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 10c5cf464dcd484191838d56253ded0b
I20250115 10:12:04.621758 4474 catalog_manager.cc:6596] ReplaceTablet: tablet 10c5cf464dcd484191838d56253ded0b deleted and replaced by tablet 28a8e280055c494f9fa2941940ea8ee5
I20250115 10:12:04.621902 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c5cf464dcd484191838d56253ded0b with delete_type TABLET_DATA_DELETED (replaced by tablet 28a8e280055c494f9fa2941940ea8ee5) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.622119 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 10c5cf464dcd484191838d56253ded0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c5cf464dcd484191838d56253ded0b already in progress: creating tablet
W20250115 10:12:04.622287 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a7e2086241df4b4fac5e481c5e8295a9 consensus state has no leader
I20250115 10:12:04.623019 4575 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.623081 4575 ts_tablet_manager.cc:1397] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:04.623247 4575 raft_consensus.cc:357] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.623317 4575 raft_consensus.cc:383] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.623347 4575 raft_consensus.cc:738] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.623405 4575 consensus_queue.cc:260] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.623449 4434 raft_consensus.cc:491] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.623499 4434 raft_consensus.cc:513] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.623533 4575 ts_tablet_manager.cc:1428] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.623607 4434 leader_election.cc:290] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.623628 4575 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.623826 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709a9b0953dd4b108825b663d703e609" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.623886 3415 raft_consensus.cc:2463] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.624132 4575 tablet_bootstrap.cc:654] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.624511 3484 leader_election.cc:304] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.624670 4434 raft_consensus.cc:2798] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.624699 4434 raft_consensus.cc:491] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.624676 4811 raft_consensus.cc:2798] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.624716 4434 raft_consensus.cc:3054] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.624744 4811 raft_consensus.cc:695] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.624799 4811 consensus_queue.cc:237] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.625370 4434 raft_consensus.cc:513] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.625504 4434 leader_election.cc:290] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.625537 4557 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.625577 4557 ts_tablet_manager.cc:1397] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s
I20250115 10:12:04.625773 4557 raft_consensus.cc:357] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.625844 4557 raft_consensus.cc:383] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.625864 4557 raft_consensus.cc:738] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.625895 4557 consensus_queue.cc:260] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.626008 4557 ts_tablet_manager.cc:1428] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.626083 4557 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.626152 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709a9b0953dd4b108825b663d703e609" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.626212 3415 raft_consensus.cc:3054] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.626394 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c5cf464dcd484191838d56253ded0b with delete_type TABLET_DATA_DELETED (replaced by tablet 28a8e280055c494f9fa2941940ea8ee5) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.626492 4557 tablet_bootstrap.cc:654] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.626962 3415 raft_consensus.cc:2463] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.627116 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 10c5cf464dcd484191838d56253ded0b with delete_type TABLET_DATA_DELETED (replaced by tablet 28a8e280055c494f9fa2941940ea8ee5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.627163 3484 leader_election.cc:304] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.627254 4887 raft_consensus.cc:2798] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.627305 4887 raft_consensus.cc:695] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:12:04.627351 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 10c5cf464dcd484191838d56253ded0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c5cf464dcd484191838d56253ded0b already in progress: creating tablet
I20250115 10:12:04.627347 4887 consensus_queue.cc:237] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.627494 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 10c5cf464dcd484191838d56253ded0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 10c5cf464dcd484191838d56253ded0b already in progress: creating tablet
I20250115 10:12:04.627538 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b9287005186640338ca0d5ebd19eaefe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.627636 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 11390ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:04.627679 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9287005186640338ca0d5ebd19eaefe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.627740 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_78585be9d5614cd7935cfdd44af23386"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.627856 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78585be9d5614cd7935cfdd44af23386 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.627883 4877 raft_consensus.cc:491] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.627928 4877 raft_consensus.cc:513] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.628010 4877 leader_election.cc:290] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.628038 4877 raft_consensus.cc:491] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.627861 4477 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_25fd90e569f543a08c37804c5c95dd31" } modify_external_catalogs: true
I20250115 10:12:04.628065 4877 raft_consensus.cc:513] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.628098 4477 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_25fd90e569f543a08c37804c5c95dd31" } modify_external_catalogs: true
I20250115 10:12:04.628151 4877 leader_election.cc:290] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.628259 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 8c045349a48644eda41ea8965b16174d from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.628232 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f0b943598bb7408d8d0306588e238317"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.628310 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0b943598bb7408d8d0306588e238317 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.628582 4475 catalog_manager.cc:5526] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.628666 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_14fa5aa998ee4f908cae7210960a689f [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 5 got 0
I20250115 10:12:04.628986 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.629027 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.629033 3411 raft_consensus.cc:3054] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.629153 3350 leader_election.cc:343] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:04.629990 4890 tablet.cc:1721] T 71c23863beb24d27b337fa039d7f04cd P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.630053 4575 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.630071 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5aa2546c19614c58aecd15fa26216c7d" } modify_external_catalogs: true
I20250115 10:12:04.630113 4575 ts_tablet_manager.cc:1397] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.630120 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5aa2546c19614c58aecd15fa26216c7d" } modify_external_catalogs: true
I20250115 10:12:04.620394 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8decec5964f14766b997192fbf4f7051 (table default.Table_db89e915c0324473bf6dfc46c3a3dbe2 [id=05d6c7181b804de9ac10c342612b7e2c]). Expected version 1 got 0
I20250115 10:12:04.631187 4575 raft_consensus.cc:357] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.631263 4575 raft_consensus.cc:383] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.631281 4575 raft_consensus.cc:738] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.631319 4575 consensus_queue.cc:260] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.631446 4575 ts_tablet_manager.cc:1428] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.631505 4575 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.631985 4575 tablet_bootstrap.cc:654] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.632160 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709a9b0953dd4b108825b663d703e609" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.632809 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "709a9b0953dd4b108825b663d703e609" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.632931 4877 raft_consensus.cc:491] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.632992 4877 raft_consensus.cc:513] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.633040 4477 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 7a9d422fdac347ff85eca778c29858e8
I20250115 10:12:04.633070 4877 leader_election.cc:290] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.633268 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9d422fdac347ff85eca778c29858e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.633356 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.633433 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 7a9d422fdac347ff85eca778c29858e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9d422fdac347ff85eca778c29858e8 already in progress: creating tablet
I20250115 10:12:04.633435 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9d422fdac347ff85eca778c29858e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.633674 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a9d422fdac347ff85eca778c29858e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.633828 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:04.633841 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.633828 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 7a9d422fdac347ff85eca778c29858e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9d422fdac347ff85eca778c29858e8 already in progress: creating tablet
I20250115 10:12:04.633909 3279 raft_consensus.cc:2463] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.634055 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 7a9d422fdac347ff85eca778c29858e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a9d422fdac347ff85eca778c29858e8 already in progress: creating tablet
I20250115 10:12:04.634654 3350 leader_election.cc:304] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.634723 3350 leader_election.cc:343] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.634806 4877 raft_consensus.cc:2798] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.634832 4877 raft_consensus.cc:491] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.634866 4877 raft_consensus.cc:3054] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.634886 4811 raft_consensus.cc:491] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.634928 4811 raft_consensus.cc:513] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.635010 4811 leader_election.cc:290] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.635349 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
W20250115 10:12:04.635536 3214 leader_election.cc:343] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.635533 4877 raft_consensus.cc:513] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.635576 3214 leader_election.cc:304] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.635628 4877 leader_election.cc:290] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.635670 3770 raft_consensus.cc:491] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.635702 3770 raft_consensus.cc:513] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.635833 3770 leader_election.cc:290] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.635867 3770 raft_consensus.cc:2743] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.635995 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
W20250115 10:12:04.636052 3485 leader_election.cc:343] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.636087 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817a8a975fea4da9a994e78f86da961f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.636139 3548 raft_consensus.cc:2463] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.636281 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 709a9b0953dd4b108825b663d703e609
I20250115 10:12:04.636252 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.636327 3550 raft_consensus.cc:2463] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.636511 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 709a9b0953dd4b108825b663d703e609 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.636576 4551 tablet_replica.cc:331] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.636632 4551 raft_consensus.cc:2238] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.636641 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 709a9b0953dd4b108825b663d703e609 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.636683 4551 pending_rounds.cc:62] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:12:04.636703 4551 pending_rounds.cc:69] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489547274002432 op_type: NO_OP noop_request { }
I20250115 10:12:04.636750 4551 raft_consensus.cc:2883] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:04.636775 4551 raft_consensus.cc:2267] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:04.636817 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 709a9b0953dd4b108825b663d703e609 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 709a9b0953dd4b108825b663d703e609 already in progress: creating tablet
I20250115 10:12:04.636252 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.636925 3215 leader_election.cc:304] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.636945 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 709a9b0953dd4b108825b663d703e609 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.637032 4592 tablet_replica.cc:331] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.637095 4592 raft_consensus.cc:2238] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.637128 4592 raft_consensus.cc:2267] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.637085 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.637199 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "766ddeab54194401aeb942516e42dc84" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.637250 3277 raft_consensus.cc:3054] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.637364 4592 ts_tablet_manager.cc:1905] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.637509 3350 leader_election.cc:343] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.637559 3350 leader_election.cc:304] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.637639 3350 leader_election.cc:343] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.637705 4877 raft_consensus.cc:2798] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.637750 4877 raft_consensus.cc:491] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.637784 4877 raft_consensus.cc:3054] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.637905 3277 raft_consensus.cc:2463] T 766ddeab54194401aeb942516e42dc84 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.638026 3770 raft_consensus.cc:2798] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.638052 3770 raft_consensus.cc:491] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.638069 3770 raft_consensus.cc:3054] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.638449 4877 raft_consensus.cc:513] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.638574 4877 leader_election.cc:290] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.638689 3770 raft_consensus.cc:513] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.638787 3770 leader_election.cc:290] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.638836 4592 ts_tablet_manager.cc:1918] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.638895 4592 log.cc:1198] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/709a9b0953dd4b108825b663d703e609
I20250115 10:12:04.638970 3350 leader_election.cc:304] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.639083 4592 ts_tablet_manager.cc:1939] T 709a9b0953dd4b108825b663d703e609 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.639098 4811 raft_consensus.cc:2798] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.639143 4811 raft_consensus.cc:695] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.639180 4811 consensus_queue.cc:237] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.639183 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.639257 3548 raft_consensus.cc:3054] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.639497 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817a8a975fea4da9a994e78f86da961f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.639472 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817a8a975fea4da9a994e78f86da961f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.639935 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a76df2d8b00c46949afac48a55d8200f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.640004 3276 raft_consensus.cc:2388] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:04.640076 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "817a8a975fea4da9a994e78f86da961f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.640136 3550 raft_consensus.cc:3054] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.640498 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 709a9b0953dd4b108825b663d703e609 (table default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]) successfully deleted
I20250115 10:12:04.640851 3550 raft_consensus.cc:2463] T 817a8a975fea4da9a994e78f86da961f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.641076 3215 leader_election.cc:304] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.641173 3952 raft_consensus.cc:2798] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.641212 3952 raft_consensus.cc:695] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.641254 3952 consensus_queue.cc:237] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.641523 4338 raft_consensus.cc:491] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.641568 4338 raft_consensus.cc:513] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.641669 4338 leader_election.cc:290] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.641862 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:04.641911 4475 catalog_manager.cc:5526] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:04.642127 3214 leader_election.cc:343] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.642210 3214 leader_election.cc:343] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.636129 3485 leader_election.cc:343] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.642897 3548 raft_consensus.cc:2463] T 7629a309511c4251b1e9ce231ef0fcf0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.642926 4473 catalog_manager.cc:5526] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.643119 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7629a309511c4251b1e9ce231ef0fcf0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.643180 3350 leader_election.cc:304] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.643250 3350 leader_election.cc:304] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.643296 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.643307 4714 raft_consensus.cc:2798] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.643429 4714 raft_consensus.cc:695] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.643463 4714 consensus_queue.cc:237] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.643620 4714 raft_consensus.cc:3054] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.644265 4714 raft_consensus.cc:2743] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.644374 4908 raft_consensus.cc:491] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.644416 4908 raft_consensus.cc:513] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.644526 4908 leader_election.cc:290] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.644654 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_0e55f165b11f4aedb199b7ce1f323765"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.644757 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e55f165b11f4aedb199b7ce1f323765 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.644882 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbb9cfc01df408eaae41b38e8c62c86" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.645112 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.645383 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.645586 3485 leader_election.cc:343] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.645771 3484 leader_election.cc:343] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.645819 3484 leader_election.cc:304] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.645918 4338 raft_consensus.cc:2743] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.646024 3214 leader_election.cc:343] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.646262 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.646437 3215 leader_election.cc:343] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.646502 3215 leader_election.cc:304] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.646884 3350 leader_election.cc:343] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.646951 3350 leader_election.cc:343] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.646973 3350 leader_election.cc:304] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.647384 4875 raft_consensus.cc:2743] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.647473 3770 raft_consensus.cc:2743] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.647907 4551 ts_tablet_manager.cc:1905] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.647996 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8f8ed6c47dab4975af3dbf9162b983da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.648108 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f8ed6c47dab4975af3dbf9162b983da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.649075 4569 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.649120 4569 ts_tablet_manager.cc:1397] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.000s
I20250115 10:12:04.649271 4569 raft_consensus.cc:357] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.649333 4569 raft_consensus.cc:383] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.649355 4569 raft_consensus.cc:738] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.649343 4551 ts_tablet_manager.cc:1918] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.649392 4551 log.cc:1198] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/709a9b0953dd4b108825b663d703e609
I20250115 10:12:04.649398 4569 consensus_queue.cc:260] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.649494 4569 ts_tablet_manager.cc:1428] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.649559 4569 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.649609 4551 ts_tablet_manager.cc:1939] T 709a9b0953dd4b108825b663d703e609 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.649869 4569 tablet_bootstrap.cc:654] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.650179 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 14cea13b41bd47faafe774471c4163dc from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.650556 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 709a9b0953dd4b108825b663d703e609 (table default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]) successfully deleted
I20250115 10:12:04.651083 4557 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.651129 4557 ts_tablet_manager.cc:1397] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.000s
I20250115 10:12:04.651263 4557 raft_consensus.cc:357] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.651322 4557 raft_consensus.cc:383] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.651341 4557 raft_consensus.cc:738] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.651391 4557 consensus_queue.cc:260] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.651533 4557 ts_tablet_manager.cc:1428] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.651620 4557 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.652500 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 28a8e280055c494f9fa2941940ea8ee5 (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.652639 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8e280055c494f9fa2941940ea8ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.652670 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc (DEFAULT_TABLE table=default.Table_f0b943598bb7408d8d0306588e238317 [id=eced63f78f4e48938a4088f50eeb92b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.652793 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.653045 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc (DEFAULT_TABLE table=default.Table_f0b943598bb7408d8d0306588e238317 [id=eced63f78f4e48938a4088f50eeb92b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.653119 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1 (DEFAULT_TABLE table=default.Table_78585be9d5614cd7935cfdd44af23386 [id=bda51d0712da4747ab93e949ca25afed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.653163 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 5d78203478b24c0490b5b3854df8674a (DEFAULT_TABLE table=default.Table_c4fdd4041cdf4d79919209b6c66dce68 [id=9128317d9cab42e6a64a7870d315e279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.653263 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 90c26daa75784e54bf2fdd2e6e40310f (DEFAULT_TABLE table=default.Table_b9287005186640338ca0d5ebd19eaefe [id=47875d040e984365ad7c702369d697b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.653136 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.653528 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d78203478b24c0490b5b3854df8674a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.654043 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 21e2a71f1a0145309b037e34f1b398d6 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.654147 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2a71f1a0145309b037e34f1b398d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.654242 4875 raft_consensus.cc:491] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.654290 4875 raft_consensus.cc:513] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.654378 4875 leader_election.cc:290] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.654572 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1 (DEFAULT_TABLE table=default.Table_78585be9d5614cd7935cfdd44af23386 [id=bda51d0712da4747ab93e949ca25afed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.654670 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.654711 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 28a8e280055c494f9fa2941940ea8ee5 (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.654831 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8e280055c494f9fa2941940ea8ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.655416 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 28a8e280055c494f9fa2941940ea8ee5 (DEFAULT_TABLE table=default.Table_7366f53944e44236ba5b92823f51d82b [id=8499b2cf0b6441f99165e236f6d4e875]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.655516 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a8e280055c494f9fa2941940ea8ee5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.655966 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 5d78203478b24c0490b5b3854df8674a (DEFAULT_TABLE table=default.Table_c4fdd4041cdf4d79919209b6c66dce68 [id=9128317d9cab42e6a64a7870d315e279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.656051 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d78203478b24c0490b5b3854df8674a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.652647 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 90c26daa75784e54bf2fdd2e6e40310f (DEFAULT_TABLE table=default.Table_b9287005186640338ca0d5ebd19eaefe [id=47875d040e984365ad7c702369d697b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.656348 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c26daa75784e54bf2fdd2e6e40310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.656769 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 21e2a71f1a0145309b037e34f1b398d6 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.656852 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2a71f1a0145309b037e34f1b398d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.657016 3246 tablet_service.cc:1467] Processing CreateTablet for tablet 90c26daa75784e54bf2fdd2e6e40310f (DEFAULT_TABLE table=default.Table_b9287005186640338ca0d5ebd19eaefe [id=47875d040e984365ad7c702369d697b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.657084 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c26daa75784e54bf2fdd2e6e40310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.657542 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c26daa75784e54bf2fdd2e6e40310f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.658049 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 21e2a71f1a0145309b037e34f1b398d6 (DEFAULT_TABLE table=default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.658138 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e2a71f1a0145309b037e34f1b398d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.652643 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1 (DEFAULT_TABLE table=default.Table_78585be9d5614cd7935cfdd44af23386 [id=bda51d0712da4747ab93e949ca25afed]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.658723 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.658929 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e09ea7c4dbd4d24add1a1ce02d187b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.659416 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.654678 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc (DEFAULT_TABLE table=default.Table_f0b943598bb7408d8d0306588e238317 [id=eced63f78f4e48938a4088f50eeb92b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.659837 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a70b8a287bd4de4adc6a0b4dcf528bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.654042 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 5d78203478b24c0490b5b3854df8674a (DEFAULT_TABLE table=default.Table_c4fdd4041cdf4d79919209b6c66dce68 [id=9128317d9cab42e6a64a7870d315e279]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.660154 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d78203478b24c0490b5b3854df8674a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.660683 4338 raft_consensus.cc:491] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.660746 4338 raft_consensus.cc:513] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.660818 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.661154 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.661255 4699 raft_consensus.cc:491] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:04.661268 3350 leader_election.cc:343] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.661293 4699 raft_consensus.cc:513] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.661394 4699 leader_election.cc:290] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.661428 4699 consensus_queue.cc:1035] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.661495 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_12b3dd12cf7b4430845719cf71bdbb89" } modify_external_catalogs: true
I20250115 10:12:04.661554 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_12b3dd12cf7b4430845719cf71bdbb89" } modify_external_catalogs: true
I20250115 10:12:04.661669 4887 raft_consensus.cc:491] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.661701 4887 raft_consensus.cc:513] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.661760 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_bb295f9a75134872a9c2e24d38b7c80c" } modify_external_catalogs: true
I20250115 10:12:04.661792 4887 leader_election.cc:290] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.661810 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_bb295f9a75134872a9c2e24d38b7c80c" } modify_external_catalogs: true
I20250115 10:12:04.661880 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.662298 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.662359 3548 raft_consensus.cc:2463] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.662447 3350 leader_election.cc:343] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.662493 3350 leader_election.cc:304] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.662782 4587 raft_consensus.cc:2743] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.662887 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.663724 4587 raft_consensus.cc:491] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.663769 4587 raft_consensus.cc:513] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.663863 4587 leader_election.cc:290] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.664026 3350 leader_election.cc:343] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.664068 3411 raft_consensus.cc:3054] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.664096 3484 leader_election.cc:343] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.664180 3484 consensus_peers.cc:487] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.664304 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.664362 3548 raft_consensus.cc:2463] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.664431 3350 leader_election.cc:304] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.664530 4811 raft_consensus.cc:2798] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.664570 4811 raft_consensus.cc:491] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.664595 4811 raft_consensus.cc:3054] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.664662 3350 leader_election.cc:304] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.664754 4877 raft_consensus.cc:2798] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.664790 4877 raft_consensus.cc:491] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.664809 4877 raft_consensus.cc:3054] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.664927 4890 tablet.cc:1721] T 4cbd61aec79d479d9eea8d807cd5fb0e P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.664032 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.665256 4811 raft_consensus.cc:513] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.665360 4811 leader_election.cc:290] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.665467 3485 leader_election.cc:343] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.665454 4877 raft_consensus.cc:513] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.665509 3485 leader_election.cc:304] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.665547 4877 leader_election.cc:290] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.665586 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.665656 3276 raft_consensus.cc:2463] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.666046 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 14cea13b41bd47faafe774471c4163dc
I20250115 10:12:04.666097 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:04.666090 4434 raft_consensus.cc:2743] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.666129 4474 catalog_manager.cc:6596] ReplaceTablet: tablet 14cea13b41bd47faafe774471c4163dc deleted and replaced by tablet 689207c595a4465fac76333b8ecb0a11
I20250115 10:12:04.666150 4434 raft_consensus.cc:491] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.666177 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:04.666179 4434 raft_consensus.cc:513] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.666276 4434 leader_election.cc:290] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.666344 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.666380 3548 raft_consensus.cc:3054] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.666360 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec3c400b50a4c8b9c490158732582f5" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.666425 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.666492 3547 raft_consensus.cc:3054] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.667078 3548 raft_consensus.cc:2463] T 4ec3c400b50a4c8b9c490158732582f5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.667161 3547 raft_consensus.cc:2463] T f3cba581c6884fd98503d4883b09d4a6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.667233 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3cba581c6884fd98503d4883b09d4a6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.667292 3280 raft_consensus.cc:3054] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.667335 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 14cea13b41bd47faafe774471c4163dc with delete_type TABLET_DATA_DELETED (replaced by tablet 689207c595a4465fac76333b8ecb0a11) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.667359 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.667340 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.667636 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 14cea13b41bd47faafe774471c4163dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14cea13b41bd47faafe774471c4163dc already in progress: creating tablet
W20250115 10:12:04.667698 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 4ae4f2e19e4443b38430cdb95bd82f91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4ae4f2e19e4443b38430cdb95bd82f91 already in progress: creating tablet
I20250115 10:12:04.667892 3350 leader_election.cc:304] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.667975 3350 leader_election.cc:304] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:04.667974 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet d3326a9a37a64e9a9485e5abadc2e493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3326a9a37a64e9a9485e5abadc2e493 already in progress: creating tablet
W20250115 10:12:04.668066 3350 leader_election.cc:343] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.668063 4811 raft_consensus.cc:2798] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.668147 4811 raft_consensus.cc:695] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.668207 4811 consensus_queue.cc:237] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.668231 4877 raft_consensus.cc:2798] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.668282 4877 raft_consensus.cc:695] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.668321 4877 consensus_queue.cc:237] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.668586 4434 raft_consensus.cc:491] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.668628 4434 raft_consensus.cc:513] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.668722 4434 leader_election.cc:290] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.668888 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ab498e7789d4ae18a9f62be2fa2514a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.668967 4551 tablet_replica.cc:331] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.669028 4551 raft_consensus.cc:2238] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.669063 4551 raft_consensus.cc:2267] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.660841 4338 leader_election.cc:290] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.669142 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.669431 4575 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.669466 4575 ts_tablet_manager.cc:1397] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.001s
I20250115 10:12:04.669489 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:04.669593 4575 raft_consensus.cc:357] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.669638 4575 raft_consensus.cc:383] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.669654 4575 raft_consensus.cc:738] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.669700 4575 consensus_queue.cc:260] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.669791 4575 ts_tablet_manager.cc:1428] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.669852 4575 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.670221 3387 tablet_service.cc:1514] Processing DeleteTablet for tablet 14cea13b41bd47faafe774471c4163dc with delete_type TABLET_DATA_DELETED (replaced by tablet 689207c595a4465fac76333b8ecb0a11) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.670259 4587 raft_consensus.cc:491] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.670230 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.670326 4587 raft_consensus.cc:513] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.670258 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.670408 4587 leader_election.cc:290] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.670424 4592 tablet_replica.cc:331] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.670313 4575 tablet_bootstrap.cc:654] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.670644 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.670691 3484 leader_election.cc:343] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.670729 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.670475 4592 raft_consensus.cc:2238] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.670778 3415 raft_consensus.cc:2388] T d5419822600e463a9efb81ad86a10292 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:04.670827 4592 pending_rounds.cc:62] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Trying to abort 1 pending ops.
I20250115 10:12:04.670845 4592 pending_rounds.cc:69] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489547122683904 op_type: NO_OP noop_request { }
I20250115 10:12:04.670881 4592 raft_consensus.cc:2883] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:04.670904 4592 raft_consensus.cc:2267] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.670933 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d8167b34064888be6e4df4dfde0b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.670989 3276 raft_consensus.cc:2463] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.671064 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:04.671156 3350 leader_election.cc:304] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.671399 3484 leader_election.cc:343] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.671468 3485 leader_election.cc:343] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.671519 3485 leader_election.cc:304] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.671564 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 14cea13b41bd47faafe774471c4163dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14cea13b41bd47faafe774471c4163dc already in progress: creating tablet
I20250115 10:12:04.671579 4699 raft_consensus.cc:2798] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.671639 4699 raft_consensus.cc:491] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.671658 4699 raft_consensus.cc:3054] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.671649 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet d3326a9a37a64e9a9485e5abadc2e493 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3326a9a37a64e9a9485e5abadc2e493 already in progress: creating tablet
I20250115 10:12:04.672142 4592 ts_tablet_manager.cc:1905] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.672288 4699 raft_consensus.cc:513] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.672374 4699 leader_election.cc:290] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.672933 4887 raft_consensus.cc:2743] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.673488 4592 ts_tablet_manager.cc:1918] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.673534 4592 log.cc:1198] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:04.673748 4592 ts_tablet_manager.cc:1939] T 4ae4f2e19e4443b38430cdb95bd82f91 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.673966 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d8b9b77af56542d1a93a82544aa28c39 (DEFAULT_TABLE table=default.Table_8f8ed6c47dab4975af3dbf9162b983da [id=36161ea2bbb24798a01f2cc101c684a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.674072 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9b77af56542d1a93a82544aa28c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.674042 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.674127 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d8167b34064888be6e4df4dfde0b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.674189 3279 raft_consensus.cc:3054] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.674822 3279 raft_consensus.cc:2463] T 87d8167b34064888be6e4df4dfde0b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.674939 3258 tablet_service.cc:1467] Processing CreateTablet for tablet b9a809be013645bf8cabb02d6b6d7da4 (DEFAULT_TABLE table=default.Table_0e55f165b11f4aedb199b7ce1f323765 [id=a2886a1ebd31451ea2cccc319eafb7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.675025 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a809be013645bf8cabb02d6b6d7da4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.675045 3485 leader_election.cc:343] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.675084 3485 leader_election.cc:304] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.675149 4887 raft_consensus.cc:2743] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.675252 3530 tablet_service.cc:1467] Processing CreateTablet for tablet b9a809be013645bf8cabb02d6b6d7da4 (DEFAULT_TABLE table=default.Table_0e55f165b11f4aedb199b7ce1f323765 [id=a2886a1ebd31451ea2cccc319eafb7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.675333 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a809be013645bf8cabb02d6b6d7da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.675606 3280 raft_consensus.cc:2463] T f3cba581c6884fd98503d4883b09d4a6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.676460 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d8167b34064888be6e4df4dfde0b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.676551 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5419822600e463a9efb81ad86a10292" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.676916 4887 raft_consensus.cc:491] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.676962 4887 raft_consensus.cc:513] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.677071 4557 tablet_bootstrap.cc:654] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.677193 3350 leader_election.cc:343] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.677244 3350 leader_election.cc:304] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.677315 4699 raft_consensus.cc:2798] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.677376 4699 raft_consensus.cc:695] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.677417 4699 consensus_queue.cc:237] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.677484 4569 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.677531 4569 ts_tablet_manager.cc:1397] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.000s
I20250115 10:12:04.677623 3381 tablet_service.cc:1467] Processing CreateTablet for tablet d8b9b77af56542d1a93a82544aa28c39 (DEFAULT_TABLE table=default.Table_8f8ed6c47dab4975af3dbf9162b983da [id=36161ea2bbb24798a01f2cc101c684a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.677673 4569 raft_consensus.cc:357] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.677717 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9b77af56542d1a93a82544aa28c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.677735 4569 raft_consensus.cc:383] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.677758 4569 raft_consensus.cc:738] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.677803 4569 consensus_queue.cc:260] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.677840 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.677915 4569 ts_tablet_manager.cc:1428] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.677999 4569 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.678232 3485 leader_election.cc:304] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.678263 4569 tablet_bootstrap.cc:654] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.678306 4338 raft_consensus.cc:3054] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.678507 3484 leader_election.cc:343] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.678500 3386 tablet_service.cc:1467] Processing CreateTablet for tablet b9a809be013645bf8cabb02d6b6d7da4 (DEFAULT_TABLE table=default.Table_0e55f165b11f4aedb199b7ce1f323765 [id=a2886a1ebd31451ea2cccc319eafb7b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.678584 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9a809be013645bf8cabb02d6b6d7da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.678897 4338 raft_consensus.cc:2743] T d5419822600e463a9efb81ad86a10292 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.677078 4887 leader_election.cc:290] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.679080 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.679215 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87d8167b34064888be6e4df4dfde0b31" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.679471 3350 leader_election.cc:343] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.679589 3485 leader_election.cc:343] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.679630 3485 leader_election.cc:304] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.679713 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ae4f2e19e4443b38430cdb95bd82f91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.679811 4589 tablet_replica.cc:331] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.679862 4589 raft_consensus.cc:2238] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.679893 4589 raft_consensus.cc:2267] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.679895 4887 raft_consensus.cc:2743] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.680007 3241 tablet_service.cc:1467] Processing CreateTablet for tablet d8b9b77af56542d1a93a82544aa28c39 (DEFAULT_TABLE table=default.Table_8f8ed6c47dab4975af3dbf9162b983da [id=36161ea2bbb24798a01f2cc101c684a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.680111 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b9b77af56542d1a93a82544aa28c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.680142 4589 ts_tablet_manager.cc:1905] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.681236 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4b98590d43434ddb8446bd4c522dee69" } modify_external_catalogs: true
I20250115 10:12:04.681305 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4b98590d43434ddb8446bd4c522dee69" } modify_external_catalogs: true
I20250115 10:12:04.681481 4589 ts_tablet_manager.cc:1918] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.681520 4589 log.cc:1198] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:04.681650 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 4ae4f2e19e4443b38430cdb95bd82f91 (table default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]) successfully deleted
I20250115 10:12:04.681672 4589 ts_tablet_manager.cc:1939] T 4ae4f2e19e4443b38430cdb95bd82f91 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.681692 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 14cea13b41bd47faafe774471c4163dc with delete_type TABLET_DATA_DELETED (replaced by tablet 689207c595a4465fac76333b8ecb0a11) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.681747 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.681910 4589 tablet_replica.cc:331] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.681973 4589 raft_consensus.cc:2238] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.682005 4589 raft_consensus.cc:2267] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.682152 4557 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.682202 4557 ts_tablet_manager.cc:1397] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.001s
I20250115 10:12:04.682329 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 4ae4f2e19e4443b38430cdb95bd82f91 (table default.Table_bb295f9a75134872a9c2e24d38b7c80c [id=5c517c1388a541f4afd6a0a79092e986]) successfully deleted
I20250115 10:12:04.682363 4557 raft_consensus.cc:357] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.682394 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 14cea13b41bd47faafe774471c4163dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14cea13b41bd47faafe774471c4163dc already in progress: creating tablet
I20250115 10:12:04.682415 4557 raft_consensus.cc:383] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.682435 4557 raft_consensus.cc:738] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.682473 4557 consensus_queue.cc:260] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.682579 4557 ts_tablet_manager.cc:1428] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.682575 4589 ts_tablet_manager.cc:1905] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.682693 4557 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.682847 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 689207c595a4465fac76333b8ecb0a11 (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.682838 4468 catalog_manager.cc:5526] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.682945 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689207c595a4465fac76333b8ecb0a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.682969 4887 raft_consensus.cc:491] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.683007 4887 raft_consensus.cc:513] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.683524 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 689207c595a4465fac76333b8ecb0a11 (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.683629 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689207c595a4465fac76333b8ecb0a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.683885 4589 ts_tablet_manager.cc:1918] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.683923 4589 log.cc:1198] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:04.684067 4589 ts_tablet_manager.cc:1939] T d3326a9a37a64e9a9485e5abadc2e493 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.684580 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 2d30f49da63241a2a794a7a18e026473 (table default.Table_2f418c5b15134aa58e94ad53b68ba2b2 [id=a5da5f258250489a9d39ce2b87fc1a86]). Expected version 1 got 0
I20250115 10:12:04.684886 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.685158 3484 leader_election.cc:343] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.685283 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]) successfully deleted
I20250115 10:12:04.685432 4569 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.685487 4569 ts_tablet_manager.cc:1397] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:04.685492 4575 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.685539 4575 ts_tablet_manager.cc:1397] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.000s
I20250115 10:12:04.685598 4569 raft_consensus.cc:357] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.685659 4569 raft_consensus.cc:383] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:04.685658 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:04.685640 4575 raft_consensus.cc:357] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.685683 4569 raft_consensus.cc:738] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.685658 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 689207c595a4465fac76333b8ecb0a11 (DEFAULT_TABLE table=default.Table_cc03dd32d9d440339095b8814765158f [id=bb65578a836b4bc093bc6af79ccef1e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.685705 4575 raft_consensus.cc:383] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.685755 4575 raft_consensus.cc:738] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.685742 4569 consensus_queue.cc:260] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.685782 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689207c595a4465fac76333b8ecb0a11. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.685801 4575 consensus_queue.cc:260] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.685874 4569 ts_tablet_manager.cc:1428] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.685906 4575 ts_tablet_manager.cc:1428] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.685948 4569 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.686370 4569 tablet_bootstrap.cc:654] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.686503 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9077d0eed1974bc898370b5d5554be71
I20250115 10:12:04.686879 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 9077d0eed1974bc898370b5d5554be71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.687114 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 9077d0eed1974bc898370b5d5554be71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.687345 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 9077d0eed1974bc898370b5d5554be71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9077d0eed1974bc898370b5d5554be71 already in progress: creating tablet
I20250115 10:12:04.687775 4887 leader_election.cc:290] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.688220 4557 tablet_bootstrap.cc:654] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.688753 4575 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.689071 4575 tablet_bootstrap.cc:654] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.689134 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.689229 4557 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.689302 4557 ts_tablet_manager.cc:1397] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.689431 4557 raft_consensus.cc:357] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.689469 5156 raft_consensus.cc:491] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.689489 4557 raft_consensus.cc:383] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.689512 4557 raft_consensus.cc:738] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.689517 5156 raft_consensus.cc:513] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.689563 4557 consensus_queue.cc:260] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.689643 5156 leader_election.cc:290] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.689671 4557 ts_tablet_manager.cc:1428] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.689723 4587 raft_consensus.cc:491] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.689749 4557 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.689769 4587 raft_consensus.cc:513] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.689867 4587 leader_election.cc:290] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.689918 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.690044 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.690093 3276 raft_consensus.cc:2463] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.690140 4557 tablet_bootstrap.cc:654] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.690248 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.690274 3350 leader_election.cc:304] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.690342 4587 raft_consensus.cc:2798] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.690371 4587 raft_consensus.cc:491] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.690389 4587 raft_consensus.cc:3054] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.690462 3214 leader_election.cc:343] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.690567 3350 leader_election.cc:343] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.691012 4587 raft_consensus.cc:513] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.691099 4587 leader_election.cc:290] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.691315 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 9077d0eed1974bc898370b5d5554be71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.691478 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 9077d0eed1974bc898370b5d5554be71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9077d0eed1974bc898370b5d5554be71 already in progress: creating tablet
W20250115 10:12:04.691625 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
W20250115 10:12:04.691668 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:04.691720 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:04.691762 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.691802 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:04.691857 4587 raft_consensus.cc:491] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.691840 4468 catalog_manager.cc:5526] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.691895 4587 raft_consensus.cc:513] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.691967 4587 leader_election.cc:290] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.692224 4551 ts_tablet_manager.cc:1905] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:04.692445 3215 leader_election.cc:343] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.692492 3215 leader_election.cc:304] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.692881 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3dd43785e2541d8be54b6ca339a754d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.692957 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.693208 3350 leader_election.cc:343] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.693274 3350 leader_election.cc:343] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.693522 4908 raft_consensus.cc:2743] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.693540 3485 leader_election.cc:343] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.693554 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3dd43785e2541d8be54b6ca339a754d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.693578 3485 leader_election.cc:304] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.693604 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.693652 3276 raft_consensus.cc:3054] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.693799 4887 raft_consensus.cc:2743] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.693609 3280 raft_consensus.cc:2463] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.694329 3276 raft_consensus.cc:2463] T 707f0e47915e4a8998a97a8680394e5d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.694478 3350 leader_election.cc:304] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.694567 4887 raft_consensus.cc:491] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.694571 4587 raft_consensus.cc:2798] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.694608 4587 raft_consensus.cc:491] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.694629 4587 raft_consensus.cc:3054] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.694609 4887 raft_consensus.cc:513] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.694710 4887 leader_election.cc:290] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.694770 4551 ts_tablet_manager.cc:1918] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.694813 4551 log.cc:1198] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/4ab498e7789d4ae18a9f62be2fa2514a
I20250115 10:12:04.694908 3350 leader_election.cc:304] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.694970 4551 ts_tablet_manager.cc:1939] T 4ab498e7789d4ae18a9f62be2fa2514a P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.695010 4699 raft_consensus.cc:2798] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.695062 4699 raft_consensus.cc:695] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.695104 4699 consensus_queue.cc:237] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.695269 4587 raft_consensus.cc:513] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.695380 4587 leader_election.cc:290] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.695498 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.695789 4569 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.695847 4569 ts_tablet_manager.cc:1397] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.000s
W20250115 10:12:04.695899 3484 leader_election.cc:343] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.695992 4569 raft_consensus.cc:357] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.696064 4569 raft_consensus.cc:383] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.696090 4569 raft_consensus.cc:738] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.696138 4569 consensus_queue.cc:260] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.696252 4569 ts_tablet_manager.cc:1428] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.696295 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 4ab498e7789d4ae18a9f62be2fa2514a (table default.Table_a4459dffa0e14dabb6ee831ff6dc3b2d [id=3f819a2f66024ccdba073693bac2ee02]) successfully deleted
I20250115 10:12:04.696354 4569 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.696372 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9077d0eed1974bc898370b5d5554be71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9077d0eed1974bc898370b5d5554be71 already in progress: creating tablet
I20250115 10:12:04.696683 3770 raft_consensus.cc:491] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.696712 4569 tablet_bootstrap.cc:654] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.696743 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.697111 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3dd43785e2541d8be54b6ca339a754d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.697175 3276 raft_consensus.cc:3054] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.697484 3485 leader_election.cc:343] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.697515 4557 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.697574 4557 ts_tablet_manager.cc:1397] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.696723 3770 raft_consensus.cc:513] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.697712 3770 leader_election.cc:290] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.697710 4557 raft_consensus.cc:357] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.697755 3276 raft_consensus.cc:2463] T e3dd43785e2541d8be54b6ca339a754d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.697782 4557 raft_consensus.cc:383] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.697808 4557 raft_consensus.cc:738] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.697849 4557 consensus_queue.cc:260] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.697918 3770 raft_consensus.cc:491] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.697947 4557 ts_tablet_manager.cc:1428] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.697960 3770 raft_consensus.cc:513] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.698056 3770 leader_election.cc:290] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.698196 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3dd43785e2541d8be54b6ca339a754d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.698285 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.698424 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.697525 3485 leader_election.cc:304] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.698518 3214 leader_election.cc:343] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.698577 3214 leader_election.cc:343] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.698769 4569 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.698761 4338 raft_consensus.cc:2743] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.698818 4569 ts_tablet_manager.cc:1397] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.698834 4468 catalog_manager.cc:5526] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.698937 4569 raft_consensus.cc:357] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.698982 4569 raft_consensus.cc:383] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.698997 4569 raft_consensus.cc:738] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.699023 4569 consensus_queue.cc:260] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.699098 4569 ts_tablet_manager.cc:1428] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.699141 4569 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.699229 3350 leader_election.cc:304] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.699296 3350 leader_election.cc:343] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.699373 4875 raft_consensus.cc:2798] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.699410 4875 raft_consensus.cc:695] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.699470 4569 tablet_bootstrap.cc:654] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.699446 4875 consensus_queue.cc:237] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.700491 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.700594 4589 tablet_replica.cc:331] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.700639 4589 raft_consensus.cc:2238] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.700666 4589 raft_consensus.cc:2267] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.700713 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.700855 4589 ts_tablet_manager.cc:1905] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.702507 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.703044 4575 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.703090 4575 ts_tablet_manager.cc:1397] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.000s
I20250115 10:12:04.703229 4575 raft_consensus.cc:357] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.703275 4575 raft_consensus.cc:383] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.703290 4575 raft_consensus.cc:738] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.703321 4575 consensus_queue.cc:260] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.703415 4575 ts_tablet_manager.cc:1428] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.703481 4877 raft_consensus.cc:491] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.703547 4877 raft_consensus.cc:513] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.703649 4877 leader_election.cc:290] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.702546 4557 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.703905 3215 leader_election.cc:343] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.703953 3215 leader_election.cc:304] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.703956 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.704041 3215 leader_election.cc:343] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.704067 3276 raft_consensus.cc:2463] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.704160 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.704191 4557 tablet_bootstrap.cc:654] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.704420 3350 leader_election.cc:343] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.704674 3770 raft_consensus.cc:2743] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.704834 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5b7d88e0e73a4f9884ba4c9d5afb82d8" } new_table_name: "default.Table_f61276eb8fc0490ebc9173121ee37c34" modify_external_catalogs: true
I20250115 10:12:04.705075 4557 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.705125 4557 ts_tablet_manager.cc:1397] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.705260 4557 raft_consensus.cc:357] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.705344 4557 raft_consensus.cc:383] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.705358 4338 consensus_queue.cc:1035] T d07f6f091ee847e49d1c64bee583a7a4 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.703481 4575 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.704069 3215 leader_election.cc:304] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.705906 3770 raft_consensus.cc:2743] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.706014 3350 leader_election.cc:304] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.706100 4587 raft_consensus.cc:2798] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.706137 4587 raft_consensus.cc:491] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.706161 4587 raft_consensus.cc:3054] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.706212 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet 0b401233481b445bbf0f394083719ed1 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.706818 4587 raft_consensus.cc:513] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.706924 4587 leader_election.cc:290] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.707194 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.707248 3279 raft_consensus.cc:3054] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.707239 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.705368 4557 raft_consensus.cc:738] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.707602 4557 consensus_queue.cc:260] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.707767 4557 ts_tablet_manager.cc:1428] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.707842 4557 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.707958 3279 raft_consensus.cc:2463] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:04.708212 3350 leader_election.cc:343] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.708243 4557 tablet_bootstrap.cc:654] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.708860 4557 tablet_bootstrap.cc:492] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.708907 4557 ts_tablet_manager.cc:1397] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.709121 4557 raft_consensus.cc:357] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.709177 4557 raft_consensus.cc:383] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.709193 4557 raft_consensus.cc:738] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.709229 4557 consensus_queue.cc:260] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.709304 4557 ts_tablet_manager.cc:1428] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.709255 4468 catalog_manager.cc:5526] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.709367 4557 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.710016 4557 tablet_bootstrap.cc:654] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.710958 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:04.711416 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:04.711557 3350 leader_election.cc:304] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.711966 4877 raft_consensus.cc:2798] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.712052 4877 raft_consensus.cc:695] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.712095 4877 consensus_queue.cc:237] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.712689 3214 consensus_peers.cc:487] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.712795 4589 ts_tablet_manager.cc:1918] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.712854 4589 log.cc:1198] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3fecca0f91e04702b438c9639303fac2
I20250115 10:12:04.712982 4569 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.713030 4589 ts_tablet_manager.cc:1939] T 3fecca0f91e04702b438c9639303fac2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.713022 4569 ts_tablet_manager.cc:1397] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:04.713344 3952 raft_consensus.cc:491] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.713357 4569 raft_consensus.cc:357] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.713392 3952 raft_consensus.cc:513] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.713423 4569 raft_consensus.cc:383] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.713440 4569 raft_consensus.cc:738] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.713465 3952 leader_election.cc:290] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.713471 4569 consensus_queue.cc:260] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.713557 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3fecca0f91e04702b438c9639303fac2 (table default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]) successfully deleted
I20250115 10:12:04.713593 4569 ts_tablet_manager.cc:1428] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.713654 4569 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.714037 4569 tablet_bootstrap.cc:654] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.714710 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.715629 4569 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.715670 4569 ts_tablet_manager.cc:1397] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
W20250115 10:12:04.715804 3215 leader_election.cc:343] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.715791 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.715888 4569 raft_consensus.cc:357] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.715943 4569 raft_consensus.cc:383] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.715961 4569 raft_consensus.cc:738] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.715994 4569 consensus_queue.cc:260] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.716071 4569 ts_tablet_manager.cc:1428] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.716118 4569 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.716681 4569 tablet_bootstrap.cc:654] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.716810 4575 tablet_bootstrap.cc:654] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.717121 3214 leader_election.cc:343] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.717157 3214 leader_election.cc:304] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.717232 3952 raft_consensus.cc:491] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.717258 3952 raft_consensus.cc:513] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.717361 3952 leader_election.cc:290] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.717391 3952 raft_consensus.cc:2743] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.717684 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.717885 3215 leader_election.cc:343] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.718139 4890 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20250115 10:12:04.718156 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:04.718297 4662 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:04.718277 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.718442 3276 raft_consensus.cc:1270] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 25d7e460cb6d4ddabf387dc672cc26b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250115 10:12:04.718475 3214 leader_election.cc:343] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.718498 3350 consensus_peers.cc:487] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.718508 3214 leader_election.cc:304] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.718755 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:04.719038 4557 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.719074 5156 raft_consensus.cc:2743] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.719089 4557 ts_tablet_manager.cc:1397] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.000s
I20250115 10:12:04.719244 4557 raft_consensus.cc:357] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.719260 4587 consensus_queue.cc:1035] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.719305 4557 raft_consensus.cc:383] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.719326 4557 raft_consensus.cc:738] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.719420 4569 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.719394 4557 consensus_queue.cc:260] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.719455 4569 ts_tablet_manager.cc:1397] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.719568 4557 ts_tablet_manager.cc:1428] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.719586 4569 raft_consensus.cc:357] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.719640 4569 raft_consensus.cc:383] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.719648 4557 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.719663 4569 raft_consensus.cc:738] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.719703 4569 consensus_queue.cc:260] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.719826 4569 ts_tablet_manager.cc:1428] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.719887 4569 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.720098 4557 tablet_bootstrap.cc:654] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.720273 4569 tablet_bootstrap.cc:654] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.720922 4575 tablet_bootstrap.cc:492] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.720970 4575 ts_tablet_manager.cc:1397] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250115 10:12:04.721100 4575 raft_consensus.cc:357] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.721146 4575 raft_consensus.cc:383] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.721163 4575 raft_consensus.cc:738] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.721176 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]). Expected version 1 got 0
I20250115 10:12:04.721196 4575 consensus_queue.cc:260] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.721278 4575 ts_tablet_manager.cc:1428] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.721328 4575 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.721544 4575 tablet_bootstrap.cc:654] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.722312 4587 raft_consensus.cc:491] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.722369 4587 raft_consensus.cc:513] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.722481 4587 leader_election.cc:290] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.722676 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.722666 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.722749 3279 raft_consensus.cc:2463] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.722893 3350 leader_election.cc:304] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.723047 4587 raft_consensus.cc:2798] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.723104 4587 raft_consensus.cc:491] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.723127 4587 raft_consensus.cc:3054] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.723060 3350 leader_election.cc:343] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.723858 4587 raft_consensus.cc:513] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.723940 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_f61276eb8fc0490ebc9173121ee37c34 [id=b9a846c94c034630930c3a4bc001f20b] alter complete (version 2)
I20250115 10:12:04.723966 4587 leader_election.cc:290] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.724129 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.724133 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63980fabd5634bf39c41215740cd4d72" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.724184 3279 raft_consensus.cc:3054] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.724870 3279 raft_consensus.cc:2463] T 63980fabd5634bf39c41215740cd4d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:04.725013 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:04.725061 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_14fa5aa998ee4f908cae7210960a689f [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 5 got 0
I20250115 10:12:04.725080 3350 leader_election.cc:304] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.725136 3350 leader_election.cc:343] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.725181 4587 raft_consensus.cc:2798] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.725255 4587 raft_consensus.cc:695] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.725317 4587 consensus_queue.cc:237] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.726112 4434 raft_consensus.cc:491] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.726166 4434 raft_consensus.cc:513] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.726193 4475 catalog_manager.cc:5526] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.726281 4434 leader_election.cc:290] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.726300 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 1 got 0
I20250115 10:12:04.726675 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.726871 3484 leader_election.cc:343] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.727300 4557 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.727342 4557 ts_tablet_manager.cc:1397] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:04.727507 4557 raft_consensus.cc:357] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.727509 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.727567 4557 raft_consensus.cc:383] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.727587 4557 raft_consensus.cc:738] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.727627 4557 consensus_queue.cc:260] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.727741 4557 ts_tablet_manager.cc:1428] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.727814 4557 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.728086 4557 tablet_bootstrap.cc:654] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.728473 3770 consensus_queue.cc:1035] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.729168 3485 leader_election.cc:343] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.729188 3952 raft_consensus.cc:491] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:04.729207 3485 leader_election.cc:304] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.729224 3952 raft_consensus.cc:513] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.729319 3952 leader_election.cc:290] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.729365 4433 raft_consensus.cc:2743] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.729539 3215 leader_election.cc:343] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4db40559d7894bb8b80cf27b546c8f56
W20250115 10:12:04.730059 3214 leader_election.cc:343] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 4db40559d7894bb8b80cf27b546c8f56
I20250115 10:12:04.730108 3214 leader_election.cc:304] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.730203 3770 raft_consensus.cc:2743] T 4db40559d7894bb8b80cf27b546c8f56 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:04.730223 4575 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.730265 4575 ts_tablet_manager.cc:1397] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:04.730368 4575 raft_consensus.cc:357] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.730432 4575 raft_consensus.cc:383] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.730450 4575 raft_consensus.cc:738] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.730489 4575 consensus_queue.cc:260] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.730585 4575 ts_tablet_manager.cc:1428] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.730649 4575 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.730887 4575 tablet_bootstrap.cc:654] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.731880 4890 tablet.cc:1721] T 497adb74fac84c1cb438ea6ba4adf211 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.732059 4662 tablet.cc:1721] T 497adb74fac84c1cb438ea6ba4adf211 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20250115 10:12:04.732520 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 497adb74fac84c1cb438ea6ba4adf211 (table default.Table_14fa5aa998ee4f908cae7210960a689f [id=c3e4a9a5f0cb44bb84722372262f7e8d]). Expected version 5 got 0
I20250115 10:12:04.733126 4569 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.733167 4569 ts_tablet_manager.cc:1397] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:12:04.733309 4569 raft_consensus.cc:357] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.733364 4569 raft_consensus.cc:383] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.733389 4569 raft_consensus.cc:738] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.733424 4569 consensus_queue.cc:260] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.733526 4569 ts_tablet_manager.cc:1428] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.733572 4569 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.733929 4569 tablet_bootstrap.cc:654] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.734597 4569 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.734642 4569 ts_tablet_manager.cc:1397] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.734954 4569 raft_consensus.cc:357] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.735005 4557 tablet_bootstrap.cc:492] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.735019 4569 raft_consensus.cc:383] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.735044 4557 ts_tablet_manager.cc:1397] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:04.735047 4569 raft_consensus.cc:738] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.735090 4569 consensus_queue.cc:260] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.735154 4557 raft_consensus.cc:357] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.735181 4569 ts_tablet_manager.cc:1428] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.735210 4557 raft_consensus.cc:383] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.735234 4557 raft_consensus.cc:738] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.735236 4569 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.735280 4557 consensus_queue.cc:260] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.735384 4557 ts_tablet_manager.cc:1428] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.735445 4557 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.735659 4433 raft_consensus.cc:491] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.735694 4569 tablet_bootstrap.cc:654] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.735731 4433 raft_consensus.cc:513] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.735847 4433 leader_election.cc:290] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.735899 4433 raft_consensus.cc:491] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.735956 4433 raft_consensus.cc:513] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.736028 4433 leader_election.cc:290] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.736354 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb353ea066dc474cac07e3adcfa6574d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.736470 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.736609 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:12:04.736735 4877 raft_consensus.cc:491] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.736788 4877 raft_consensus.cc:513] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.736842 4557 tablet_bootstrap.cc:654] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.736898 4877 leader_election.cc:290] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.737015 3484 leader_election.cc:343] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.737160 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57d3800d79794d3bad6c50d2dc8e9258" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.737236 3276 raft_consensus.cc:2388] T 57d3800d79794d3bad6c50d2dc8e9258 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.737298 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.737291 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.737334 3280 raft_consensus.cc:2463] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.737390 4475 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_14fa5aa998ee4f908cae7210960a689f [id=c3e4a9a5f0cb44bb84722372262f7e8d] alter complete (version 5)
I20250115 10:12:04.737496 3350 leader_election.cc:304] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.737571 4877 raft_consensus.cc:2798] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.737607 4877 raft_consensus.cc:491] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.737632 4877 raft_consensus.cc:3054] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.737705 3350 leader_election.cc:343] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.737802 4575 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.737838 4575 ts_tablet_manager.cc:1397] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:04.737926 4575 raft_consensus.cc:357] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.737979 4575 raft_consensus.cc:383] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.738003 4575 raft_consensus.cc:738] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.738037 4575 consensus_queue.cc:260] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.738071 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:04.738126 4575 ts_tablet_manager.cc:1428] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.738179 4575 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.738337 4877 raft_consensus.cc:513] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.738440 4877 leader_election.cc:290] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.738636 4575 tablet_bootstrap.cc:654] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.738930 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.738981 3280 raft_consensus.cc:3054] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.738994 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.739142 3350 leader_election.cc:343] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.739418 4569 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.739460 4569 ts_tablet_manager.cc:1397] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:04.739537 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb353ea066dc474cac07e3adcfa6574d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.739583 4569 raft_consensus.cc:357] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.739631 4569 raft_consensus.cc:383] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.739652 3280 raft_consensus.cc:2463] T 0e23a070a8454f3b8bd1620ac4535a12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.739655 4569 raft_consensus.cc:738] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.739710 4569 consensus_queue.cc:260] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.739848 4569 ts_tablet_manager.cc:1428] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.739884 3485 leader_election.cc:304] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.739912 4569 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.740015 4434 raft_consensus.cc:3054] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.740279 4569 tablet_bootstrap.cc:654] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.740295 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 7144ec81e9244eb49715450aeda5f82f (table default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]). Expected version 1 got 0
I20250115 10:12:04.740648 4434 raft_consensus.cc:2743] T 57d3800d79794d3bad6c50d2dc8e9258 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.740751 4569 tablet_bootstrap.cc:492] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.740782 4569 ts_tablet_manager.cc:1397] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.740788 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:04.740883 4569 raft_consensus.cc:357] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.740926 4569 raft_consensus.cc:383] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.740942 4569 raft_consensus.cc:738] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.740964 4569 consensus_queue.cc:260] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.741061 4569 ts_tablet_manager.cc:1428] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.741111 4569 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.741253 3350 leader_election.cc:304] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.741329 4877 raft_consensus.cc:2798] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.741370 4877 raft_consensus.cc:695] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.741415 4877 consensus_queue.cc:237] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.741477 4569 tablet_bootstrap.cc:654] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.742185 4475 catalog_manager.cc:5526] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:04.742324 3485 leader_election.cc:343] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.742377 3485 leader_election.cc:304] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.742583 4434 raft_consensus.cc:2743] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.742720 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 0fbb9cfc01df408eaae41b38e8c62c86
W20250115 10:12:04.742769 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f682c7942a454d86a5df19eeac533361
I20250115 10:12:04.742920 3952 consensus_queue.cc:1035] T d5419822600e463a9efb81ad86a10292 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.743177 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3ba11705ca3d4f7aa340b7c005f24e1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.743294 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ba11705ca3d4f7aa340b7c005f24e1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.743981 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3e941a068876448eb12eef23e2760ba6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.744095 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e941a068876448eb12eef23e2760ba6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.744623 4557 tablet_bootstrap.cc:492] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.744621 4575 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.744657 4575 ts_tablet_manager.cc:1397] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:04.744657 4557 ts_tablet_manager.cc:1397] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:04.744787 4575 raft_consensus.cc:357] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.744836 4575 raft_consensus.cc:383] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.744813 4557 raft_consensus.cc:357] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.744853 4575 raft_consensus.cc:738] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.744858 4557 raft_consensus.cc:383] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.744876 4557 raft_consensus.cc:738] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.744892 4575 consensus_queue.cc:260] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.744908 4557 consensus_queue.cc:260] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.744982 4575 ts_tablet_manager.cc:1428] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.745011 4557 ts_tablet_manager.cc:1428] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.745043 4575 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.745072 4557 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.745085 4473 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b9287005186640338ca0d5ebd19eaefe" } new_table_name: "default.Table_bafc0af99d4c4ff19fc98578d4628027" modify_external_catalogs: true
I20250115 10:12:04.745461 4575 tablet_bootstrap.cc:654] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.745677 4557 tablet_bootstrap.cc:654] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.746577 4575 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.746615 4575 ts_tablet_manager.cc:1397] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.746750 4575 raft_consensus.cc:357] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.746796 4575 raft_consensus.cc:383] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.746816 4575 raft_consensus.cc:738] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.746850 4575 consensus_queue.cc:260] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.746933 4575 ts_tablet_manager.cc:1428] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.746986 4575 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.747452 4575 tablet_bootstrap.cc:654] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.747702 4557 tablet_bootstrap.cc:492] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.747766 4557 ts_tablet_manager.cc:1397] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.747876 4557 raft_consensus.cc:357] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.747931 4557 raft_consensus.cc:383] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.747926 3952 raft_consensus.cc:491] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.747952 4557 raft_consensus.cc:738] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.747968 3952 raft_consensus.cc:513] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.748011 4557 consensus_queue.cc:260] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.748080 3952 leader_election.cc:290] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.748102 4557 ts_tablet_manager.cc:1428] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.748157 4557 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.748265 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.748389 4557 tablet_bootstrap.cc:654] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.748488 3214 leader_election.cc:343] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.748778 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.748898 4557 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.748950 4557 ts_tablet_manager.cc:1397] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.749101 4557 raft_consensus.cc:357] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.749171 4557 raft_consensus.cc:383] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.749191 4557 raft_consensus.cc:738] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.749202 4569 tablet_bootstrap.cc:492] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.749218 4557 consensus_queue.cc:260] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.749238 4569 ts_tablet_manager.cc:1397] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.749310 4557 ts_tablet_manager.cc:1428] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.749382 4557 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.749459 4569 raft_consensus.cc:357] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.749517 4569 raft_consensus.cc:383] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.749539 4569 raft_consensus.cc:738] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.749579 4569 consensus_queue.cc:260] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.749667 4557 tablet_bootstrap.cc:654] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.749688 4569 ts_tablet_manager.cc:1428] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.749785 4569 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.750154 4557 tablet_bootstrap.cc:492] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.750195 4569 tablet_bootstrap.cc:654] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.750195 4557 ts_tablet_manager.cc:1397] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.750291 4557 raft_consensus.cc:357] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.750335 4473 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90c26daa75784e54bf2fdd2e6e40310f consensus state has no leader
I20250115 10:12:04.750346 4557 raft_consensus.cc:383] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.750371 4557 raft_consensus.cc:738] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.750420 4557 consensus_queue.cc:260] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.750517 4557 ts_tablet_manager.cc:1428] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.750572 4557 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.750777 3215 leader_election.cc:343] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.750828 3215 leader_election.cc:304] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.750898 4557 tablet_bootstrap.cc:654] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.751579 3952 raft_consensus.cc:2743] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.751762 4557 tablet_bootstrap.cc:492] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.751799 4557 ts_tablet_manager.cc:1397] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.751811 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 709a9b0953dd4b108825b663d703e609 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.751929 4589 tablet_replica.cc:331] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.751941 4557 raft_consensus.cc:357] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.751982 4589 raft_consensus.cc:2238] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.752012 4557 raft_consensus.cc:383] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.752018 4589 raft_consensus.cc:2267] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.752033 4557 raft_consensus.cc:738] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.752076 4557 consensus_queue.cc:260] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.752168 4557 ts_tablet_manager.cc:1428] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.750835 4569 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.752230 4569 ts_tablet_manager.cc:1397] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.752239 4557 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.752401 4569 raft_consensus.cc:357] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.752475 4569 raft_consensus.cc:383] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.752498 4569 raft_consensus.cc:738] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.752539 4569 consensus_queue.cc:260] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.752628 4569 ts_tablet_manager.cc:1428] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.752657 4557 tablet_bootstrap.cc:654] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.752683 4569 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.753046 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 41581e46b20d4c89a93086b7101a5553 (DEFAULT_TABLE table=default.Table_3ba11705ca3d4f7aa340b7c005f24e1d [id=f032051438b348c39d4332c704a57ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.753093 4569 tablet_bootstrap.cc:654] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.753082 4877 raft_consensus.cc:491] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.753147 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41581e46b20d4c89a93086b7101a5553. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.753129 4877 raft_consensus.cc:513] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.753247 4877 leader_election.cc:290] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.753351 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 41581e46b20d4c89a93086b7101a5553 (DEFAULT_TABLE table=default.Table_3ba11705ca3d4f7aa340b7c005f24e1d [id=f032051438b348c39d4332c704a57ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.753451 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41581e46b20d4c89a93086b7101a5553. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.754088 4569 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.754134 4569 ts_tablet_manager.cc:1397] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.754274 4569 raft_consensus.cc:357] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.754325 4569 raft_consensus.cc:383] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.754344 4569 raft_consensus.cc:738] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.754370 4569 consensus_queue.cc:260] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.754381 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.754431 3280 raft_consensus.cc:2463] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.754444 4569 ts_tablet_manager.cc:1428] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.754496 4569 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.754776 4589 ts_tablet_manager.cc:1905] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.754882 4569 tablet_bootstrap.cc:654] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.754894 4575 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.754926 4575 ts_tablet_manager.cc:1397] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.755029 4575 raft_consensus.cc:357] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.755071 4575 raft_consensus.cc:383] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.755086 4575 raft_consensus.cc:738] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.755117 4575 consensus_queue.cc:260] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.755213 4575 ts_tablet_manager.cc:1428] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.755257 4575 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.755506 4557 tablet_bootstrap.cc:492] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.755553 4557 ts_tablet_manager.cc:1397] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.755681 4557 raft_consensus.cc:357] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.755776 4557 raft_consensus.cc:383] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.755810 4557 raft_consensus.cc:738] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.755822 4575 tablet_bootstrap.cc:654] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.755862 4557 consensus_queue.cc:260] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.755962 4557 ts_tablet_manager.cc:1428] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.756033 4557 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.756258 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 41581e46b20d4c89a93086b7101a5553 (DEFAULT_TABLE table=default.Table_3ba11705ca3d4f7aa340b7c005f24e1d [id=f032051438b348c39d4332c704a57ff2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.755781 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.756379 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41581e46b20d4c89a93086b7101a5553. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.756572 4569 tablet_bootstrap.cc:492] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.756621 4569 ts_tablet_manager.cc:1397] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.756747 4557 tablet_bootstrap.cc:654] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.756767 4569 raft_consensus.cc:357] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.756834 4569 raft_consensus.cc:383] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.756860 4569 raft_consensus.cc:738] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.756906 4569 consensus_queue.cc:260] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.757004 4569 ts_tablet_manager.cc:1428] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.757082 4569 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.757305 4589 ts_tablet_manager.cc:1918] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.757346 4589 log.cc:1198] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/709a9b0953dd4b108825b663d703e609
I20250115 10:12:04.757426 4569 tablet_bootstrap.cc:654] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.757501 4589 ts_tablet_manager.cc:1939] T 709a9b0953dd4b108825b663d703e609 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
W20250115 10:12:04.757699 3350 leader_election.cc:343] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.757774 3350 leader_election.cc:304] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.757889 4699 raft_consensus.cc:2798] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.757941 4699 raft_consensus.cc:491] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.757966 4699 raft_consensus.cc:3054] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.758100 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 709a9b0953dd4b108825b663d703e609 (table default.Table_5aa2546c19614c58aecd15fa26216c7d [id=e2b602b775ea4d7497644928a1a91f57]) successfully deleted
I20250115 10:12:04.758407 4575 tablet_bootstrap.cc:492] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.758452 4575 ts_tablet_manager.cc:1397] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.758602 4575 raft_consensus.cc:357] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.758659 4575 raft_consensus.cc:383] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.758633 4699 raft_consensus.cc:513] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.758682 4575 raft_consensus.cc:738] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.758726 4575 consensus_queue.cc:260] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.758759 4699 leader_election.cc:290] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.758846 4575 ts_tablet_manager.cc:1428] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.758904 4575 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.759130 3386 tablet_service.cc:1467] Processing CreateTablet for tablet c9565d0fe4904b5189f0141e31f34548 (DEFAULT_TABLE table=default.Table_3e941a068876448eb12eef23e2760ba6 [id=41e387cbcdf74ea1b86f3b2bb5adf692]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.759227 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9565d0fe4904b5189f0141e31f34548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.759277 4575 tablet_bootstrap.cc:654] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.759330 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:04.759433 4569 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.759471 4569 ts_tablet_manager.cc:1397] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.759586 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]). Expected version 1 got 0
I20250115 10:12:04.759598 4569 raft_consensus.cc:357] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.759657 4569 raft_consensus.cc:383] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.759681 4569 raft_consensus.cc:738] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.759760 4569 consensus_queue.cc:260] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.759860 4569 ts_tablet_manager.cc:1428] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.759917 4569 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.760346 4569 tablet_bootstrap.cc:654] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.760592 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:04.760635 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:04.760723 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.761039 3530 tablet_service.cc:1467] Processing CreateTablet for tablet c9565d0fe4904b5189f0141e31f34548 (DEFAULT_TABLE table=default.Table_3e941a068876448eb12eef23e2760ba6 [id=41e387cbcdf74ea1b86f3b2bb5adf692]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:04.761096 3350 leader_election.cc:343] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.761133 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9565d0fe4904b5189f0141e31f34548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.761231 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.761289 3280 raft_consensus.cc:3054] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.761490 3770 raft_consensus.cc:491] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.761538 3770 raft_consensus.cc:513] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.761636 3770 leader_election.cc:290] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.761917 3280 raft_consensus.cc:2463] T 77b422773c3346199383ca64330719c6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.762074 3244 tablet_service.cc:1467] Processing CreateTablet for tablet c9565d0fe4904b5189f0141e31f34548 (DEFAULT_TABLE table=default.Table_3e941a068876448eb12eef23e2760ba6 [id=41e387cbcdf74ea1b86f3b2bb5adf692]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.762154 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9565d0fe4904b5189f0141e31f34548. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.762159 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 5f37b29ba1cb4a0289268ba1241527b8 (table default.Table_3249ea9ae59247ca976f3c00dc0b4947 [id=2cd4c5e9ab1f4e018b47117186f14066]). Expected version 1 got 0
I20250115 10:12:04.762202 4569 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.762236 4569 ts_tablet_manager.cc:1397] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.762362 4569 raft_consensus.cc:357] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.762372 3350 leader_election.cc:304] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.762403 4569 raft_consensus.cc:383] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.762419 4569 raft_consensus.cc:738] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.762456 4569 consensus_queue.cc:260] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.762526 4557 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.762530 4569 ts_tablet_manager.cc:1428] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.762565 4557 ts_tablet_manager.cc:1397] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:04.762581 4569 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.762734 4557 raft_consensus.cc:357] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.762787 4557 raft_consensus.cc:383] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.762809 4557 raft_consensus.cc:738] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.762848 4557 consensus_queue.cc:260] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.762936 4557 ts_tablet_manager.cc:1428] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.763001 4569 tablet_bootstrap.cc:654] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.763056 4557 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.763469 4557 tablet_bootstrap.cc:654] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.763605 4877 raft_consensus.cc:2798] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.763654 4877 raft_consensus.cc:695] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.763633 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.763691 4877 consensus_queue.cc:237] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.763969 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.764171 4557 tablet_bootstrap.cc:492] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.764214 4557 ts_tablet_manager.cc:1397] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
W20250115 10:12:04.764232 3214 leader_election.cc:343] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.764278 3215 leader_election.cc:343] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.764317 3215 leader_election.cc:304] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.764336 4557 raft_consensus.cc:357] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.764389 4557 raft_consensus.cc:383] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.764410 4557 raft_consensus.cc:738] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.764472 4557 consensus_queue.cc:260] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.764493 3952 raft_consensus.cc:2743] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.764593 4557 ts_tablet_manager.cc:1428] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.764657 4557 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.764892 3411 raft_consensus.cc:3054] T fc423aad4e7a49eaacb21c73d5d8c341 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.765093 4557 tablet_bootstrap.cc:654] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.765610 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.766088 4575 tablet_bootstrap.cc:492] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.766131 4575 ts_tablet_manager.cc:1397] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:04.766144 3770 consensus_queue.cc:1035] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.766264 4575 raft_consensus.cc:357] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.766320 4575 raft_consensus.cc:383] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.766343 4575 raft_consensus.cc:738] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.766384 4575 consensus_queue.cc:260] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.766448 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:12:04.766490 4575 ts_tablet_manager.cc:1428] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.766556 4575 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.767164 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1056c5778b5d4cab99ab769e53573c71" } new_table_name: "default.Table_44bd57faa7db488bafe4c7d0f2db54c8" modify_external_catalogs: true
I20250115 10:12:04.767130 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_ece042a56fe04c1485bd610f5829cca9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.767204 3770 raft_consensus.cc:491] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.767225 4575 tablet_bootstrap.cc:654] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.767258 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ece042a56fe04c1485bd610f5829cca9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.767248 3770 raft_consensus.cc:513] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.767345 3770 leader_election.cc:290] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.767613 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_730810b9477747d6a9ac4fabeceb1305" } new_table_name: "default.Table_c494c5f3959d4959b88ac69c86bb5de1" modify_external_catalogs: true
W20250115 10:12:04.767654 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
W20250115 10:12:04.767692 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:04.767884 3770 consensus_queue.cc:1035] T 6d8e47c05a4b46d9a032852ad67b29ae P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.768085 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.768497 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.768534 3215 leader_election.cc:343] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.768633 3214 leader_election.cc:343] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.768667 3214 leader_election.cc:304] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.768807 3770 raft_consensus.cc:2743] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.768877 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet d3326a9a37a64e9a9485e5abadc2e493 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.768954 4592 tablet_replica.cc:331] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.769016 4592 raft_consensus.cc:2238] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.769064 4592 raft_consensus.cc:2267] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.769171 4877 raft_consensus.cc:491] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.769230 4877 raft_consensus.cc:513] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.769340 4877 leader_election.cc:290] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.769572 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1385fb81dff24e709d5d45fb9d616369" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.769721 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 31b8334f3d734968a0a7ba148bd90d72 consensus state has no leader
W20250115 10:12:04.769734 3350 leader_election.cc:343] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.770009 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
W20250115 10:12:04.770026 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4a33ae08b3194c09a7ca5701c13da844 consensus state has no leader
W20250115 10:12:04.770380 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
W20250115 10:12:04.770407 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:04.770665 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1385fb81dff24e709d5d45fb9d616369" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.770725 3280 raft_consensus.cc:2463] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.770941 4557 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.770992 4557 ts_tablet_manager.cc:1397] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.771210 4557 raft_consensus.cc:357] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.771272 4557 raft_consensus.cc:383] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.771279 3350 leader_election.cc:304] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.771297 4557 raft_consensus.cc:738] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.771310 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 7167314ee8cc4fcfbc4912bc0422afc8 (DEFAULT_TABLE table=default.Table_ece042a56fe04c1485bd610f5829cca9 [id=45a74e9274bd4cf4859a189b1c09fb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.771328 4557 consensus_queue.cc:260] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.771405 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167314ee8cc4fcfbc4912bc0422afc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.771422 4557 ts_tablet_manager.cc:1428] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.771483 4557 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.771939 4557 tablet_bootstrap.cc:654] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.771920 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 7167314ee8cc4fcfbc4912bc0422afc8 (DEFAULT_TABLE table=default.Table_ece042a56fe04c1485bd610f5829cca9 [id=45a74e9274bd4cf4859a189b1c09fb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.771947 4877 raft_consensus.cc:2798] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.772004 4877 raft_consensus.cc:491] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.772029 4877 raft_consensus.cc:3054] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.772038 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167314ee8cc4fcfbc4912bc0422afc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.772646 4877 raft_consensus.cc:513] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.772713 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 7167314ee8cc4fcfbc4912bc0422afc8 (DEFAULT_TABLE table=default.Table_ece042a56fe04c1485bd610f5829cca9 [id=45a74e9274bd4cf4859a189b1c09fb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.772755 4877 leader_election.cc:290] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.772830 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7167314ee8cc4fcfbc4912bc0422afc8. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.773046 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:04.773583 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1385fb81dff24e709d5d45fb9d616369" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.773643 3280 raft_consensus.cc:3054] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.774111 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1385fb81dff24e709d5d45fb9d616369" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.774302 3280 raft_consensus.cc:2463] T 1385fb81dff24e709d5d45fb9d616369 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:04.774341 3350 leader_election.cc:343] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.774363 3415 raft_consensus.cc:3054] T 41e2e034ea974448922f2cb0529bd196 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.774546 4569 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.774580 4569 ts_tablet_manager.cc:1397] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:04.774610 3350 leader_election.cc:304] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.774749 4569 raft_consensus.cc:357] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.774803 4569 raft_consensus.cc:383] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.774820 4569 raft_consensus.cc:738] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.774868 4569 consensus_queue.cc:260] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.774969 4569 ts_tablet_manager.cc:1428] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.775099 4877 raft_consensus.cc:2798] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.775154 4877 raft_consensus.cc:695] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.775147 4434 consensus_queue.cc:1035] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.775190 4877 consensus_queue.cc:237] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.775879 4592 ts_tablet_manager.cc:1905] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.776098 4557 tablet_bootstrap.cc:492] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.776142 4557 ts_tablet_manager.cc:1397] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.776296 4557 raft_consensus.cc:357] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.776361 4557 raft_consensus.cc:383] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.776386 4557 raft_consensus.cc:738] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.776432 4557 consensus_queue.cc:260] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.776574 4557 ts_tablet_manager.cc:1428] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.776635 4557 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.776854 4887 raft_consensus.cc:491] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.776904 4887 raft_consensus.cc:513] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.777031 4887 leader_election.cc:290] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.777063 4557 tablet_bootstrap.cc:654] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.777349 4592 ts_tablet_manager.cc:1918] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.777390 4592 log.cc:1198] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:04.777541 4592 ts_tablet_manager.cc:1939] T d3326a9a37a64e9a9485e5abadc2e493 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.777551 4472 catalog_manager.cc:5526] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.777704 4557 tablet_bootstrap.cc:492] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.777788 4557 ts_tablet_manager.cc:1397] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.777973 4557 raft_consensus.cc:357] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.778023 4557 raft_consensus.cc:383] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.778043 4557 raft_consensus.cc:738] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.778079 4557 consensus_queue.cc:260] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.778160 4557 ts_tablet_manager.cc:1428] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.778422 4434 raft_consensus.cc:491] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.778466 4434 raft_consensus.cc:513] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.778558 4434 leader_election.cc:290] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.778743 4557 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.778864 4569 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.779179 4557 tablet_bootstrap.cc:654] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.779179 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.779270 4569 tablet_bootstrap.cc:654] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.779443 4908 raft_consensus.cc:491] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.779482 4908 raft_consensus.cc:513] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.779573 4908 leader_election.cc:290] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.779675 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c44b485fd84ea8a954c1eb5b8ff5b5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.779795 3411 raft_consensus.cc:2388] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:04.780057 4575 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.780196 4575 ts_tablet_manager.cc:1397] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:04.780202 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.780405 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.780665 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8decec5964f14766b997192fbf4f7051" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.780746 4434 raft_consensus.cc:491] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:04.780766 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.780799 4434 raft_consensus.cc:513] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.780795 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d3326a9a37a64e9a9485e5abadc2e493 (table default.Table_12b3dd12cf7b4430845719cf71bdbb89 [id=d2afc82c93634f34b7984f1150be5f30]) successfully deleted
I20250115 10:12:04.780827 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_f61276eb8fc0490ebc9173121ee37c34 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 2 got 0
I20250115 10:12:04.780875 4434 leader_election.cc:290] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.780892 4433 consensus_queue.cc:1035] T 41e2e034ea974448922f2cb0529bd196 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.781085 3484 leader_election.cc:304] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.781147 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.781210 3414 raft_consensus.cc:2463] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.781236 4433 raft_consensus.cc:3054] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.781591 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:04.781597 4434 raft_consensus.cc:491] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.781644 4434 raft_consensus.cc:513] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.781751 4434 leader_election.cc:290] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.781839 3215 leader_election.cc:343] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.781973 4433 raft_consensus.cc:2743] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.781961 4335 consensus_queue.cc:1035] T fc423aad4e7a49eaacb21c73d5d8c341 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.782146 3485 leader_election.cc:304] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.782243 4338 raft_consensus.cc:2743] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.782459 3214 leader_election.cc:304] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.782578 3770 raft_consensus.cc:2798] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.782629 3770 raft_consensus.cc:491] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.782580 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.782649 3770 raft_consensus.cc:3054] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.781535 4575 raft_consensus.cc:357] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.782788 4575 raft_consensus.cc:383] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.782814 4575 raft_consensus.cc:738] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.782866 4575 consensus_queue.cc:260] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.783090 3484 leader_election.cc:343] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.783385 3770 raft_consensus.cc:513] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.783491 3770 leader_election.cc:290] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.783548 4557 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.783592 4557 ts_tablet_manager.cc:1397] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:04.783568 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.783677 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.783754 4557 raft_consensus.cc:357] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.783782 3484 leader_election.cc:343] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.783825 4557 raft_consensus.cc:383] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.783851 4557 raft_consensus.cc:738] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.783921 4557 consensus_queue.cc:260] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.784011 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.784045 4557 ts_tablet_manager.cc:1428] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.784073 3411 raft_consensus.cc:3054] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.784231 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.784260 4557 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.784312 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.784448 3215 leader_election.cc:343] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.784669 4557 tablet_bootstrap.cc:654] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.784696 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.784696 3411 raft_consensus.cc:2463] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.784941 3214 leader_election.cc:304] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.785045 3770 raft_consensus.cc:2798] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.785090 3770 raft_consensus.cc:695] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.785122 3770 consensus_queue.cc:237] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.785156 3485 leader_election.cc:343] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.785195 3485 leader_election.cc:304] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.785265 3485 leader_election.cc:343] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.785295 3485 leader_election.cc:304] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.785363 4335 raft_consensus.cc:491] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.785426 4335 raft_consensus.cc:513] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.785461 4884 raft_consensus.cc:2743] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.785523 4335 leader_election.cc:290] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.785461 4434 raft_consensus.cc:2743] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.785650 4877 raft_consensus.cc:491] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.785702 4877 raft_consensus.cc:513] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.785792 4877 leader_election.cc:290] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.785857 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.786022 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.786075 3547 raft_consensus.cc:2463] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.786293 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:04.786387 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.786482 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.786522 3350 leader_election.cc:304] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.786590 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.786684 3411 raft_consensus.cc:2463] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.786747 4877 raft_consensus.cc:2798] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.786769 4877 raft_consensus.cc:491] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.786769 4557 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.786785 4877 raft_consensus.cc:3054] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.786813 4557 ts_tablet_manager.cc:1397] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.786861 3214 leader_election.cc:304] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.786937 4335 raft_consensus.cc:2798] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.786964 4335 raft_consensus.cc:491] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.786954 4557 raft_consensus.cc:357] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.787011 4335 raft_consensus.cc:3054] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.787020 4557 raft_consensus.cc:383] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.787040 4557 raft_consensus.cc:738] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.787079 4557 consensus_queue.cc:260] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.787163 4557 ts_tablet_manager.cc:1428] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.787214 4557 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.787318 3215 leader_election.cc:343] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.787417 4877 raft_consensus.cc:513] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.787523 4877 leader_election.cc:290] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.787577 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
W20250115 10:12:04.787607 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.787636 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:04.787648 4557 tablet_bootstrap.cc:654] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.787771 4335 raft_consensus.cc:513] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.787844 4575 ts_tablet_manager.cc:1428] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:04.787775 4569 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.787951 4569 ts_tablet_manager.cc:1397] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:04.788069 4569 raft_consensus.cc:357] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.788120 4569 raft_consensus.cc:383] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:04.788120 3350 leader_election.cc:343] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.788143 4569 raft_consensus.cc:738] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.788154 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.788193 4569 consensus_queue.cc:260] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.788197 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.788221 3548 raft_consensus.cc:3054] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.787904 4335 leader_election.cc:290] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.788280 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce84190f55b14902ab678a98e622dc4f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.788370 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.788421 3411 raft_consensus.cc:3054] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.788348 4569 ts_tablet_manager.cc:1428] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.788492 3215 leader_election.cc:343] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.788517 4569 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.788654 3350 leader_election.cc:343] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.788882 3548 raft_consensus.cc:2463] T ce84190f55b14902ab678a98e622dc4f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.789011 3411 raft_consensus.cc:2463] T 0496864e655e40dfac38619adbf4fd87 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.789149 3214 leader_election.cc:304] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.789227 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:04.789248 4335 raft_consensus.cc:2798] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.789297 4335 raft_consensus.cc:695] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.789269 4472 catalog_manager.cc:5526] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.789333 4335 consensus_queue.cc:237] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.789376 4575 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.789554 3350 leader_election.cc:304] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.789626 4877 raft_consensus.cc:2798] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.789669 4877 raft_consensus.cc:695] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.789707 4877 consensus_queue.cc:237] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.790163 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:04.790449 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.790537 4551 tablet_replica.cc:331] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.790602 4551 raft_consensus.cc:2238] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.790617 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:04.790659 4551 raft_consensus.cc:2267] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.790880 4551 ts_tablet_manager.cc:1905] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.790999 4575 tablet_bootstrap.cc:654] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.792196 4551 ts_tablet_manager.cc:1918] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.792237 4551 log.cc:1198] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3fecca0f91e04702b438c9639303fac2
I20250115 10:12:04.792380 4551 ts_tablet_manager.cc:1939] T 3fecca0f91e04702b438c9639303fac2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.792325 4472 catalog_manager.cc:5526] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.792541 4875 raft_consensus.cc:491] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.792599 4875 raft_consensus.cc:513] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.792685 4875 leader_election.cc:290] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.792891 4887 raft_consensus.cc:491] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.792940 4887 raft_consensus.cc:513] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.792985 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.793040 3280 raft_consensus.cc:2463] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.793061 4887 leader_election.cc:290] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.793161 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.793279 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.793349 3350 leader_election.cc:304] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.793339 4468 catalog_manager.cc:5526] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.793416 4875 raft_consensus.cc:2798] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.793452 4875 raft_consensus.cc:491] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.793442 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3fecca0f91e04702b438c9639303fac2 (table default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]) successfully deleted
W20250115 10:12:04.793424 3350 leader_election.cc:343] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.793473 4875 raft_consensus.cc:3054] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.793852 4569 tablet_bootstrap.cc:654] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.794149 4875 raft_consensus.cc:513] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.794243 4875 leader_election.cc:290] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.794363 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47205800bd074a9585c4af0f50055a13" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.794430 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.794479 3280 raft_consensus.cc:3054] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.794765 3484 leader_election.cc:304] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.794864 4887 raft_consensus.cc:2743] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.795038 4575 tablet_bootstrap.cc:492] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.795085 4575 ts_tablet_manager.cc:1397] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:04.795153 3280 raft_consensus.cc:2463] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.795207 4575 raft_consensus.cc:357] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.795228 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet dc7e96ba921d4fbb96afbbf8c5f354f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 21e2a71f1a0145309b037e34f1b398d6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.795254 4575 raft_consensus.cc:383] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.795274 4575 raft_consensus.cc:738] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.795289 4589 tablet_replica.cc:331] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.795321 4575 consensus_queue.cc:260] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.795362 4589 raft_consensus.cc:2238] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.795392 4589 raft_consensus.cc:2267] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.795435 4575 ts_tablet_manager.cc:1428] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.795610 4589 ts_tablet_manager.cc:1905] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.795594 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_4663d24ec3e4427085037f4f6873dfb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.795718 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4663d24ec3e4427085037f4f6873dfb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.796248 3350 leader_election.cc:304] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.796305 4557 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.796322 4875 raft_consensus.cc:2798] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.796348 4557 ts_tablet_manager.cc:1397] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:04.796356 4875 raft_consensus.cc:695] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.796398 4875 consensus_queue.cc:237] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.796492 4557 raft_consensus.cc:357] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.796559 4557 raft_consensus.cc:383] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.796584 4557 raft_consensus.cc:738] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.796618 4557 consensus_queue.cc:260] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.796721 4557 ts_tablet_manager.cc:1428] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.796852 4557 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.797160 4589 ts_tablet_manager.cc:1918] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.797184 4575 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.797210 4589 log.cc:1198] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:04.797345 4557 tablet_bootstrap.cc:654] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.797380 4589 ts_tablet_manager.cc:1939] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.797778 4575 tablet_bootstrap.cc:654] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.797978 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f3aea0cf684f749027f817eb3b13b7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.798185 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 166e6390660c485c99b2e115fd1b272f
W20250115 10:12:04.798197 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:04.798244 4472 catalog_manager.cc:5526] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:04.798636 3350 leader_election.cc:343] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.799292 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet dc7e96ba921d4fbb96afbbf8c5f354f2 (table default.Table_a07cb910095f454d98b97363e9407cc8 [id=3ef12371d42a4825a34048a1611889c9]) successfully deleted
I20250115 10:12:04.800221 4887 raft_consensus.cc:491] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.800279 4887 raft_consensus.cc:513] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.800366 4575 tablet_bootstrap.cc:492] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.800393 4887 leader_election.cc:290] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.800405 4575 ts_tablet_manager.cc:1397] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.800523 4575 raft_consensus.cc:357] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.800576 4575 raft_consensus.cc:383] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.800593 4575 raft_consensus.cc:738] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.800640 4575 consensus_queue.cc:260] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.800726 4575 ts_tablet_manager.cc:1428] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.800784 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.800846 4575 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.800875 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.801239 3484 leader_election.cc:343] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.801335 4575 tablet_bootstrap.cc:654] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.801357 3485 leader_election.cc:343] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.801388 3485 leader_election.cc:304] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.801679 4887 raft_consensus.cc:2743] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.801951 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 580547bda81345f2ac5dc804470cc2e6 (DEFAULT_TABLE table=default.Table_4663d24ec3e4427085037f4f6873dfb2 [id=312b0c88146447d19c86742c79b21782]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.802070 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580547bda81345f2ac5dc804470cc2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.802117 4569 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.802157 4569 ts_tablet_manager.cc:1397] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:04.802201 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 580547bda81345f2ac5dc804470cc2e6 (DEFAULT_TABLE table=default.Table_4663d24ec3e4427085037f4f6873dfb2 [id=312b0c88146447d19c86742c79b21782]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.802292 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580547bda81345f2ac5dc804470cc2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.802323 4575 tablet_bootstrap.cc:492] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.802330 4569 raft_consensus.cc:357] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.802362 4575 ts_tablet_manager.cc:1397] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.802386 4569 raft_consensus.cc:383] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.802403 4569 raft_consensus.cc:738] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.802430 4569 consensus_queue.cc:260] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.802485 4575 raft_consensus.cc:357] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.802531 4569 ts_tablet_manager.cc:1428] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.802542 4575 raft_consensus.cc:383] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.802567 4575 raft_consensus.cc:738] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.802593 4569 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.802624 4575 consensus_queue.cc:260] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.802817 4575 ts_tablet_manager.cc:1428] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.802875 4575 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.803189 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 580547bda81345f2ac5dc804470cc2e6 (DEFAULT_TABLE table=default.Table_4663d24ec3e4427085037f4f6873dfb2 [id=312b0c88146447d19c86742c79b21782]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.803272 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580547bda81345f2ac5dc804470cc2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.803395 4575 tablet_bootstrap.cc:654] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.804180 4575 tablet_bootstrap.cc:492] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.804226 4575 ts_tablet_manager.cc:1397] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.804369 4575 raft_consensus.cc:357] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.804602 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 3fecca0f91e04702b438c9639303fac2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.804610 4575 raft_consensus.cc:383] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.804679 4575 raft_consensus.cc:738] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.804687 4592 tablet_replica.cc:331] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.804796 4592 raft_consensus.cc:2238] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.804764 4575 consensus_queue.cc:260] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.804822 4592 raft_consensus.cc:2267] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.805054 4569 tablet_bootstrap.cc:654] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.805466 4592 ts_tablet_manager.cc:1905] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.805742 4335 raft_consensus.cc:491] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.805789 4887 raft_consensus.cc:491] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.805797 4335 raft_consensus.cc:513] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.805832 4887 raft_consensus.cc:513] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.805918 4335 leader_election.cc:290] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.805965 4575 ts_tablet_manager.cc:1428] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:04.805968 4887 leader_election.cc:290] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.806039 4575 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.806049 3088 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3c778d7be748405285068f36650902b0 has no consensus state
I20250115 10:12:04.806315 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f611ee9e87048ca8bddaa6525bbd054" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.806370 3414 raft_consensus.cc:2463] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.806504 4575 tablet_bootstrap.cc:654] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.806502 3214 leader_election.cc:304] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.806578 4335 raft_consensus.cc:2798] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.806584 4887 raft_consensus.cc:491] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.806615 4335 raft_consensus.cc:491] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.806638 4335 raft_consensus.cc:3054] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.806629 4887 raft_consensus.cc:513] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.806720 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d30f49da63241a2a794a7a18e026473" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.806757 4887 leader_election.cc:290] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.806828 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d30f49da63241a2a794a7a18e026473" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.806886 3484 leader_election.cc:343] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.806926 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.807015 3485 leader_election.cc:343] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.807049 3485 leader_election.cc:304] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.807185 4887 raft_consensus.cc:2743] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.807229 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c64affc7645145069d6197ede241585e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.807297 3279 raft_consensus.cc:2388] T c64affc7645145069d6197ede241585e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.807397 4335 raft_consensus.cc:513] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.807559 4335 leader_election.cc:290] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.807641 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f611ee9e87048ca8bddaa6525bbd054" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.807729 3485 leader_election.cc:304] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.807901 3215 leader_election.cc:343] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.807734 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f611ee9e87048ca8bddaa6525bbd054" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.807989 4887 raft_consensus.cc:3054] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.807997 4569 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.808034 4569 ts_tablet_manager.cc:1397] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.808169 4569 raft_consensus.cc:357] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.808229 4569 raft_consensus.cc:383] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.808246 4569 raft_consensus.cc:738] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.808281 4569 consensus_queue.cc:260] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.808393 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f611ee9e87048ca8bddaa6525bbd054" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.808423 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.808439 3411 raft_consensus.cc:3054] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.808851 4877 raft_consensus.cc:491] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.808899 4877 raft_consensus.cc:513] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.809023 4877 leader_election.cc:290] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.809465 4592 ts_tablet_manager.cc:1918] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.809542 4592 log.cc:1198] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/3fecca0f91e04702b438c9639303fac2
I20250115 10:12:04.809661 3411 raft_consensus.cc:2463] T 6f611ee9e87048ca8bddaa6525bbd054 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.809794 4592 ts_tablet_manager.cc:1939] T 3fecca0f91e04702b438c9639303fac2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.809791 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.809854 3547 raft_consensus.cc:2463] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.808168 3215 leader_election.cc:343] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.809978 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.810293 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 3fecca0f91e04702b438c9639303fac2 (table default.Table_e419dd2392434a8ab8def3765f49bf85 [id=79c0864afd084efe8fbe13584c0d8b4e]) successfully deleted
I20250115 10:12:04.810842 3350 leader_election.cc:304] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.810917 4877 raft_consensus.cc:2798] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.811007 4877 raft_consensus.cc:491] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.811033 4877 raft_consensus.cc:3054] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.811563 3350 leader_election.cc:343] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.811692 4569 ts_tablet_manager.cc:1428] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:04.811882 4877 raft_consensus.cc:513] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.811936 4569 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.812004 4877 leader_election.cc:290] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.812146 4433 raft_consensus.cc:491] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.812204 4433 raft_consensus.cc:513] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.812310 4433 leader_election.cc:290] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.812153 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.812400 3547 raft_consensus.cc:3054] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.812407 4569 tablet_bootstrap.cc:654] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.812880 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:04.812969 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.813004 4877 raft_consensus.cc:491] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.812994 3214 leader_election.cc:304] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.813045 4877 raft_consensus.cc:513] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.813134 3952 raft_consensus.cc:2798] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.813153 4877 leader_election.cc:290] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.813179 3952 raft_consensus.cc:695] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.813223 3952 consensus_queue.cc:237] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.813354 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb4d112daca24c82931daf050edbd846" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.813412 3548 raft_consensus.cc:2463] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.813525 3350 leader_election.cc:304] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.813645 4877 raft_consensus.cc:2798] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.813688 4877 raft_consensus.cc:491] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.813712 4877 raft_consensus.cc:3054] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.813964 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.813977 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb4d112daca24c82931daf050edbd846" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.814043 3276 raft_consensus.cc:2463] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:04.814123 3350 leader_election.cc:343] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.814327 4877 raft_consensus.cc:513] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.814424 4877 leader_election.cc:290] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.814421 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]). Expected version 3 got 0
I20250115 10:12:04.815018 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb4d112daca24c82931daf050edbd846" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.815083 3279 raft_consensus.cc:3054] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.815232 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb4d112daca24c82931daf050edbd846" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.815268 4569 tablet_bootstrap.cc:492] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.815296 3548 raft_consensus.cc:3054] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.815304 4569 ts_tablet_manager.cc:1397] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.815400 4575 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.815443 4575 ts_tablet_manager.cc:1397] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:04.815457 4569 raft_consensus.cc:357] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.815501 4569 raft_consensus.cc:383] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.815519 4569 raft_consensus.cc:738] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.815557 4569 consensus_queue.cc:260] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.815562 4575 raft_consensus.cc:357] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.815603 4575 raft_consensus.cc:383] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.815624 4575 raft_consensus.cc:738] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.815657 4569 ts_tablet_manager.cc:1428] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.815660 4575 consensus_queue.cc:260] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.815750 4569 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.815783 3279 raft_consensus.cc:2463] T bb4d112daca24c82931daf050edbd846 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.815915 3350 leader_election.cc:304] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.816054 4875 raft_consensus.cc:2798] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.816089 4575 ts_tablet_manager.cc:1428] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.816110 4875 raft_consensus.cc:695] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.816151 4569 tablet_bootstrap.cc:654] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.816156 4875 consensus_queue.cc:237] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.816359 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]). Expected version 1 got 0
I20250115 10:12:04.816166 4575 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.816418 4472 catalog_manager.cc:5526] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.816540 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
W20250115 10:12:04.816761 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:12:04.816880 4575 tablet_bootstrap.cc:654] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.817317 4569 tablet_bootstrap.cc:492] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.817360 4569 ts_tablet_manager.cc:1397] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.817483 4569 raft_consensus.cc:357] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.817526 4569 raft_consensus.cc:383] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.817544 4569 raft_consensus.cc:738] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.817580 4569 consensus_queue.cc:260] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.817667 4569 ts_tablet_manager.cc:1428] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.817714 4569 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.817775 4575 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.817817 4575 ts_tablet_manager.cc:1397] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.818032 4575 raft_consensus.cc:357] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.818094 4575 raft_consensus.cc:383] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.818120 4575 raft_consensus.cc:738] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.818168 4575 consensus_queue.cc:260] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.818190 4569 tablet_bootstrap.cc:654] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.818271 4575 ts_tablet_manager.cc:1428] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.818334 4575 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.818372 4468 catalog_manager.cc:5526] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.818711 4569 tablet_bootstrap.cc:492] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.818749 4575 tablet_bootstrap.cc:654] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.818778 4569 ts_tablet_manager.cc:1397] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.818950 4569 raft_consensus.cc:357] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.819021 4569 raft_consensus.cc:383] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.819047 4569 raft_consensus.cc:738] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.819092 4569 consensus_queue.cc:260] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.819196 4569 ts_tablet_manager.cc:1428] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:04.819916 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
W20250115 10:12:04.819963 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:04.819999 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:04.820070 4575 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.820111 4575 ts_tablet_manager.cc:1397] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.820222 4575 raft_consensus.cc:357] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.820266 4575 raft_consensus.cc:383] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.820276 4575 raft_consensus.cc:738] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.820293 4575 consensus_queue.cc:260] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.820353 4575 ts_tablet_manager.cc:1428] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.820385 4575 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.820502 4569 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.820760 4575 tablet_bootstrap.cc:654] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.820890 4569 tablet_bootstrap.cc:654] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.821362 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:04.821497 4569 tablet_bootstrap.cc:492] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.821555 4569 ts_tablet_manager.cc:1397] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.821681 4569 raft_consensus.cc:357] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.821748 4569 raft_consensus.cc:383] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.821769 4569 raft_consensus.cc:738] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.821825 4569 consensus_queue.cc:260] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.821910 4569 ts_tablet_manager.cc:1428] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.821964 4569 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.822355 4569 tablet_bootstrap.cc:654] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.822942 4884 raft_consensus.cc:491] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.823010 4884 raft_consensus.cc:513] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.823117 4884 leader_election.cc:290] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.823243 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.823407 3484 leader_election.cc:343] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.823599 4575 tablet_bootstrap.cc:492] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.823644 4575 ts_tablet_manager.cc:1397] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:04.823930 4557 tablet_bootstrap.cc:492] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.823977 4557 ts_tablet_manager.cc:1397] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20250115 10:12:04.824148 4557 raft_consensus.cc:357] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.824208 4557 raft_consensus.cc:383] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.824225 4557 raft_consensus.cc:738] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.824268 4557 consensus_queue.cc:260] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.824373 4557 ts_tablet_manager.cc:1428] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.824433 4557 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.824605 4887 raft_consensus.cc:2743] T c64affc7645145069d6197ede241585e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.824611 4884 raft_consensus.cc:491] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.824679 4884 raft_consensus.cc:513] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.824775 4884 leader_election.cc:290] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.824846 4557 tablet_bootstrap.cc:654] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.825394 4557 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.825439 4557 ts_tablet_manager.cc:1397] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
W20250115 10:12:04.825440 4461 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 4a33ae08b3194c09a7ca5701c13da844 (table default.Table_44bd57faa7db488bafe4c7d0f2db54c8 [id=600a5b9246924bbf908f4ade19aefdfa], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4a33ae08b3194c09a7ca5701c13da844 consensus state has no leader
I20250115 10:12:04.825580 4557 raft_consensus.cc:357] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.825635 4557 raft_consensus.cc:383] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.825657 4557 raft_consensus.cc:738] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.825687 3548 raft_consensus.cc:2463] T bb4d112daca24c82931daf050edbd846 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.825708 4557 consensus_queue.cc:260] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.825840 4557 ts_tablet_manager.cc:1428] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.825909 4557 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.826303 3547 raft_consensus.cc:2463] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.826403 4557 tablet_bootstrap.cc:654] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.826433 3350 leader_election.cc:304] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.826632 4699 raft_consensus.cc:2798] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.826683 4699 raft_consensus.cc:695] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.826726 4699 consensus_queue.cc:237] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.826952 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_830a8b16d5ef4b02b0a223ab505ef9be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.827080 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_830a8b16d5ef4b02b0a223ab505ef9be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.827071 4575 raft_consensus.cc:357] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.827126 4575 raft_consensus.cc:383] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.827144 4575 raft_consensus.cc:738] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.827240 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.824450 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.827427 3276 raft_consensus.cc:2463] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:04.827478 3484 leader_election.cc:343] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.825039 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.827546 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9ff66254df664c3ebde2bfb9440108e1" } new_table_name: "default.Table_a48aa9d4a54e451888fe9ec81172f482" modify_external_catalogs: true
I20250115 10:12:04.827589 4699 consensus_queue.cc:1035] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.828253 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:04.828339 4473 catalog_manager.cc:5526] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.828426 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:04.828742 3485 leader_election.cc:304] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.828852 4338 raft_consensus.cc:2798] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.828892 4338 raft_consensus.cc:491] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.828908 4338 raft_consensus.cc:3054] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.829430 4338 raft_consensus.cc:513] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.829524 4338 leader_election.cc:290] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.828855 3485 leader_election.cc:343] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.829618 3485 leader_election.cc:304] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.829679 4557 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.829737 4557 ts_tablet_manager.cc:1397] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:04.829886 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.829969 3280 raft_consensus.cc:3054] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.830106 4557 raft_consensus.cc:357] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.830175 4557 raft_consensus.cc:383] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.830201 4557 raft_consensus.cc:738] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.830256 4557 consensus_queue.cc:260] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.830366 4884 raft_consensus.cc:2743] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.830372 4557 ts_tablet_manager.cc:1428] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.830510 3280 raft_consensus.cc:2463] T 368df29ba175447ba4c009c7eb15a49d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.830538 4557 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.831046 4557 tablet_bootstrap.cc:654] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.831561 4557 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.831605 4557 ts_tablet_manager.cc:1397] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.831797 4557 raft_consensus.cc:357] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.831858 4557 raft_consensus.cc:383] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.826545 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bb29eb3de04d65aa91e7ae8c652170" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.831881 4557 raft_consensus.cc:738] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.831912 4557 consensus_queue.cc:260] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.832005 4557 ts_tablet_manager.cc:1428] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.832060 4557 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:04.832275 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5507e6db082f4618aea2dcb6ee16c61f consensus state has no leader
I20250115 10:12:04.832446 4557 tablet_bootstrap.cc:654] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.832481 3485 leader_election.cc:304] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.832558 3485 leader_election.cc:304] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.832665 4434 raft_consensus.cc:2798] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.832696 4434 raft_consensus.cc:695] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.832736 4884 raft_consensus.cc:2743] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.832736 4434 consensus_queue.cc:237] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.833041 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:04.833326 3484 leader_election.cc:343] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.833448 4575 consensus_queue.cc:260] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.833573 4575 ts_tablet_manager.cc:1428] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.010s user 0.000s sys 0.000s
I20250115 10:12:04.833671 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_994ccfc74c4d41cb93b7df9cab4b0607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.833731 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a105454ffc4f4c239e800f1df5f25b7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.833784 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_994ccfc74c4d41cb93b7df9cab4b0607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:04.833798 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a105454ffc4f4c239e800f1df5f25b7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.834174 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a3e6b80eacb049fe8a9d0d027d8f2804"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.834280 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3e6b80eacb049fe8a9d0d027d8f2804 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.834295 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8010a5c5fc7649488137372787886dd5" } modify_external_catalogs: true
I20250115 10:12:04.834370 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8010a5c5fc7649488137372787886dd5" } modify_external_catalogs: true
I20250115 10:12:04.823773 4569 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.834430 4569 ts_tablet_manager.cc:1397] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s
W20250115 10:12:04.834642 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:04.834813 4575 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.836741 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 76796bdbd05c48de93c1b6336568bc2d
I20250115 10:12:04.836889 4575 tablet_bootstrap.cc:654] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.837170 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 76796bdbd05c48de93c1b6336568bc2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.837266 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 76796bdbd05c48de93c1b6336568bc2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.837394 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 76796bdbd05c48de93c1b6336568bc2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76796bdbd05c48de93c1b6336568bc2d already in progress: creating tablet
W20250115 10:12:04.837467 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 76796bdbd05c48de93c1b6336568bc2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76796bdbd05c48de93c1b6336568bc2d already in progress: creating tablet
I20250115 10:12:04.837661 4875 consensus_queue.cc:1035] T d2e5a7a6cd0a4f09b5a66f1f817c6193 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.838151 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 76796bdbd05c48de93c1b6336568bc2d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.838241 4575 tablet_bootstrap.cc:492] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.838275 4575 ts_tablet_manager.cc:1397] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:04.838421 4575 raft_consensus.cc:357] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.838459 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 76796bdbd05c48de93c1b6336568bc2d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76796bdbd05c48de93c1b6336568bc2d already in progress: creating tablet
I20250115 10:12:04.838481 4575 raft_consensus.cc:383] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.838511 4575 raft_consensus.cc:738] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.838550 4575 consensus_queue.cc:260] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.838613 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet f55439e91f284175a59d35160668fa6c from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.838650 4575 ts_tablet_manager.cc:1428] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.838701 4575 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.838907 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9b8574ea15ad4c9db7d63aa09348d5ee" } modify_external_catalogs: true
I20250115 10:12:04.838972 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9b8574ea15ad4c9db7d63aa09348d5ee" } modify_external_catalogs: true
I20250115 10:12:04.839151 4575 tablet_bootstrap.cc:654] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.839241 4569 raft_consensus.cc:357] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.839411 4569 raft_consensus.cc:383] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.839656 4433 raft_consensus.cc:491] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.839660 4569 raft_consensus.cc:738] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.839700 4433 raft_consensus.cc:513] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.839882 4433 leader_election.cc:290] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.839774 4569 consensus_queue.cc:260] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.840252 3485 leader_election.cc:343] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:04.840598 5155 raft_consensus.cc:491] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.840648 5155 raft_consensus.cc:513] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.840770 5155 leader_election.cc:290] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.840893 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.840898 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.840950 4714 raft_consensus.cc:491] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.840986 4714 raft_consensus.cc:513] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.841063 3214 leader_election.cc:343] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.841097 4714 leader_election.cc:290] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.841112 3215 leader_election.cc:343] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.841145 3215 leader_election.cc:304] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:04.841181 3484 leader_election.cc:343] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 08b7630b6c8b40d89b9829ffc8fc4b2b
I20250115 10:12:04.841223 3484 leader_election.cc:304] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.841243 4335 raft_consensus.cc:2743] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.841395 4433 raft_consensus.cc:2743] T 08b7630b6c8b40d89b9829ffc8fc4b2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.841395 4338 raft_consensus.cc:491] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.841475 4338 raft_consensus.cc:513] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.841570 4338 leader_election.cc:290] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.841609 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26351bbe70044075a99982bb380d86a0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.841673 3547 raft_consensus.cc:2463] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.841825 3350 leader_election.cc:304] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.841892 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.841960 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.842083 4569 ts_tablet_manager.cc:1428] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
W20250115 10:12:04.842129 3484 leader_election.cc:343] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.842142 4714 raft_consensus.cc:2798] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.842181 4714 raft_consensus.cc:491] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.842211 4714 raft_consensus.cc:3054] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.842159 4569 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.842283 3485 leader_election.cc:343] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.842319 3485 leader_election.cc:304] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.842383 4338 raft_consensus.cc:2743] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.842764 4569 tablet_bootstrap.cc:654] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.842952 4714 raft_consensus.cc:513] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.843065 4714 leader_election.cc:290] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.843253 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26351bbe70044075a99982bb380d86a0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.843333 3547 raft_consensus.cc:3054] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.843348 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26351bbe70044075a99982bb380d86a0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.843403 3279 raft_consensus.cc:2463] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.843606 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 9077d0eed1974bc898370b5d5554be71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.843765 4589 tablet_replica.cc:331] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.843845 4589 raft_consensus.cc:2238] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.843878 4589 raft_consensus.cc:2267] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.843991 4569 tablet_bootstrap.cc:492] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.844028 4569 ts_tablet_manager.cc:1397] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.844110 3547 raft_consensus.cc:2463] T 26351bbe70044075a99982bb380d86a0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.844211 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26351bbe70044075a99982bb380d86a0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.844274 3276 raft_consensus.cc:3054] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.844271 3350 leader_election.cc:304] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.844357 4714 raft_consensus.cc:2798] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.844285 4569 raft_consensus.cc:357] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.844396 4714 raft_consensus.cc:695] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.844415 4569 raft_consensus.cc:383] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.844462 4569 raft_consensus.cc:738] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.844435 4714 consensus_queue.cc:237] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.844530 4569 consensus_queue.cc:260] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.844655 4335 raft_consensus.cc:491] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.844691 4335 raft_consensus.cc:513] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.844715 4569 ts_tablet_manager.cc:1428] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.844780 4335 leader_election.cc:290] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.844854 4569 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.845052 3276 raft_consensus.cc:2463] T 26351bbe70044075a99982bb380d86a0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.846000 4569 tablet_bootstrap.cc:654] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.846271 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.847357 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7d152010241599ade9cad70c5c5d9 (DEFAULT_TABLE table=default.Table_830a8b16d5ef4b02b0a223ab505ef9be [id=f6fbb915587b4eaab8d38fe5a0803acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.847477 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d7d152010241599ade9cad70c5c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.847653 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f55439e91f284175a59d35160668fa6c
I20250115 10:12:04.847769 4474 catalog_manager.cc:6596] ReplaceTablet: tablet f55439e91f284175a59d35160668fa6c deleted and replaced by tablet 8103671796f141c1b105c3296455274c
I20250115 10:12:04.848471 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7d152010241599ade9cad70c5c5d9 (DEFAULT_TABLE table=default.Table_830a8b16d5ef4b02b0a223ab505ef9be [id=f6fbb915587b4eaab8d38fe5a0803acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.848497 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet f55439e91f284175a59d35160668fa6c with delete_type TABLET_DATA_DELETED (replaced by tablet 8103671796f141c1b105c3296455274c) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.848569 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d7d152010241599ade9cad70c5c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.848770 4551 tablet_replica.cc:331] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.848836 4551 raft_consensus.cc:2238] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.848907 4551 raft_consensus.cc:2267] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.849243 4551 ts_tablet_manager.cc:1905] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.850194 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c778d7be748405285068f36650902b0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.850265 3547 raft_consensus.cc:2388] T 3c778d7be748405285068f36650902b0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.850399 3215 leader_election.cc:304] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.850499 5155 raft_consensus.cc:3054] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.851128 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet f55439e91f284175a59d35160668fa6c with delete_type TABLET_DATA_DELETED (replaced by tablet 8103671796f141c1b105c3296455274c) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.851227 5155 raft_consensus.cc:2743] T 3c778d7be748405285068f36650902b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.851230 4551 ts_tablet_manager.cc:1918] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.851280 4551 log.cc:1198] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f55439e91f284175a59d35160668fa6c
I20250115 10:12:04.851514 4551 ts_tablet_manager.cc:1939] T f55439e91f284175a59d35160668fa6c P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.851495 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 58d7d152010241599ade9cad70c5c5d9 (DEFAULT_TABLE table=default.Table_830a8b16d5ef4b02b0a223ab505ef9be [id=f6fbb915587b4eaab8d38fe5a0803acb]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.851598 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d7d152010241599ade9cad70c5c5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.852017 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]) successfully deleted
I20250115 10:12:04.852424 4575 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.852474 4575 ts_tablet_manager.cc:1397] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:04.852629 4575 raft_consensus.cc:357] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.852701 4575 raft_consensus.cc:383] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.852727 4575 raft_consensus.cc:738] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.852768 4575 consensus_queue.cc:260] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.852864 4575 ts_tablet_manager.cc:1428] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.852922 4575 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.853083 3381 tablet_service.cc:1514] Processing DeleteTablet for tablet f55439e91f284175a59d35160668fa6c with delete_type TABLET_DATA_DELETED (replaced by tablet 8103671796f141c1b105c3296455274c) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.853173 4592 tablet_replica.cc:331] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.853238 4592 raft_consensus.cc:2238] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.853283 4592 raft_consensus.cc:2267] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.853303 4575 tablet_bootstrap.cc:654] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.853854 4592 ts_tablet_manager.cc:1905] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.855414 4592 ts_tablet_manager.cc:1918] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.855470 4592 log.cc:1198] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f55439e91f284175a59d35160668fa6c
I20250115 10:12:04.855640 4592 ts_tablet_manager.cc:1939] T f55439e91f284175a59d35160668fa6c P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.855661 4589 ts_tablet_manager.cc:1905] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.856158 4473 master_service.cc:946] ReplaceTablet: received request to replace tablet cb353ea066dc474cac07e3adcfa6574d from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.856243 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet b580a5dc6a9c4a0f8b65ad9a92804e09 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.856463 3514 tablet_service.cc:1467] Processing CreateTablet for tablet f276b6fa123e4c25817ba6cb8970af8a (DEFAULT_TABLE table=default.Table_a105454ffc4f4c239e800f1df5f25b7e [id=9c8bf118427748998ae66219b52b14b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.856472 4338 raft_consensus.cc:491] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.856587 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f276b6fa123e4c25817ba6cb8970af8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.856547 4338 raft_consensus.cc:513] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.856673 4338 leader_election.cc:290] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.857050 3244 tablet_service.cc:1467] Processing CreateTablet for tablet f276b6fa123e4c25817ba6cb8970af8a (DEFAULT_TABLE table=default.Table_a105454ffc4f4c239e800f1df5f25b7e [id=9c8bf118427748998ae66219b52b14b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.857142 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f276b6fa123e4c25817ba6cb8970af8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.857167 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 5b354c8d0b264cd2a9de3d46f62e8384 (DEFAULT_TABLE table=default.Table_994ccfc74c4d41cb93b7df9cab4b0607 [id=96d10b16fb494e12bfa49f86e9c9232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.857216 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 822b3e78b0ce4d01bfff2544b1964b7c (DEFAULT_TABLE table=default.Table_a3e6b80eacb049fe8a9d0d027d8f2804 [id=3e92ba7df6154d80908ba9185c02ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.857311 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b354c8d0b264cd2a9de3d46f62e8384. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.857319 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b3e78b0ce4d01bfff2544b1964b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.858343 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 822b3e78b0ce4d01bfff2544b1964b7c (DEFAULT_TABLE table=default.Table_a3e6b80eacb049fe8a9d0d027d8f2804 [id=3e92ba7df6154d80908ba9185c02ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.858436 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b3e78b0ce4d01bfff2544b1964b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.858551 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.858835 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.858901 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cb353ea066dc474cac07e3adcfa6574d
I20250115 10:12:04.859000 4473 catalog_manager.cc:6596] ReplaceTablet: tablet cb353ea066dc474cac07e3adcfa6574d deleted and replaced by tablet c537978805d44602ae5dd423773128e6
W20250115 10:12:04.859149 3485 leader_election.cc:343] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.857138 4589 ts_tablet_manager.cc:1918] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.859256 4589 log.cc:1198] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/9077d0eed1974bc898370b5d5554be71
I20250115 10:12:04.859328 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet b580a5dc6a9c4a0f8b65ad9a92804e09
I20250115 10:12:04.859414 4468 catalog_manager.cc:6596] ReplaceTablet: tablet b580a5dc6a9c4a0f8b65ad9a92804e09 deleted and replaced by tablet 5498fab4c4cb4d5cba73cd6db6699ab5
I20250115 10:12:04.859452 4589 ts_tablet_manager.cc:1939] T 9077d0eed1974bc898370b5d5554be71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.859688 4589 tablet_replica.cc:331] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.859795 4589 raft_consensus.cc:2238] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:04.859786 3484 leader_election.cc:343] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.859810 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 5b354c8d0b264cd2a9de3d46f62e8384 (DEFAULT_TABLE table=default.Table_994ccfc74c4d41cb93b7df9cab4b0607 [id=96d10b16fb494e12bfa49f86e9c9232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.859830 3484 leader_election.cc:304] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.859843 4589 raft_consensus.cc:2267] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.859903 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b354c8d0b264cd2a9de3d46f62e8384. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.859892 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5498fab4c4cb4d5cba73cd6db6699ab5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.859930 4338 raft_consensus.cc:2743] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.859925 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 822b3e78b0ce4d01bfff2544b1964b7c (DEFAULT_TABLE table=default.Table_a3e6b80eacb049fe8a9d0d027d8f2804 [id=3e92ba7df6154d80908ba9185c02ffa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.860060 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 822b3e78b0ce4d01bfff2544b1964b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.860152 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 9077d0eed1974bc898370b5d5554be71 (table default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]) successfully deleted
I20250115 10:12:04.860183 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet cb353ea066dc474cac07e3adcfa6574d with delete_type TABLET_DATA_DELETED (replaced by tablet c537978805d44602ae5dd423773128e6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.861157 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5498fab4c4cb4d5cba73cd6db6699ab5) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.861194 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet cb353ea066dc474cac07e3adcfa6574d with delete_type TABLET_DATA_DELETED (replaced by tablet c537978805d44602ae5dd423773128e6) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.861245 3386 tablet_service.cc:1467] Processing CreateTablet for tablet f276b6fa123e4c25817ba6cb8970af8a (DEFAULT_TABLE table=default.Table_a105454ffc4f4c239e800f1df5f25b7e [id=9c8bf118427748998ae66219b52b14b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.861255 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet b580a5dc6a9c4a0f8b65ad9a92804e09 with delete_type TABLET_DATA_DELETED (replaced by tablet 5498fab4c4cb4d5cba73cd6db6699ab5) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.861342 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f276b6fa123e4c25817ba6cb8970af8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.861807 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet cb353ea066dc474cac07e3adcfa6574d with delete_type TABLET_DATA_DELETED (replaced by tablet c537978805d44602ae5dd423773128e6) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.861893 4551 tablet_replica.cc:331] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.861959 4551 raft_consensus.cc:2238] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.862061 4551 raft_consensus.cc:2267] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.862264 4551 ts_tablet_manager.cc:1905] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.862365 4589 ts_tablet_manager.cc:1905] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.862593 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3158fe922af5485aacb79290a874f648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:04.862737 5155 raft_consensus.cc:491] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:04.862766 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3158fe922af5485aacb79290a874f648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.862784 5155 raft_consensus.cc:513] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.862926 5155 leader_election.cc:290] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.862968 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d9658f77eb334a269d2aac555e308757"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.863080 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9658f77eb334a269d2aac555e308757 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.863308 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.863487 3215 leader_election.cc:343] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.863987 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.864181 3214 leader_election.cc:343] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.864224 3214 leader_election.cc:304] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.864297 5155 raft_consensus.cc:2743] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.864342 4551 ts_tablet_manager.cc:1918] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.864393 4551 log.cc:1198] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/b580a5dc6a9c4a0f8b65ad9a92804e09
I20250115 10:12:04.864569 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 5b354c8d0b264cd2a9de3d46f62e8384 (DEFAULT_TABLE table=default.Table_994ccfc74c4d41cb93b7df9cab4b0607 [id=96d10b16fb494e12bfa49f86e9c9232d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.864686 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b354c8d0b264cd2a9de3d46f62e8384. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.864713 4551 ts_tablet_manager.cc:1939] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.865010 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (table default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]) successfully deleted
I20250115 10:12:04.865183 4592 tablet_replica.cc:331] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.864939 4551 tablet_replica.cc:331] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.865253 4592 raft_consensus.cc:2238] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.865279 4551 raft_consensus.cc:2238] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.865291 4592 raft_consensus.cc:2267] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.865314 4551 raft_consensus.cc:2267] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.865445 4551 ts_tablet_manager.cc:1905] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.865650 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]) successfully deleted
W20250115 10:12:04.865744 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet cb353ea066dc474cac07e3adcfa6574d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb353ea066dc474cac07e3adcfa6574d already in progress: creating tablet
I20250115 10:12:04.865947 4592 ts_tablet_manager.cc:1905] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.866641 4875 consensus_queue.cc:1035] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.867177 4551 ts_tablet_manager.cc:1918] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.867229 4551 log.cc:1198] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/cb353ea066dc474cac07e3adcfa6574d
I20250115 10:12:04.867414 4592 ts_tablet_manager.cc:1918] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.867481 4592 log.cc:1198] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/b580a5dc6a9c4a0f8b65ad9a92804e09
I20250115 10:12:04.867584 4551 ts_tablet_manager.cc:1939] T cb353ea066dc474cac07e3adcfa6574d P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.868098 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet cb353ea066dc474cac07e3adcfa6574d (table default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]) successfully deleted
I20250115 10:12:04.868669 4589 ts_tablet_manager.cc:1918] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:04.868717 4589 log.cc:1198] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f55439e91f284175a59d35160668fa6c
I20250115 10:12:04.868920 4589 ts_tablet_manager.cc:1939] T f55439e91f284175a59d35160668fa6c P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.869278 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f55439e91f284175a59d35160668fa6c (table default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]) successfully deleted
I20250115 10:12:04.869392 4589 tablet_replica.cc:331] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.869462 4589 raft_consensus.cc:2238] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:04.869391 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet cb353ea066dc474cac07e3adcfa6574d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb353ea066dc474cac07e3adcfa6574d already in progress: creating tablet
I20250115 10:12:04.869386 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a6400bf1de024af4b73446837abbe6c5" } modify_external_catalogs: true
I20250115 10:12:04.869498 4589 raft_consensus.cc:2267] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.869494 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:04.869513 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a6400bf1de024af4b73446837abbe6c5" } modify_external_catalogs: true
I20250115 10:12:04.869586 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c199cca34ce04842a194169888b4c5d7" } modify_external_catalogs: true
I20250115 10:12:04.869623 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c199cca34ce04842a194169888b4c5d7" } modify_external_catalogs: true
I20250115 10:12:04.869728 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 8103671796f141c1b105c3296455274c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.869830 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8103671796f141c1b105c3296455274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.869863 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 8103671796f141c1b105c3296455274c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.869949 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8103671796f141c1b105c3296455274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.870954 4589 ts_tablet_manager.cc:1905] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.871661 4887 raft_consensus.cc:491] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.871754 4887 raft_consensus.cc:513] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.871886 4887 leader_election.cc:290] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.872009 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.872069 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ed70f5db0e492eaf0c42e005736ad1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.872246 3485 leader_election.cc:304] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.872323 4887 raft_consensus.cc:2743] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.872807 4589 ts_tablet_manager.cc:1918] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.872908 4589 log.cc:1198] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/b580a5dc6a9c4a0f8b65ad9a92804e09
I20250115 10:12:04.873126 4589 ts_tablet_manager.cc:1939] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.873472 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (table default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]) successfully deleted
I20250115 10:12:04.874409 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 8103671796f141c1b105c3296455274c (DEFAULT_TABLE table=default.Table_81d92177a29e4f1fa3c869df5e9beb21 [id=4e7f3c025c334531afdd701fa6b2def6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.874527 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8103671796f141c1b105c3296455274c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.876049 4592 ts_tablet_manager.cc:1939] T b580a5dc6a9c4a0f8b65ad9a92804e09 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.876670 4875 raft_consensus.cc:491] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.876709 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet c64affc7645145069d6197ede241585e from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.876735 4875 raft_consensus.cc:513] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.876842 4875 leader_election.cc:290] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.876915 4575 tablet_bootstrap.cc:492] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.876935 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet b580a5dc6a9c4a0f8b65ad9a92804e09 (table default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]) successfully deleted
I20250115 10:12:04.876960 4575 ts_tablet_manager.cc:1397] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.001s
I20250115 10:12:04.877002 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.877074 3550 raft_consensus.cc:2463] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.877125 4575 raft_consensus.cc:357] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.877202 4575 raft_consensus.cc:383] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.877238 4575 raft_consensus.cc:738] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.877285 4575 consensus_queue.cc:260] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.877399 4575 ts_tablet_manager.cc:1428] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.877364 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.877445 3279 raft_consensus.cc:2463] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.877462 4575 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.877902 4575 tablet_bootstrap.cc:654] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.878013 3350 leader_election.cc:304] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.878077 4875 raft_consensus.cc:2798] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.878118 4875 raft_consensus.cc:491] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.878145 4875 raft_consensus.cc:3054] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.878418 4575 tablet_bootstrap.cc:492] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.878453 4575 ts_tablet_manager.cc:1397] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.878882 4875 raft_consensus.cc:513] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.879017 4875 leader_election.cc:290] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.879153 4557 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.879201 4557 ts_tablet_manager.cc:1397] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.047s user 0.001s sys 0.000s
I20250115 10:12:04.879356 4557 raft_consensus.cc:357] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.879421 4557 raft_consensus.cc:383] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.879442 4557 raft_consensus.cc:738] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.879484 4557 consensus_queue.cc:260] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.879498 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.879544 3550 raft_consensus.cc:3054] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.879606 4557 ts_tablet_manager.cc:1428] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.879878 4557 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.880288 3550 raft_consensus.cc:2463] T 6d9a83c4de3849498be5c6e4f9c8b00c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.880337 4557 tablet_bootstrap.cc:654] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.880546 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d9a83c4de3849498be5c6e4f9c8b00c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.880591 3350 leader_election.cc:304] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.880620 3276 raft_consensus.cc:3054] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.880753 4699 raft_consensus.cc:2798] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.880805 4699 raft_consensus.cc:695] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.880846 4699 consensus_queue.cc:237] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.881294 3276 raft_consensus.cc:2463] T 6d9a83c4de3849498be5c6e4f9c8b00c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:04.881584 3350 consensus_peers.cc:487] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.878571 4575 raft_consensus.cc:357] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.881666 4575 raft_consensus.cc:383] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.881686 4575 raft_consensus.cc:738] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.882169 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f9acac6e5e8a486ea8e269359498c3a7
I20250115 10:12:04.882441 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:04.882534 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.882699 4551 tablet_replica.cc:331] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.882771 4551 raft_consensus.cc:2238] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.882890 4551 raft_consensus.cc:2267] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.883122 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 1d3bb9b55a54469e9c93e1e29f33e533
I20250115 10:12:04.883201 4575 consensus_queue.cc:260] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.883383 4575 ts_tablet_manager.cc:1428] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:04.883455 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.883455 4575 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.883602 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.883692 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d3bb9b55a54469e9c93e1e29f33e533 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.884006 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 1d3bb9b55a54469e9c93e1e29f33e533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3bb9b55a54469e9c93e1e29f33e533 already in progress: creating tablet
I20250115 10:12:04.884305 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.884418 4575 tablet_bootstrap.cc:654] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.884423 4474 catalog_manager.cc:5526] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.884544 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:04.884527 4589 tablet_replica.cc:331] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:04.884615 4589 raft_consensus.cc:2238] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:04.884680 4589 pending_rounds.cc:62] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:04.884702 4589 pending_rounds.cc:69] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489547104514048 op_type: NO_OP noop_request { }
I20250115 10:12:04.884740 4589 raft_consensus.cc:2883] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:04.884766 4589 raft_consensus.cc:2267] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.885254 4477 catalog_manager.cc:5526] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.885401 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_2bc1f827e44144f4b2bcc3b6a0229a54 [id=75a3cabc6ab0415992e902b02ea54d47]). Expected version 1 got 0
I20250115 10:12:04.885414 4589 ts_tablet_manager.cc:1905] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.885438 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]). Expected version 1 got 0
I20250115 10:12:04.885744 4557 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.885818 4557 ts_tablet_manager.cc:1397] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.885996 4557 raft_consensus.cc:357] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.886060 4557 raft_consensus.cc:383] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.886083 4557 raft_consensus.cc:738] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.886125 4557 consensus_queue.cc:260] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.884250 4551 ts_tablet_manager.cc:1905] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.886193 4575 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.886214 4557 ts_tablet_manager.cc:1428] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.886234 4575 ts_tablet_manager.cc:1397] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.886279 4557 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.886389 4575 raft_consensus.cc:357] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.886440 4575 raft_consensus.cc:383] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.886459 4575 raft_consensus.cc:738] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.886495 4575 consensus_queue.cc:260] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.886585 4575 ts_tablet_manager.cc:1428] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.886746 4557 tablet_bootstrap.cc:654] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.886922 4575 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.887332 4575 tablet_bootstrap.cc:654] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.887590 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:04.887650 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:04.887677 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a7e2086241df4b4fac5e481c5e8295a9 (table default.Table_99fc538b849348e19ef1968953d83866 [id=0b1b8cdb67244dc19aed82671327d212]). Expected version 1 got 0
I20250115 10:12:04.888124 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_08430ab01322483682c5ea1bb80c05bb" } modify_external_catalogs: true
I20250115 10:12:04.888183 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_08430ab01322483682c5ea1bb80c05bb" } modify_external_catalogs: true
I20250115 10:12:04.888783 3530 tablet_service.cc:1467] Processing CreateTablet for tablet ae24e71bb31a4407b5787467a995af7d (DEFAULT_TABLE table=default.Table_3158fe922af5485aacb79290a874f648 [id=1de437ca6b6c46cd811ac245a0b8d6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.888906 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae24e71bb31a4407b5787467a995af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.889138 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 5498fab4c4cb4d5cba73cd6db6699ab5 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.889271 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5498fab4c4cb4d5cba73cd6db6699ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.890170 3387 tablet_service.cc:1467] Processing CreateTablet for tablet c537978805d44602ae5dd423773128e6 (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.890216 3381 tablet_service.cc:1467] Processing CreateTablet for tablet 5498fab4c4cb4d5cba73cd6db6699ab5 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.890273 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c537978805d44602ae5dd423773128e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.890303 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 5498fab4c4cb4d5cba73cd6db6699ab5 (DEFAULT_TABLE table=default.Table_0e71dac929ff4e3691493a57b54cc977 [id=ec120a62d29e4a2e9c42ffc8719394b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.890334 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5498fab4c4cb4d5cba73cd6db6699ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.890385 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5498fab4c4cb4d5cba73cd6db6699ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.891505 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 420676dd3e20497b9cc05ec93929276c (DEFAULT_TABLE table=default.Table_d9658f77eb334a269d2aac555e308757 [id=e021cb8beeb14bad9a3d8dde9a7075ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.891531 3377 tablet_service.cc:1467] Processing CreateTablet for tablet ae24e71bb31a4407b5787467a995af7d (DEFAULT_TABLE table=default.Table_3158fe922af5485aacb79290a874f648 [id=1de437ca6b6c46cd811ac245a0b8d6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.891630 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420676dd3e20497b9cc05ec93929276c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.891654 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 420676dd3e20497b9cc05ec93929276c (DEFAULT_TABLE table=default.Table_d9658f77eb334a269d2aac555e308757 [id=e021cb8beeb14bad9a3d8dde9a7075ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.891692 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae24e71bb31a4407b5787467a995af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.891762 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420676dd3e20497b9cc05ec93929276c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.891932 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet ac8b3c397070467196b73dedcacf22de with delete_type TABLET_DATA_DELETED (replaced by tablet 03d897d86e1b456b973c9b689bd4d7c6) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.892664 3241 tablet_service.cc:1467] Processing CreateTablet for tablet c537978805d44602ae5dd423773128e6 (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.892752 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c537978805d44602ae5dd423773128e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.892779 4887 raft_consensus.cc:491] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.892834 4887 raft_consensus.cc:513] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.892954 4887 leader_election.cc:290] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.893368 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ffe30b01774a4345992fa0b29ee7f418
I20250115 10:12:04.893376 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7c1c0ac4d3487187907a49343381c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.893433 3276 raft_consensus.cc:2463] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.893430 3523 tablet_service.cc:1467] Processing CreateTablet for tablet c537978805d44602ae5dd423773128e6 (DEFAULT_TABLE table=default.Table_2d58f2e9fdcb4b38a1aa71b5a37a8f4f [id=9834f0b0123940a68596d72746b37f11]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.893551 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c537978805d44602ae5dd423773128e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.893712 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7c1c0ac4d3487187907a49343381c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.893894 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe30b01774a4345992fa0b29ee7f418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.894007 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe30b01774a4345992fa0b29ee7f418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.894013 3485 leader_election.cc:304] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:04.894598 3484 leader_election.cc:343] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.894682 4887 raft_consensus.cc:2798] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.894717 4887 raft_consensus.cc:491] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.894739 4887 raft_consensus.cc:3054] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.894706 5199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:04.894788 5199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:12:04.895164 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 61cc55da8a4c4da2b94321a912418747
I20250115 10:12:04.895383 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cc55da8a4c4da2b94321a912418747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:04.895411 3377 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cc55da8a4c4da2b94321a912418747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.895424 4887 raft_consensus.cc:513] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.895539 4887 leader_election.cc:290] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.895730 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7c1c0ac4d3487187907a49343381c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.895843 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet ffe30b01774a4345992fa0b29ee7f418 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.895942 3484 leader_election.cc:343] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.896036 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 420676dd3e20497b9cc05ec93929276c (DEFAULT_TABLE table=default.Table_d9658f77eb334a269d2aac555e308757 [id=e021cb8beeb14bad9a3d8dde9a7075ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.896129 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420676dd3e20497b9cc05ec93929276c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.896414 4551 ts_tablet_manager.cc:1918] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.896826 4589 ts_tablet_manager.cc:1918] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:04.896875 4589 log.cc:1198] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f9acac6e5e8a486ea8e269359498c3a7
I20250115 10:12:04.897009 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7c1c0ac4d3487187907a49343381c0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.897079 3276 raft_consensus.cc:3054] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.897142 4589 ts_tablet_manager.cc:1939] T f9acac6e5e8a486ea8e269359498c3a7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:04.897351 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet f9acac6e5e8a486ea8e269359498c3a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.897276 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 61cc55da8a4c4da2b94321a912418747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.897473 4592 tablet_replica.cc:331] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:04.897468 4551 log.cc:1198] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f9acac6e5e8a486ea8e269359498c3a7
I20250115 10:12:04.897478 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f9acac6e5e8a486ea8e269359498c3a7 (table default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]) successfully deleted
I20250115 10:12:04.897536 4592 raft_consensus.cc:2238] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250115 10:12:04.897542 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet ffe30b01774a4345992fa0b29ee7f418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe30b01774a4345992fa0b29ee7f418 already in progress: creating tablet
I20250115 10:12:04.897570 4592 raft_consensus.cc:2267] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:04.897593 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 61cc55da8a4c4da2b94321a912418747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61cc55da8a4c4da2b94321a912418747 already in progress: creating tablet
I20250115 10:12:04.897647 4551 ts_tablet_manager.cc:1939] T f9acac6e5e8a486ea8e269359498c3a7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.897675 4592 ts_tablet_manager.cc:1905] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.897760 3276 raft_consensus.cc:2463] T 0d7c1c0ac4d3487187907a49343381c0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.897869 4551 tablet_replica.cc:331] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.897928 4551 raft_consensus.cc:2238] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.897984 4551 raft_consensus.cc:2267] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.898276 4551 ts_tablet_manager.cc:1905] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.898406 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f9acac6e5e8a486ea8e269359498c3a7 (table default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]) successfully deleted
W20250115 10:12:04.898420 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 1d3bb9b55a54469e9c93e1e29f33e533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3bb9b55a54469e9c93e1e29f33e533 already in progress: creating tablet
W20250115 10:12:04.898487 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 61cc55da8a4c4da2b94321a912418747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61cc55da8a4c4da2b94321a912418747 already in progress: creating tablet
W20250115 10:12:04.898501 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 1d3bb9b55a54469e9c93e1e29f33e533 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d3bb9b55a54469e9c93e1e29f33e533 already in progress: creating tablet
W20250115 10:12:04.898547 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet ffe30b01774a4345992fa0b29ee7f418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe30b01774a4345992fa0b29ee7f418 already in progress: creating tablet
I20250115 10:12:04.898661 4887 raft_consensus.cc:491] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.898669 3485 leader_election.cc:304] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:04.898721 3242 tablet_service.cc:1467] Processing CreateTablet for tablet ae24e71bb31a4407b5787467a995af7d (DEFAULT_TABLE table=default.Table_3158fe922af5485aacb79290a874f648 [id=1de437ca6b6c46cd811ac245a0b8d6b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.898722 4887 raft_consensus.cc:513] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.898814 4433 raft_consensus.cc:2798] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.898835 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae24e71bb31a4407b5787467a995af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.898838 4887 leader_election.cc:290] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.898854 4433 raft_consensus.cc:695] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.898892 4433 consensus_queue.cc:237] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.899194 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.899470 3484 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.900017 4551 ts_tablet_manager.cc:1918] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.900031 4592 ts_tablet_manager.cc:1918] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.900061 4551 log.cc:1198] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/ac8b3c397070467196b73dedcacf22de
I20250115 10:12:04.900079 4592 log.cc:1198] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/f9acac6e5e8a486ea8e269359498c3a7
I20250115 10:12:04.900221 4551 ts_tablet_manager.cc:1939] T ac8b3c397070467196b73dedcacf22de P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.900256 4592 ts_tablet_manager.cc:1939] T f9acac6e5e8a486ea8e269359498c3a7 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.900557 4575 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.900566 4699 raft_consensus.cc:491] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.900642 4699 raft_consensus.cc:513] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.900785 4699 leader_election.cc:290] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.900604 4575 ts_tablet_manager.cc:1397] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
W20250115 10:12:04.900841 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:04.900990 4575 raft_consensus.cc:357] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.901047 4575 raft_consensus.cc:383] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.901072 4575 raft_consensus.cc:738] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.901077 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.901118 4575 consensus_queue.cc:260] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.901218 4575 ts_tablet_manager.cc:1428] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.901305 4575 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.901834 4575 tablet_bootstrap.cc:654] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.902218 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.902293 3279 raft_consensus.cc:2463] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.902354 4575 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.902398 4575 ts_tablet_manager.cc:1397] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
W20250115 10:12:04.902421 3350 leader_election.cc:343] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.902485 3350 leader_election.cc:304] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.902525 4575 raft_consensus.cc:357] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.902565 4575 raft_consensus.cc:383] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.902582 4575 raft_consensus.cc:738] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.902634 4714 raft_consensus.cc:2798] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.902698 4714 raft_consensus.cc:491] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.902734 4714 raft_consensus.cc:3054] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.902634 4575 consensus_queue.cc:260] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.903101 4575 ts_tablet_manager.cc:1428] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.903168 4575 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.903481 4714 raft_consensus.cc:513] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.903591 4575 tablet_bootstrap.cc:654] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.903605 4714 leader_election.cc:290] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.903970 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.904145 3350 leader_election.cc:343] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.904209 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.904273 4575 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.904279 3279 raft_consensus.cc:3054] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.904304 4575 ts_tablet_manager.cc:1397] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.904435 4575 raft_consensus.cc:357] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.904492 4575 raft_consensus.cc:383] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.904510 4575 raft_consensus.cc:738] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.904556 4569 tablet_bootstrap.cc:492] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.904546 4575 consensus_queue.cc:260] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.904594 4569 ts_tablet_manager.cc:1397] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.060s user 0.000s sys 0.001s
I20250115 10:12:04.904628 4575 ts_tablet_manager.cc:1428] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.904633 4557 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.904682 4575 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.904680 4557 ts_tablet_manager.cc:1397] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250115 10:12:04.904727 4569 raft_consensus.cc:357] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.904800 4569 raft_consensus.cc:383] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.904824 4569 raft_consensus.cc:738] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.904834 4557 raft_consensus.cc:357] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.904865 4569 consensus_queue.cc:260] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.904903 4557 raft_consensus.cc:383] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.904927 4557 raft_consensus.cc:738] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.904939 3279 raft_consensus.cc:2463] T 98e5519e80144b7582d76b7f9d8d6ffa P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.904968 4569 ts_tablet_manager.cc:1428] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.904973 4557 consensus_queue.cc:260] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.905032 4569 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.905076 4575 tablet_bootstrap.cc:654] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.905105 4557 ts_tablet_manager.cc:1428] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.905179 4557 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.905432 4699 raft_consensus.cc:491] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.905472 4699 raft_consensus.cc:513] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.905591 4699 leader_election.cc:290] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.905607 4569 tablet_bootstrap.cc:654] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.905627 4557 tablet_bootstrap.cc:654] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.905855 4575 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.905892 4575 ts_tablet_manager.cc:1397] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:04.906029 4575 raft_consensus.cc:357] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.906087 4575 raft_consensus.cc:383] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.906111 4575 raft_consensus.cc:738] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.906154 4575 consensus_queue.cc:260] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.906255 4575 ts_tablet_manager.cc:1428] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.906291 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet f9acac6e5e8a486ea8e269359498c3a7 (table default.Table_c199cca34ce04842a194169888b4c5d7 [id=332de19ac8614789a895f3c744bbc27f]) successfully deleted
I20250115 10:12:04.906311 4338 raft_consensus.cc:491] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.906329 4575 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.906353 4338 raft_consensus.cc:513] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.906464 4338 leader_election.cc:290] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.906708 4575 tablet_bootstrap.cc:654] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.906956 3350 leader_election.cc:304] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.907058 4587 raft_consensus.cc:2798] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.907127 4587 raft_consensus.cc:695] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.907158 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.907176 4587 consensus_queue.cc:237] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.907261 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.907681 3350 leader_election.cc:343] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.907689 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 8c045349a48644eda41ea8965b16174d
I20250115 10:12:04.907658 3952 consensus_queue.cc:1035] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.907745 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 616166bc9d5d4651999b1d2e0a1851bb
I20250115 10:12:04.905020 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.907843 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.907915 3279 raft_consensus.cc:2463] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.908228 3350 leader_election.cc:304] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.908412 4699 raft_consensus.cc:2798] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.908463 4699 raft_consensus.cc:491] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.908488 4699 raft_consensus.cc:3054] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.908768 4887 raft_consensus.cc:491] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.908807 4887 raft_consensus.cc:513] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.908878 4887 leader_election.cc:290] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.909245 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
W20250115 10:12:04.909240 3485 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.909277 3485 leader_election.cc:304] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.909232 4699 raft_consensus.cc:513] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.909345 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.909469 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.908495 4575 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.909515 3389 tablet_service.cc:1514] Processing DeleteTablet for tablet 36b19ae7373c4de688ae30eb7e1d9eab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:04.909556 4575 ts_tablet_manager.cc:1397] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:04.909602 4592 tablet_replica.cc:331] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
W20250115 10:12:04.909626 3484 leader_election.cc:343] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.909627 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.909651 4592 raft_consensus.cc:2238] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.909678 3276 raft_consensus.cc:3054] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.909682 4592 raft_consensus.cc:2267] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.909675 4575 raft_consensus.cc:357] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.909755 4575 raft_consensus.cc:383] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.909356 4699 leader_election.cc:290] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.909873 4592 ts_tablet_manager.cc:1905] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.910017 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc2b34be581f44028fed1514c78d1874" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.910079 3279 raft_consensus.cc:2388] T dc2b34be581f44028fed1514c78d1874 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:04.910248 3276 raft_consensus.cc:2463] T 82c66363913e47399c4e1e8533bdadd0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.910398 3350 leader_election.cc:304] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.910451 3350 leader_election.cc:343] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.910523 4887 raft_consensus.cc:2743] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.909816 4575 raft_consensus.cc:738] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.910645 4575 consensus_queue.cc:260] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.910737 4575 ts_tablet_manager.cc:1428] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:04.910766 3485 leader_election.cc:304] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.910794 4575 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.910866 4587 raft_consensus.cc:2798] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.910917 4587 raft_consensus.cc:695] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.910959 4587 consensus_queue.cc:237] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.911140 4592 ts_tablet_manager.cc:1918] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.911182 4575 tablet_bootstrap.cc:654] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.911526 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.911183 4592 log.cc:1198] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/36b19ae7373c4de688ae30eb7e1d9eab
I20250115 10:12:04.911801 4592 ts_tablet_manager.cc:1939] T 36b19ae7373c4de688ae30eb7e1d9eab P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:04.911801 4887 raft_consensus.cc:3054] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.912030 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 8c045349a48644eda41ea8965b16174d
I20250115 10:12:04.912083 4474 catalog_manager.cc:5526] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.912406 4887 raft_consensus.cc:2743] T dc2b34be581f44028fed1514c78d1874 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.912744 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
W20250115 10:12:04.913231 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
W20250115 10:12:04.913280 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:04.913311 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:04.913282 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet 36b19ae7373c4de688ae30eb7e1d9eab (table default.Table_3a151d1a3a4f4bd89f2a1fec8a3caf42 [id=ee5989ff607243e38ee167a4d318eaaf]) successfully deleted
I20250115 10:12:04.913518 4890 tablet.cc:1721] T 3f81769b500149f7b2bf7cdf76f7ee27 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.914202 4662 tablet.cc:1721] T 3f81769b500149f7b2bf7cdf76f7ee27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:04.914549 3485 leader_election.cc:343] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.914654 3485 leader_election.cc:304] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.914834 4433 raft_consensus.cc:2743] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.915352 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 9077d0eed1974bc898370b5d5554be71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.916368 4477 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6f88aa1b8e7647eb981a2782c248902d" } new_table_name: "default.Table_7c2bc8549a054450aa8c797399219162" modify_external_catalogs: true
I20250115 10:12:04.917778 4551 tablet_replica.cc:331] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
W20250115 10:12:04.918203 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.918994 4575 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.919036 4575 ts_tablet_manager.cc:1397] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.919169 4575 raft_consensus.cc:357] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.919229 4575 raft_consensus.cc:383] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.919250 4575 raft_consensus.cc:738] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.919281 4575 consensus_queue.cc:260] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.919322 4477 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bdc347f892a64f3e84c4414fce486de6 consensus state has no leader
I20250115 10:12:04.919361 4575 ts_tablet_manager.cc:1428] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.919405 4575 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.919811 4575 tablet_bootstrap.cc:654] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.920156 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet ac8b3c397070467196b73dedcacf22de (table default.Table_d049d9f9e2b94476a35abc8a6e30c57e [id=b666cda3961944debdf10e2c2d98c4d5]) successfully deleted
W20250115 10:12:04.920238 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet ffe30b01774a4345992fa0b29ee7f418 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffe30b01774a4345992fa0b29ee7f418 already in progress: creating tablet
W20250115 10:12:04.920290 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 61cc55da8a4c4da2b94321a912418747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61cc55da8a4c4da2b94321a912418747 already in progress: creating tablet
I20250115 10:12:04.920830 4338 consensus_queue.cc:1035] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.919697 5155 consensus_queue.cc:1035] T 52c44b485fd84ea8a954c1eb5b8ff5b5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250115 10:12:04.921028 4477 catalog_manager.cc:5526] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.921489 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97] alter complete (version 1)
I20250115 10:12:04.921751 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 8eec0ec85d5040168145d8ecf6a48184 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:04.921859 5155 raft_consensus.cc:491] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.921911 5155 raft_consensus.cc:513] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.922004 5155 leader_election.cc:290] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.922008 4551 raft_consensus.cc:2238] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.922060 4551 raft_consensus.cc:2267] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.922227 4551 ts_tablet_manager.cc:1905] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.922250 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.922322 3411 raft_consensus.cc:2463] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.922991 3214 leader_election.cc:304] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.923077 5155 raft_consensus.cc:2798] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.923100 5155 raft_consensus.cc:491] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.923128 5155 raft_consensus.cc:3054] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.923820 5155 raft_consensus.cc:513] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.923964 5155 leader_election.cc:290] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.924275 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.924335 3411 raft_consensus.cc:3054] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.924398 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.924466 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.924764 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 8eec0ec85d5040168145d8ecf6a48184
I20250115 10:12:04.924849 4474 catalog_manager.cc:6596] ReplaceTablet: tablet 8eec0ec85d5040168145d8ecf6a48184 deleted and replaced by tablet 43fbb0a09ea8446eaee4cf38e222431b
I20250115 10:12:04.925101 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.925173 3547 raft_consensus.cc:2463] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:04.925101 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76499a085d9d4f74818684d3148a4866" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.925259 3550 raft_consensus.cc:3054] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.925588 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 with delete_type TABLET_DATA_DELETED (replaced by tablet 43fbb0a09ea8446eaee4cf38e222431b) from {username='slave'} at 127.0.0.1:46330
W20250115 10:12:04.925838 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 8eec0ec85d5040168145d8ecf6a48184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eec0ec85d5040168145d8ecf6a48184 already in progress: creating tablet
I20250115 10:12:04.926035 3550 raft_consensus.cc:2463] T 76499a085d9d4f74818684d3148a4866 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.926479 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 with delete_type TABLET_DATA_DELETED (replaced by tablet 43fbb0a09ea8446eaee4cf38e222431b) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:04.926699 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
I20250115 10:12:04.926697 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 8eec0ec85d5040168145d8ecf6a48184 with delete_type TABLET_DATA_DELETED (replaced by tablet 43fbb0a09ea8446eaee4cf38e222431b) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:04.926931 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 8eec0ec85d5040168145d8ecf6a48184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eec0ec85d5040168145d8ecf6a48184 already in progress: creating tablet
I20250115 10:12:04.927138 3215 leader_election.cc:304] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.927237 3952 raft_consensus.cc:2798] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.927280 3952 raft_consensus.cc:695] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:04.927323 3952 consensus_queue.cc:237] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.927551 4699 consensus_queue.cc:1035] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.927953 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbb0a09ea8446eaee4cf38e222431b (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.928057 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43fbb0a09ea8446eaee4cf38e222431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.928508 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbb0a09ea8446eaee4cf38e222431b (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.928599 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43fbb0a09ea8446eaee4cf38e222431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.928776 4474 catalog_manager.cc:5526] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.929941 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 43fbb0a09ea8446eaee4cf38e222431b (DEFAULT_TABLE table=default.Table_ebf48b3ee3564dcf9e39755c3cdab956 [id=abf619cc3f6548f79f10be48b7ce2870]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.930045 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43fbb0a09ea8446eaee4cf38e222431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.930375 4551 ts_tablet_manager.cc:1918] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.930441 4551 log.cc:1198] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/9077d0eed1974bc898370b5d5554be71
I20250115 10:12:04.930651 4551 ts_tablet_manager.cc:1939] T 9077d0eed1974bc898370b5d5554be71 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.931115 4569 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.931160 4569 ts_tablet_manager.cc:1397] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
I20250115 10:12:04.931320 4569 raft_consensus.cc:357] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.931373 4569 raft_consensus.cc:383] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.931392 4569 raft_consensus.cc:738] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.931407 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 9077d0eed1974bc898370b5d5554be71 (table default.Table_4b98590d43434ddb8446bd4c522dee69 [id=c9fb24c78a664a3e9ba2d66bf974f1b9]) successfully deleted
I20250115 10:12:04.931427 4569 consensus_queue.cc:260] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:04.931475 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 8eec0ec85d5040168145d8ecf6a48184 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8eec0ec85d5040168145d8ecf6a48184 already in progress: creating tablet
I20250115 10:12:04.931545 4569 ts_tablet_manager.cc:1428] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.931612 4569 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.931916 3411 raft_consensus.cc:2463] T 76499a085d9d4f74818684d3148a4866 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:04.932008 4569 tablet_bootstrap.cc:654] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.932469 3550 raft_consensus.cc:3054] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.932791 4575 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.932847 4575 ts_tablet_manager.cc:1397] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20250115 10:12:04.932997 4575 raft_consensus.cc:357] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.933032 4569 tablet_bootstrap.cc:492] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.933061 4575 raft_consensus.cc:383] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.933070 4569 ts_tablet_manager.cc:1397] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.933082 4575 raft_consensus.cc:738] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.933123 4575 consensus_queue.cc:260] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.933226 4575 ts_tablet_manager.cc:1428] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.933244 4569 raft_consensus.cc:357] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.933290 4575 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.933300 4569 raft_consensus.cc:383] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.933318 4569 raft_consensus.cc:738] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.933357 4569 consensus_queue.cc:260] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.933470 4569 ts_tablet_manager.cc:1428] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.933523 4569 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.933938 4569 tablet_bootstrap.cc:654] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.933950 4575 tablet_bootstrap.cc:654] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.934226 4873 tablet.cc:1721] T 29ed70f5db0e492eaf0c42e005736ad1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.934638 4887 raft_consensus.cc:491] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.934677 4887 raft_consensus.cc:513] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.934760 4887 leader_election.cc:290] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:04.935443 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:04.935503 4335 raft_consensus.cc:491] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.935547 4335 raft_consensus.cc:513] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.935653 4335 leader_election.cc:290] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.935639 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.936041 3484 leader_election.cc:343] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.936407 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 29ed70f5db0e492eaf0c42e005736ad1 (table default.Table_ae5773271b544b30abdf0b371cadb4f1 [id=cc91f8c8f0a441e8b2604164c4ec82e4]). Expected version 1 got 0
I20250115 10:12:04.936051 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.936703 3215 leader_election.cc:343] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.937110 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.937234 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.937463 3214 leader_election.cc:343] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.937506 3214 leader_election.cc:304] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.937600 5155 raft_consensus.cc:2743] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.937796 3485 leader_election.cc:343] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.937837 3485 leader_election.cc:304] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:04.937945 3350 consensus_peers.cc:487] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d35847dc829b4b3d94c0fb68ec6c2b31. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.938017 4887 raft_consensus.cc:2743] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.938599 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.938629 5155 raft_consensus.cc:491] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.938671 5155 raft_consensus.cc:513] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.938689 4714 consensus_queue.cc:1035] T c64affc7645145069d6197ede241585e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.938763 5155 leader_election.cc:290] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.938971 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.939040 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.939147 3215 leader_election.cc:343] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.939218 3214 leader_election.cc:343] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.939249 3214 leader_election.cc:304] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.939306 4335 raft_consensus.cc:2743] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.939672 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
W20250115 10:12:04.940289 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 11725ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:04.940757 4557 tablet_bootstrap.cc:492] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.940809 4557 ts_tablet_manager.cc:1397] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20250115 10:12:04.940979 4557 raft_consensus.cc:357] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.941053 4557 raft_consensus.cc:383] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.941077 4557 raft_consensus.cc:738] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.941111 4557 consensus_queue.cc:260] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.941166 4575 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.941216 4575 ts_tablet_manager.cc:1397] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:04.941215 4557 ts_tablet_manager.cc:1428] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.941267 4557 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.941351 4575 raft_consensus.cc:357] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.941427 4575 raft_consensus.cc:383] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.941450 4575 raft_consensus.cc:738] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.941498 4575 consensus_queue.cc:260] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.941587 4575 ts_tablet_manager.cc:1428] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.941660 4575 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.941708 4557 tablet_bootstrap.cc:654] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.941936 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.942101 4575 tablet_bootstrap.cc:654] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.942896 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
W20250115 10:12:04.943361 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:04.943562 4569 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.943600 4569 ts_tablet_manager.cc:1397] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:04.943850 4569 raft_consensus.cc:357] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.943917 4569 raft_consensus.cc:383] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.943934 4569 raft_consensus.cc:738] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.943971 4569 consensus_queue.cc:260] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.944052 4569 ts_tablet_manager.cc:1428] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:04.944105 4569 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.944475 4569 tablet_bootstrap.cc:654] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.945132 4887 consensus_queue.cc:1035] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.945264 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.946034 4714 raft_consensus.cc:491] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.946094 4714 raft_consensus.cc:513] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.946159 4569 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.946204 4714 leader_election.cc:290] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.946219 4569 ts_tablet_manager.cc:1397] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:04.946280 4575 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.946317 4575 ts_tablet_manager.cc:1397] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:04.946350 4569 raft_consensus.cc:357] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.946410 4569 raft_consensus.cc:383] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.946434 4569 raft_consensus.cc:738] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.946470 4569 consensus_queue.cc:260] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.946467 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.946467 4575 raft_consensus.cc:357] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.946542 4575 raft_consensus.cc:383] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.946565 4575 raft_consensus.cc:738] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.946597 4569 ts_tablet_manager.cc:1428] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.946606 4575 consensus_queue.cc:260] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.946648 4569 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.946666 3350 leader_election.cc:343] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.946702 4575 ts_tablet_manager.cc:1428] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.946763 4575 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:04.947041 4569 tablet_bootstrap.cc:654] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.947158 4575 tablet_bootstrap.cc:654] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.947425 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.947475 4908 raft_consensus.cc:491] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.947525 4908 raft_consensus.cc:513] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.947588 4557 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.947625 4557 ts_tablet_manager.cc:1397] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:04.947633 4908 leader_election.cc:290] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.947703 3952 consensus_queue.cc:1035] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.947793 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.947820 4557 raft_consensus.cc:357] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.947873 4557 raft_consensus.cc:383] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.947894 4557 raft_consensus.cc:738] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:12:04.947932 3214 leader_election.cc:343] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.947935 4557 consensus_queue.cc:260] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.947484 3276 raft_consensus.cc:2463] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.948045 4557 ts_tablet_manager.cc:1428] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:04.948120 4557 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.948139 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_d8204dbea13e49cc85f44f199f3004f3 [id=59ace488897c42a3a28b6118667f6403]). Expected version 2 got 0
I20250115 10:12:04.948489 4557 tablet_bootstrap.cc:654] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.948782 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.948797 3350 leader_election.cc:304] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.948880 4877 raft_consensus.cc:2798] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.948908 4877 raft_consensus.cc:491] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.948928 4877 raft_consensus.cc:3054] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.949558 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_779a075814744834909ab78772a470d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.949679 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_779a075814744834909ab78772a470d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.949666 4877 raft_consensus.cc:513] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.949788 4877 leader_election.cc:290] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.950721 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fbcd4787a734c5bba29f8a600abf874 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:04 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:04.950872 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f043cb2f81ea453b8d2d5c69eb66e609" } new_table_name: "default.Table_4c9ef381d60040c587c1a743bb9c66f1" modify_external_catalogs: true
I20250115 10:12:04.951148 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_bad10177c85c46b194b12736ca2e50b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.951251 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bad10177c85c46b194b12736ca2e50b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.951799 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.952029 3215 leader_election.cc:343] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.952067 3215 leader_election.cc:304] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.952186 3952 raft_consensus.cc:2743] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.952188 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.952435 3276 raft_consensus.cc:3054] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.952518 4551 tablet_replica.cc:331] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:04.952659 4551 raft_consensus.cc:2238] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:04.952790 4551 raft_consensus.cc:2267] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:04.952981 4569 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.953006 4887 raft_consensus.cc:491] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.953022 4569 ts_tablet_manager.cc:1397] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:04.953048 4887 raft_consensus.cc:513] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.953119 4551 ts_tablet_manager.cc:1905] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:04.953161 4887 leader_election.cc:290] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.953193 3276 raft_consensus.cc:2463] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.953181 4569 raft_consensus.cc:357] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.953236 4569 raft_consensus.cc:383] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.953258 4569 raft_consensus.cc:738] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.953296 4569 consensus_queue.cc:260] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.953399 4569 ts_tablet_manager.cc:1428] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.953466 4569 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.953506 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f778154f3bc3420abe9eb87608228bc3 consensus state has no leader
I20250115 10:12:04.953778 3547 raft_consensus.cc:3054] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.953888 4569 tablet_bootstrap.cc:654] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.955374 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 7a16c0f3e32e4f92b685eef31ca31744 (DEFAULT_TABLE table=default.Table_779a075814744834909ab78772a470d9 [id=400fc9113d634255a15e1bc6fe5a6a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.955492 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a16c0f3e32e4f92b685eef31ca31744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.956334 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 7a16c0f3e32e4f92b685eef31ca31744 (DEFAULT_TABLE table=default.Table_779a075814744834909ab78772a470d9 [id=400fc9113d634255a15e1bc6fe5a6a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.956470 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a16c0f3e32e4f92b685eef31ca31744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.957041 4551 ts_tablet_manager.cc:1918] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:04.957120 4551 log.cc:1198] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/9fbcd4787a734c5bba29f8a600abf874
I20250115 10:12:04.957412 4569 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.957397 4551 ts_tablet_manager.cc:1939] T 9fbcd4787a734c5bba29f8a600abf874 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:04.957453 4569 ts_tablet_manager.cc:1397] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:04.957674 4569 raft_consensus.cc:357] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.957726 4569 raft_consensus.cc:383] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.957770 4569 raft_consensus.cc:738] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.957813 4569 consensus_queue.cc:260] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.957929 4569 ts_tablet_manager.cc:1428] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.957976 4569 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.958163 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.958370 4569 tablet_bootstrap.cc:654] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.958364 3484 leader_election.cc:343] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.958765 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 9fbcd4787a734c5bba29f8a600abf874 (table default.Table_e0f1a11511f24abc9a4d094b016522fe [id=c800383272d24119b296faf848b5d048]) successfully deleted
I20250115 10:12:04.958843 4714 raft_consensus.cc:491] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.958868 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 7a16c0f3e32e4f92b685eef31ca31744 (DEFAULT_TABLE table=default.Table_779a075814744834909ab78772a470d9 [id=400fc9113d634255a15e1bc6fe5a6a01]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.958889 4714 raft_consensus.cc:513] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.958946 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a16c0f3e32e4f92b685eef31ca31744. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.959012 4714 leader_election.cc:290] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.959049 4714 raft_consensus.cc:491] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.959077 4714 raft_consensus.cc:513] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.959142 4714 leader_election.cc:290] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.959379 3350 leader_election.cc:304] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.959417 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:04.959443 3350 leader_election.cc:343] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.959475 3280 raft_consensus.cc:2463] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.959528 4699 raft_consensus.cc:2798] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.959564 4699 raft_consensus.cc:695] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.959558 4908 consensus_queue.cc:1035] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.959623 4699 consensus_queue.cc:237] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.959818 3350 leader_election.cc:304] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.959904 4699 raft_consensus.cc:2798] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.959940 4699 raft_consensus.cc:491] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.959964 4699 raft_consensus.cc:3054] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.960692 4699 raft_consensus.cc:513] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.960844 4699 leader_election.cc:290] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.961120 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.961180 3280 raft_consensus.cc:3054] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.961650 4569 tablet_bootstrap.cc:492] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.961704 4569 ts_tablet_manager.cc:1397] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:04.961838 3280 raft_consensus.cc:2463] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.961880 4569 raft_consensus.cc:357] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.961956 4569 raft_consensus.cc:383] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.961972 4569 raft_consensus.cc:738] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.962021 4569 consensus_queue.cc:260] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.962097 4569 ts_tablet_manager.cc:1428] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.962169 4569 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.962560 4569 tablet_bootstrap.cc:654] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.962797 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.962881 3279 raft_consensus.cc:2463] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.962968 3350 leader_election.cc:304] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:04.963065 4875 raft_consensus.cc:2798] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.963083 4908 raft_consensus.cc:491] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.963114 4875 raft_consensus.cc:695] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.963124 4908 raft_consensus.cc:513] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.963158 4875 consensus_queue.cc:237] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.963227 4908 leader_election.cc:290] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.963541 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.963665 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.963769 4887 raft_consensus.cc:491] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.963815 4887 raft_consensus.cc:513] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.963940 4887 leader_election.cc:290] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.964294 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf567628009460dbb7bfa582f69b4f1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.964366 3279 raft_consensus.cc:2463] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.964309 3952 consensus_queue.cc:1035] T b5bf4d0bb3c847d5bf0b0697f8334e0a P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:04.964515 3215 leader_election.cc:343] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.964553 3485 leader_election.cc:304] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.964671 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.964736 3548 raft_consensus.cc:2463] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.964803 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:04.964957 4434 raft_consensus.cc:2798] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.964985 4434 raft_consensus.cc:491] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.965001 4434 raft_consensus.cc:3054] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.965654 4434 raft_consensus.cc:513] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.965773 4434 leader_election.cc:290] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:04.966050 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:04.966212 3214 leader_election.cc:343] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.966254 3214 leader_election.cc:304] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.966286 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf567628009460dbb7bfa582f69b4f1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.966315 3952 raft_consensus.cc:2743] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.966348 3415 raft_consensus.cc:2463] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:04.966290 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf567628009460dbb7bfa582f69b4f1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:04.966424 3413 raft_consensus.cc:3054] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.967103 3413 raft_consensus.cc:2463] T fcf567628009460dbb7bfa582f69b4f1 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.967217 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.967262 3350 leader_election.cc:304] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:04.967321 3350 leader_election.cc:343] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:04.967365 3350 leader_election.cc:343] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.967382 4877 raft_consensus.cc:2798] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.967422 4877 raft_consensus.cc:491] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.967443 4877 raft_consensus.cc:3054] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.968225 4877 raft_consensus.cc:513] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.968350 4877 leader_election.cc:290] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:04.968693 3485 leader_election.cc:343] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.968735 3485 leader_election.cc:304] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:04.968792 4434 raft_consensus.cc:2743] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.969025 3484 leader_election.cc:304] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.969240 4434 raft_consensus.cc:2798] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.969291 4434 raft_consensus.cc:695] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:04.969323 4434 consensus_queue.cc:237] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.969782 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf567628009460dbb7bfa582f69b4f1" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.969833 3276 raft_consensus.cc:3054] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.969863 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.969907 3550 raft_consensus.cc:3054] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.970423 3276 raft_consensus.cc:2463] T fcf567628009460dbb7bfa582f69b4f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:04.970512 3550 raft_consensus.cc:2463] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.970813 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1465bcc80e40cdad4e0722eb0d74c3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.970881 3279 raft_consensus.cc:3054] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.971292 3350 leader_election.cc:304] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:04.971633 3279 raft_consensus.cc:2463] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.971958 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d63e50fd58fd4335ba0165af0f856032" } new_table_name: "default.Table_d93d63dc24474413af7dbd49a6a8b6d6" modify_external_catalogs: true
I20250115 10:12:04.971989 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a7058d7b7d5f448b81c27f06b321f7ef" } new_table_name: "default.Table_2f8f54af2bc14fd3b13925bff00079ee" modify_external_catalogs: true
I20250115 10:12:04.972134 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3c676fcf25a54fcebdbab5149e0bd178"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:04.972249 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c676fcf25a54fcebdbab5149e0bd178 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:04.972750 4587 raft_consensus.cc:2798] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.972808 4587 raft_consensus.cc:695] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.972856 4587 consensus_queue.cc:237] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.972868 3952 consensus_queue.cc:1035] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.973047 4587 raft_consensus.cc:491] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.973071 4569 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.973083 4587 raft_consensus.cc:513] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.973111 4569 ts_tablet_manager.cc:1397] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.000s
I20250115 10:12:04.973176 4587 leader_election.cc:290] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.973294 4569 raft_consensus.cc:357] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.973348 4569 raft_consensus.cc:383] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.973366 4569 raft_consensus.cc:738] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.973407 4569 consensus_queue.cc:260] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.973505 4569 ts_tablet_manager.cc:1428] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.973567 4569 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:04.974087 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac322279a7e845529e4771aedba8881b consensus state has no leader
I20250115 10:12:04.974112 4569 tablet_bootstrap.cc:654] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.974583 3952 raft_consensus.cc:491] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.974625 3952 raft_consensus.cc:513] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.974705 3952 leader_election.cc:290] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.974907 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.975072 3215 leader_election.cc:343] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.975082 4569 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.975134 4569 ts_tablet_manager.cc:1397] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:04.975270 4569 raft_consensus.cc:357] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.975324 4569 raft_consensus.cc:383] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.975370 4569 raft_consensus.cc:738] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.975415 4569 consensus_queue.cc:260] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.975503 4569 ts_tablet_manager.cc:1428] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.975560 4569 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.975783 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:04.975824 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.975994 3214 leader_election.cc:343] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.976035 3214 leader_election.cc:304] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.976156 4731 raft_consensus.cc:2743] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:04.976387 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 367694b5edf143ef81e99e348543659a
W20250115 10:12:04.976433 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet f9825097e391481da01ad9111c836ec9
W20250115 10:12:04.976461 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 4839f8e0539d468ea11077d48f8f8266
I20250115 10:12:04.976493 4569 tablet_bootstrap.cc:654] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:04.976672 3215 consensus_peers.cc:487] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.976850 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:04.976914 3279 raft_consensus.cc:2463] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:04.977110 3350 leader_election.cc:304] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.977466 3350 leader_election.cc:343] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.977538 4699 raft_consensus.cc:2798] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:04.977579 4699 raft_consensus.cc:491] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:04.977602 4699 raft_consensus.cc:3054] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.978376 4699 raft_consensus.cc:513] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.978499 4699 leader_election.cc:290] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.978662 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:04.978708 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12379200d11e4ed3800f609d34a54ea7" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:04.978744 3276 raft_consensus.cc:3054] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.979187 4477 catalog_manager.cc:5526] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.979316 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:04.979367 4477 catalog_manager.cc:5526] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.979431 3276 raft_consensus.cc:2463] T 12379200d11e4ed3800f609d34a54ea7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:04.979878 3350 leader_election.cc:304] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:04.979949 3350 leader_election.cc:343] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.980091 4474 catalog_manager.cc:5526] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:04.980780 4875 raft_consensus.cc:2798] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:04.980835 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b821630ef4fac98bd12e4324880f4 (DEFAULT_TABLE table=default.Table_bad10177c85c46b194b12736ca2e50b3 [id=be378d2e5c5f42a0990bb449edf5cb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.980944 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b821630ef4fac98bd12e4324880f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.980978 4890 tablet.cc:1721] T d0e3265da9be49518705bedf6daa27a1 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.980842 4875 raft_consensus.cc:695] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:04.982270 4875 consensus_queue.cc:237] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.982290 4662 tablet.cc:1721] T d0e3265da9be49518705bedf6daa27a1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.982323 4873 tablet.cc:1721] T d0e3265da9be49518705bedf6daa27a1 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:04.983732 3770 raft_consensus.cc:491] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:04.983803 3770 raft_consensus.cc:513] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.983917 3770 leader_election.cc:290] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:04.984040 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:04.984277 3214 leader_election.cc:343] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.984387 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b821630ef4fac98bd12e4324880f4 (DEFAULT_TABLE table=default.Table_bad10177c85c46b194b12736ca2e50b3 [id=be378d2e5c5f42a0990bb449edf5cb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.984463 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b821630ef4fac98bd12e4324880f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.984561 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 9b3b821630ef4fac98bd12e4324880f4 (DEFAULT_TABLE table=default.Table_bad10177c85c46b194b12736ca2e50b3 [id=be378d2e5c5f42a0990bb449edf5cb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.984639 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b3b821630ef4fac98bd12e4324880f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:04.985199 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 11725ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:04.985955 4557 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.986014 4557 ts_tablet_manager.cc:1397] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.001s
I20250115 10:12:04.986215 4557 raft_consensus.cc:357] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.986279 4557 raft_consensus.cc:383] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.986302 4557 raft_consensus.cc:738] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.986347 4557 consensus_queue.cc:260] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.986387 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:04.986443 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]). Expected version 1 got 0
I20250115 10:12:04.986454 4557 ts_tablet_manager.cc:1428] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.986510 4557 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.987102 4557 tablet_bootstrap.cc:654] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.987948 4557 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.987998 4557 ts_tablet_manager.cc:1397] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:04.988137 4557 raft_consensus.cc:357] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.988185 4557 raft_consensus.cc:383] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.988200 4557 raft_consensus.cc:738] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.988222 4557 consensus_queue.cc:260] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.988294 4557 ts_tablet_manager.cc:1428] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.988337 4575 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:04.988343 4557 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.988375 4575 ts_tablet_manager.cc:1397] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.001s
I20250115 10:12:04.988510 4575 raft_consensus.cc:357] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.988559 4575 raft_consensus.cc:383] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.988580 4575 raft_consensus.cc:738] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.988606 4575 consensus_queue.cc:260] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.988705 4575 ts_tablet_manager.cc:1428] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.988720 4557 tablet_bootstrap.cc:654] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.988782 4575 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:04.989086 3215 consensus_peers.cc:487] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:04.989161 3215 consensus_peers.cc:487] T 3402dc674ab0402f8e0bdd7b8db4b88d P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:04.989281 4575 tablet_bootstrap.cc:654] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.990078 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:04.990679 3215 leader_election.cc:343] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:04.991055 3215 leader_election.cc:304] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:04.991174 4731 raft_consensus.cc:2743] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:04.992404 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.992801 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.992858 4474 catalog_manager.cc:5526] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.992910 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 78da637a02f34263a6fbf9c48f538227 (DEFAULT_TABLE table=default.Table_3c676fcf25a54fcebdbab5149e0bd178 [id=6222280bc2fd4b589755dbf1ced20e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.992945 4474 catalog_manager.cc:5526] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:04.993090 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78da637a02f34263a6fbf9c48f538227. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.993777 3547 raft_consensus.cc:3054] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:04.993880 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 78da637a02f34263a6fbf9c48f538227 (DEFAULT_TABLE table=default.Table_3c676fcf25a54fcebdbab5149e0bd178 [id=6222280bc2fd4b589755dbf1ced20e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.993989 5155 consensus_queue.cc:1035] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:04.994084 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78da637a02f34263a6fbf9c48f538227. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.995019 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 78da637a02f34263a6fbf9c48f538227 (DEFAULT_TABLE table=default.Table_3c676fcf25a54fcebdbab5149e0bd178 [id=6222280bc2fd4b589755dbf1ced20e12]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:04.995110 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78da637a02f34263a6fbf9c48f538227. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:04.995471 4569 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:04.995520 4569 ts_tablet_manager.cc:1397] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.001s
I20250115 10:12:04.995671 4569 raft_consensus.cc:357] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.995770 4569 raft_consensus.cc:383] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.995800 4569 raft_consensus.cc:738] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.995834 4569 consensus_queue.cc:260] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.995963 4569 ts_tablet_manager.cc:1428] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.996018 4569 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:04.996407 4569 tablet_bootstrap.cc:654] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.996706 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:04.996803 4557 tablet_bootstrap.cc:492] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:04.996857 4557 ts_tablet_manager.cc:1397] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:04.996845 4473 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_d93d63dc24474413af7dbd49a6a8b6d6 [id=3bedd46181134cf7bdc3b443a5aff915] alter complete (version 1)
I20250115 10:12:04.997007 4557 raft_consensus.cc:357] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.997064 4557 raft_consensus.cc:383] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:04.997080 4557 raft_consensus.cc:738] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:04.997113 4557 consensus_queue.cc:260] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:04.997187 4557 ts_tablet_manager.cc:1428] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:04.997236 4557 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:04.997614 4557 tablet_bootstrap.cc:654] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:04.998132 3548 raft_consensus.cc:3054] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:04.998713 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet f792ae7d54184207825a92d72bc5a323
W20250115 10:12:04.998759 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:04.999491 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:04.999536 4477 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet f8114f64577245c2b3ce70e4399de0c8 (table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]). Expected version 2 got 0
I20250115 10:12:04.999614 3770 consensus_queue.cc:1035] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.000953 4477 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:05.001011 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8d59e4a4f97745aeb3f3689e2af1986b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.001152 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d59e4a4f97745aeb3f3689e2af1986b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.002003 4557 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.002038 4575 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.002046 4557 ts_tablet_manager.cc:1397] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:05.002082 4575 ts_tablet_manager.cc:1397] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s
I20250115 10:12:05.002189 4557 raft_consensus.cc:357] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.002254 4557 raft_consensus.cc:383] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.002269 4557 raft_consensus.cc:738] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.002249 4575 raft_consensus.cc:357] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.002315 4557 consensus_queue.cc:260] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.002331 4575 raft_consensus.cc:383] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.002353 4575 raft_consensus.cc:738] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.002396 4557 ts_tablet_manager.cc:1428] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.002395 4575 consensus_queue.cc:260] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.002456 4557 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.002513 4575 ts_tablet_manager.cc:1428] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.002581 4575 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.002900 4557 tablet_bootstrap.cc:654] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.003060 4575 tablet_bootstrap.cc:654] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.003258 4731 raft_consensus.cc:491] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.003311 4731 raft_consensus.cc:513] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.003420 4731 leader_election.cc:290] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.003744 4575 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.003787 4575 ts_tablet_manager.cc:1397] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.003756 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.003932 4575 raft_consensus.cc:357] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.004010 4575 raft_consensus.cc:383] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.004031 4575 raft_consensus.cc:738] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:05.004026 3215 leader_election.cc:343] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.004074 4575 consensus_queue.cc:260] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.004182 4575 ts_tablet_manager.cc:1428] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.004237 4575 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.004698 4575 tablet_bootstrap.cc:654] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.004819 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.005018 3214 leader_election.cc:343] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.005056 3214 leader_election.cc:304] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.005158 3770 raft_consensus.cc:2743] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.005467 4557 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.005508 4557 ts_tablet_manager.cc:1397] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:05.005924 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]). Expected version 1 got 0
I20250115 10:12:05.006178 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 21317f9119f44290a209cc1cb5990514 (DEFAULT_TABLE table=default.Table_8d59e4a4f97745aeb3f3689e2af1986b [id=1fbf761d48e44dc1bf5719f568f875d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.006289 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21317f9119f44290a209cc1cb5990514. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.006999 4557 raft_consensus.cc:357] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.007208 4557 raft_consensus.cc:383] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.007206 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]). Expected version 1 got 0
I20250115 10:12:05.007391 4557 raft_consensus.cc:738] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.007500 4557 consensus_queue.cc:260] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.008126 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 21317f9119f44290a209cc1cb5990514 (DEFAULT_TABLE table=default.Table_8d59e4a4f97745aeb3f3689e2af1986b [id=1fbf761d48e44dc1bf5719f568f875d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.008242 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21317f9119f44290a209cc1cb5990514. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.008342 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:05.008386 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 21317f9119f44290a209cc1cb5990514 (DEFAULT_TABLE table=default.Table_8d59e4a4f97745aeb3f3689e2af1986b [id=1fbf761d48e44dc1bf5719f568f875d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.008414 4699 raft_consensus.cc:491] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.008464 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21317f9119f44290a209cc1cb5990514. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.008455 4699 raft_consensus.cc:513] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.008548 4699 leader_election.cc:290] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.008845 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.009032 3350 leader_election.cc:343] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.009670 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:05.009826 3350 leader_election.cc:343] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.009867 3350 leader_election.cc:304] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.009928 4699 raft_consensus.cc:2743] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.010617 4557 ts_tablet_manager.cc:1428] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:05.011121 4557 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.011755 4557 tablet_bootstrap.cc:654] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.012475 4569 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.012528 4569 ts_tablet_manager.cc:1397] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20250115 10:12:05.012686 4569 raft_consensus.cc:357] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.012751 4569 raft_consensus.cc:383] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.012773 4569 raft_consensus.cc:738] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.012813 4569 consensus_queue.cc:260] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.012916 4569 ts_tablet_manager.cc:1428] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.012996 4569 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.013453 4569 tablet_bootstrap.cc:654] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.014091 4557 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.014101 4569 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.014138 4569 ts_tablet_manager.cc:1397] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.014189 4557 ts_tablet_manager.cc:1397] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:05.014287 4569 raft_consensus.cc:357] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.014364 4569 raft_consensus.cc:383] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.014387 4569 raft_consensus.cc:738] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.014417 4569 consensus_queue.cc:260] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.014433 4557 raft_consensus.cc:357] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.014484 4557 raft_consensus.cc:383] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.014503 4557 raft_consensus.cc:738] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.014514 4569 ts_tablet_manager.cc:1428] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.014568 4569 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.014552 4557 consensus_queue.cc:260] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.014750 4557 ts_tablet_manager.cc:1428] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.014914 4557 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.014956 4569 tablet_bootstrap.cc:654] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.015365 4557 tablet_bootstrap.cc:654] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.015555 4699 raft_consensus.cc:491] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.015615 4699 raft_consensus.cc:513] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.015774 4699 leader_election.cc:290] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.015918 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.015929 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.015978 3550 raft_consensus.cc:2463] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.016008 3276 raft_consensus.cc:2463] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.016111 3350 leader_election.cc:304] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.016194 4699 raft_consensus.cc:2798] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.016235 4699 raft_consensus.cc:491] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.016259 4699 raft_consensus.cc:3054] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.016281 4557 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.016320 4557 ts_tablet_manager.cc:1397] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.016448 4557 raft_consensus.cc:357] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.016495 4557 raft_consensus.cc:383] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.016511 4557 raft_consensus.cc:738] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.016551 4557 consensus_queue.cc:260] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.016654 4557 ts_tablet_manager.cc:1428] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.016716 4557 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.016858 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_cab9252630814ab69c879985e3c01f06 [id=71819bfc734a4e0d9e38041345bbd29b]). Expected version 2 got 0
I20250115 10:12:05.017102 4557 tablet_bootstrap.cc:654] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.017726 4557 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.017762 3550 raft_consensus.cc:3054] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.017766 4557 ts_tablet_manager.cc:1397] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.017948 4557 raft_consensus.cc:357] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.018000 4557 raft_consensus.cc:383] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.018016 4557 raft_consensus.cc:738] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.018049 4557 consensus_queue.cc:260] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.018121 4557 ts_tablet_manager.cc:1428] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.018164 4557 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.018532 4557 tablet_bootstrap.cc:654] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.018791 4873 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.019534 4557 tablet_bootstrap.cc:492] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.019521 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_e2336efa12724d77804d65cd42e446df [id=a917e062f0334d9ab4cd3ee08ba2ce98]). Expected version 2 got 0
I20250115 10:12:05.019569 4557 ts_tablet_manager.cc:1397] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.019692 4557 raft_consensus.cc:357] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.019776 4557 raft_consensus.cc:383] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.019798 4557 raft_consensus.cc:738] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.019852 4557 consensus_queue.cc:260] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.019948 4557 ts_tablet_manager.cc:1428] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.020009 4557 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.020278 4569 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.020318 4569 ts_tablet_manager.cc:1397] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:05.020377 4557 tablet_bootstrap.cc:654] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.020465 4569 raft_consensus.cc:357] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.020535 4569 raft_consensus.cc:383] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.020558 4569 raft_consensus.cc:738] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.020608 4569 consensus_queue.cc:260] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.020720 4569 ts_tablet_manager.cc:1428] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.020727 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]). Expected version 1 got 0
I20250115 10:12:05.020776 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 47205800bd074a9585c4af0f50055a13 (table default.Table_f61276eb8fc0490ebc9173121ee37c34 [id=b9a846c94c034630930c3a4bc001f20b]). Expected version 2 got 1
I20250115 10:12:05.020789 4569 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.021144 4569 tablet_bootstrap.cc:654] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.021996 4569 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.022043 4569 ts_tablet_manager.cc:1397] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.022112 4653 mvcc.cc:204] Tried to move back new op lower bound from 7114489547632087040 to 7114489546313449472. Current Snapshot: MvccSnapshot[applied={T|T < 7114489547632087040}]
I20250115 10:12:05.022159 4873 tablet.cc:1721] T 47205800bd074a9585c4af0f50055a13 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.022192 4569 raft_consensus.cc:357] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.022256 4569 raft_consensus.cc:383] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.022280 4569 raft_consensus.cc:738] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.022331 4569 consensus_queue.cc:260] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.022418 4569 ts_tablet_manager.cc:1428] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.022475 4569 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.022755 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]). Expected version 1 got 0
I20250115 10:12:05.022953 4569 tablet_bootstrap.cc:654] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.023108 4887 raft_consensus.cc:491] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.023155 4887 raft_consensus.cc:513] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.023264 4887 leader_election.cc:290] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.023438 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.023607 4569 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.023648 4569 ts_tablet_manager.cc:1397] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.023818 4569 raft_consensus.cc:357] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.023842 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.023957 3276 raft_consensus.cc:2463] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:05.023978 3484 leader_election.cc:343] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.023902 4569 raft_consensus.cc:383] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.024111 4569 raft_consensus.cc:738] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.024108 3485 leader_election.cc:304] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.024154 4569 consensus_queue.cc:260] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.024253 4569 ts_tablet_manager.cc:1428] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.024307 4569 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.023700 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:05.024716 4569 tablet_bootstrap.cc:654] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.025188 4887 raft_consensus.cc:2798] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.025238 4887 raft_consensus.cc:491] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.025262 4887 raft_consensus.cc:3054] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.025315 4908 raft_consensus.cc:491] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.025377 4908 raft_consensus.cc:513] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.025496 4908 leader_election.cc:290] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.025549 4569 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.025595 4569 ts_tablet_manager.cc:1397] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:05.025709 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.025727 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.025755 4569 raft_consensus.cc:357] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.025802 4569 raft_consensus.cc:383] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.025982 4569 raft_consensus.cc:738] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.026006 4887 raft_consensus.cc:513] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.026108 4887 leader_election.cc:290] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.026463 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.026551 3279 raft_consensus.cc:3054] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.025876 3215 leader_election.cc:343] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.026674 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.026774 3214 leader_election.cc:343] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.026945 4569 consensus_queue.cc:260] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.027006 4557 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.027042 4557 ts_tablet_manager.cc:1397] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:05.027065 3214 leader_election.cc:304] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.027130 4731 raft_consensus.cc:2743] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.027158 4557 raft_consensus.cc:357] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.027222 4557 raft_consensus.cc:383] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.027243 4557 raft_consensus.cc:738] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.027280 4557 consensus_queue.cc:260] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.027304 3279 raft_consensus.cc:2463] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.027384 4557 ts_tablet_manager.cc:1428] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.027462 4557 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.027076 4569 ts_tablet_manager.cc:1428] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:05.027860 4557 tablet_bootstrap.cc:654] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.027920 4569 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.028291 3485 leader_election.cc:304] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.028334 3484 leader_election.cc:343] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.028381 4433 raft_consensus.cc:2798] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.028436 4433 raft_consensus.cc:695] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.028440 4569 tablet_bootstrap.cc:654] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.028479 4433 consensus_queue.cc:237] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.028833 4557 tablet_bootstrap.cc:492] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.028872 4557 ts_tablet_manager.cc:1397] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:05.029019 4557 raft_consensus.cc:357] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.029080 4557 raft_consensus.cc:383] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.029116 4557 raft_consensus.cc:738] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.029157 4557 consensus_queue.cc:260] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.029255 4557 ts_tablet_manager.cc:1428] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.029317 4557 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:05.029425 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 00e78a8b61e142199ba7bf73e3879b98
I20250115 10:12:05.029476 4474 catalog_manager.cc:5526] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.029664 4557 tablet_bootstrap.cc:654] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.030433 5155 consensus_queue.cc:1035] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.030566 3550 raft_consensus.cc:3054] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.031647 4873 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.031970 4557 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.032027 4557 ts_tablet_manager.cc:1397] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:05.032191 4557 raft_consensus.cc:357] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.032248 4557 raft_consensus.cc:383] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.032266 4557 raft_consensus.cc:738] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.032300 4557 consensus_queue.cc:260] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.032404 4557 ts_tablet_manager.cc:1428] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.032461 4557 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.032847 4557 tablet_bootstrap.cc:654] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.033931 5155 consensus_queue.cc:1035] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.034580 4557 tablet_bootstrap.cc:492] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.034595 4477 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]). Expected version 1 got 0
I20250115 10:12:05.034618 4557 ts_tablet_manager.cc:1397] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.034729 4557 raft_consensus.cc:357] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.034755 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 7a9d422fdac347ff85eca778c29858e8
I20250115 10:12:05.034775 4557 raft_consensus.cc:383] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250115 10:12:05.034786 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 00e78a8b61e142199ba7bf73e3879b98
I20250115 10:12:05.034792 4557 raft_consensus.cc:738] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.034835 4557 consensus_queue.cc:260] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.034940 4557 ts_tablet_manager.cc:1428] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.035012 4557 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.035132 4908 consensus_queue.cc:1035] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.035384 4557 tablet_bootstrap.cc:654] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.036157 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:05.036317 4890 tablet.cc:1721] T d42535a811dc420b94527f7d81efdd13 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.036522 4433 raft_consensus.cc:491] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.036585 4433 raft_consensus.cc:513] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.036675 4433 leader_election.cc:290] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.036803 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet d42535a811dc420b94527f7d81efdd13 (table default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61]). Expected version 1 got 0
I20250115 10:12:05.036903 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e033d609eef46a792b1a568ec2936de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.037220 3485 leader_election.cc:343] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 0e033d609eef46a792b1a568ec2936de
W20250115 10:12:05.037333 3484 leader_election.cc:343] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.037371 3484 leader_election.cc:304] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.037494 4569 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.037536 4569 ts_tablet_manager.cc:1397] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.037556 4662 tablet.cc:1721] T d42535a811dc420b94527f7d81efdd13 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.037552 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d8204dbea13e49cc85f44f199f3004f3" } new_table_name: "default.Table_792eee547bd24cc8aa8ad66532ec52b9" modify_external_catalogs: true
I20250115 10:12:05.037740 4569 raft_consensus.cc:357] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.037809 4569 raft_consensus.cc:383] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.037832 4569 raft_consensus.cc:738] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.037868 4569 consensus_queue.cc:260] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.037871 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c9c31c7a674d4f138960d564cc53686c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.037952 4569 ts_tablet_manager.cc:1428] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:05.037986 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9c31c7a674d4f138960d564cc53686c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.038015 4569 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.038448 4569 tablet_bootstrap.cc:654] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.039120 4470 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b4fe8306357b48248969d0b4b3ffc3bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.039227 4470 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4fe8306357b48248969d0b4b3ffc3bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.039400 4433 raft_consensus.cc:2743] T 0e033d609eef46a792b1a568ec2936de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.039516 4557 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.039558 4557 ts_tablet_manager.cc:1397] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:05.039644 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]). Expected version 1 got 0
I20250115 10:12:05.039682 4873 tablet.cc:1721] T d42535a811dc420b94527f7d81efdd13 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.039691 4557 raft_consensus.cc:357] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.039783 4557 raft_consensus.cc:383] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.039803 4557 raft_consensus.cc:738] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.039834 4557 consensus_queue.cc:260] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.039831 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a59b4ec5ddf041bfbd28831ba2e64618"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.039937 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a59b4ec5ddf041bfbd28831ba2e64618 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.039964 4557 ts_tablet_manager.cc:1428] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.040022 4557 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.040084 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2f418c5b15134aa58e94ad53b68ba2b2" } modify_external_catalogs: true
I20250115 10:12:05.040136 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2f418c5b15134aa58e94ad53b68ba2b2" } modify_external_catalogs: true
I20250115 10:12:05.040493 4569 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.040535 4569 ts_tablet_manager.cc:1397] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:05.040550 4557 tablet_bootstrap.cc:654] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.040654 4569 raft_consensus.cc:357] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.040699 4569 raft_consensus.cc:383] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.040712 4569 raft_consensus.cc:738] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.040758 4569 consensus_queue.cc:260] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.040838 4569 ts_tablet_manager.cc:1428] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.040885 4569 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.041244 4569 tablet_bootstrap.cc:654] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.041327 4477 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_fcc33e9a90f6491fa648c2c623dbb0d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.041420 4477 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fcc33e9a90f6491fa648c2c623dbb0d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.042225 4569 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.042268 4569 ts_tablet_manager.cc:1397] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.042392 4569 raft_consensus.cc:357] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.042470 4569 raft_consensus.cc:383] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.042492 4569 raft_consensus.cc:738] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.042531 4569 consensus_queue.cc:260] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.042687 4569 ts_tablet_manager.cc:1428] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.042759 4569 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.042909 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 14cea13b41bd47faafe774471c4163dc
I20250115 10:12:05.043323 4569 tablet_bootstrap.cc:654] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.043963 3415 raft_consensus.cc:3054] T 817a8a975fea4da9a994e78f86da961f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.044481 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet cc395ae76a494a8eb682b7ef34dcb169
I20250115 10:12:05.045276 4557 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.045320 4557 ts_tablet_manager.cc:1397] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:05.045485 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 2d30f49da63241a2a794a7a18e026473
I20250115 10:12:05.045477 4557 raft_consensus.cc:357] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.045533 4557 raft_consensus.cc:383] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.045550 4557 raft_consensus.cc:738] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.045583 4557 consensus_queue.cc:260] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.045707 4557 ts_tablet_manager.cc:1428] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.045740 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d30f49da63241a2a794a7a18e026473 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:05.045756 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d30f49da63241a2a794a7a18e026473 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.045804 4557 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:05.046103 4462 catalog_manager.cc:4852] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): delete failed for tablet 2d30f49da63241a2a794a7a18e026473 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d30f49da63241a2a794a7a18e026473 already in progress: creating tablet
I20250115 10:12:05.046249 4557 tablet_bootstrap.cc:654] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.046420 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 353b2e8e545e44768ec77f0cd0caa6e6 consensus state has no leader
W20250115 10:12:05.046502 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 2d30f49da63241a2a794a7a18e026473 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d30f49da63241a2a794a7a18e026473 already in progress: creating tablet
I20250115 10:12:05.046599 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d30f49da63241a2a794a7a18e026473 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.046665 4551 tablet_replica.cc:331] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.046685 4335 raft_consensus.cc:491] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.046736 4551 raft_consensus.cc:2238] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.046723 4335 raft_consensus.cc:513] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.046769 4551 raft_consensus.cc:2267] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.046818 4335 leader_election.cc:290] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.047173 4551 ts_tablet_manager.cc:1905] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:05.047403 3215 leader_election.cc:343] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:05.047860 4575 tablet_bootstrap.cc:492] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.047901 4575 ts_tablet_manager.cc:1397] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.001s
I20250115 10:12:05.048095 4575 raft_consensus.cc:357] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.048152 4575 raft_consensus.cc:383] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.048168 4575 raft_consensus.cc:738] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.048203 4575 consensus_queue.cc:260] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.048309 4575 ts_tablet_manager.cc:1428] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.048612 4908 consensus_queue.cc:1035] T 817a8a975fea4da9a994e78f86da961f P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.048957 4551 ts_tablet_manager.cc:1918] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.048946 3276 raft_consensus.cc:3054] T b33c7ecdd251412eaeed45e378e5cc75 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.049005 4551 log.cc:1198] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/2d30f49da63241a2a794a7a18e026473
I20250115 10:12:05.049211 4551 ts_tablet_manager.cc:1939] T 2d30f49da63241a2a794a7a18e026473 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.049526 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 2d30f49da63241a2a794a7a18e026473 (table default.Table_2f418c5b15134aa58e94ad53b68ba2b2 [id=a5da5f258250489a9d39ce2b87fc1a86]) successfully deleted
I20250115 10:12:05.049747 4699 raft_consensus.cc:513] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.049835 4569 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.049854 4699 leader_election.cc:290] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.049849 4433 consensus_queue.cc:1035] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.049908 4569 ts_tablet_manager.cc:1397] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20250115 10:12:05.050079 4569 raft_consensus.cc:357] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.050225 4569 raft_consensus.cc:383] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.050257 4569 raft_consensus.cc:738] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.050311 4569 consensus_queue.cc:260] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.050452 4569 ts_tablet_manager.cc:1428] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.050519 4569 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.050959 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.050988 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8600883e5a5449c59a747a6ef2121c61" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.051038 3548 raft_consensus.cc:3054] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.051040 3279 raft_consensus.cc:3054] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.051086 4569 tablet_bootstrap.cc:654] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.051611 4569 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.051636 3548 raft_consensus.cc:2463] T 8600883e5a5449c59a747a6ef2121c61 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.051661 3279 raft_consensus.cc:2463] T 8600883e5a5449c59a747a6ef2121c61 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.051764 4569 ts_tablet_manager.cc:1397] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.051908 4471 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_2b9de7b04dd143d1ba8d05bc78b25fa6 [id=dd93f46925ca4329a7f08c1b1e06ed61] alter complete (version 1)
I20250115 10:12:05.051986 4569 raft_consensus.cc:357] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.052086 3350 leader_election.cc:304] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.052132 4877 consensus_queue.cc:1035] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.052161 4587 raft_consensus.cc:2798] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.052219 4587 raft_consensus.cc:695] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.052254 4587 consensus_queue.cc:237] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.052412 4569 raft_consensus.cc:383] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.052454 4569 raft_consensus.cc:738] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.052518 4569 consensus_queue.cc:260] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.052649 4569 ts_tablet_manager.cc:1428] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.053295 4569 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.053702 4569 tablet_bootstrap.cc:654] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.054030 4575 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.054222 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 14cea13b41bd47faafe774471c4163dc
W20250115 10:12:05.054275 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 46b8efd1622a4efcb009f999cb915dfc
I20250115 10:12:05.054447 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbb9cfc01df408eaae41b38e8c62c86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.054490 4575 tablet_bootstrap.cc:654] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.054518 3413 raft_consensus.cc:2463] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.054769 4569 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.054803 4569 ts_tablet_manager.cc:1397] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:05.054939 4569 raft_consensus.cc:357] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.055022 4569 raft_consensus.cc:383] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.055048 4569 raft_consensus.cc:738] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.055095 4569 consensus_queue.cc:260] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.055194 4569 ts_tablet_manager.cc:1428] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.055262 4569 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.055477 4433 consensus_queue.cc:1035] T b33c7ecdd251412eaeed45e378e5cc75 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.055680 4569 tablet_bootstrap.cc:654] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.055681 3214 leader_election.cc:304] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.056514 4569 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.056553 4569 ts_tablet_manager.cc:1397] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.056578 5155 raft_consensus.cc:2798] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.056607 5155 raft_consensus.cc:491] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.056623 5155 raft_consensus.cc:3054] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.056679 4569 raft_consensus.cc:357] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.056727 4569 raft_consensus.cc:383] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.056762 4569 raft_consensus.cc:738] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.056787 4569 consensus_queue.cc:260] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.056866 4569 ts_tablet_manager.cc:1428] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.056911 4569 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.057099 4575 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.057142 4575 ts_tablet_manager.cc:1397] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:05.057242 5155 raft_consensus.cc:513] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.057312 4569 tablet_bootstrap.cc:654] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.057281 4575 raft_consensus.cc:357] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.057333 4575 raft_consensus.cc:383] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.057343 5155 leader_election.cc:290] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.057353 4575 raft_consensus.cc:738] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.057399 4575 consensus_queue.cc:260] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.057514 4575 ts_tablet_manager.cc:1428] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.057569 4575 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.057991 4575 tablet_bootstrap.cc:654] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.058213 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fbb9cfc01df408eaae41b38e8c62c86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.058274 3413 raft_consensus.cc:3054] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.058529 4575 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.058570 4575 ts_tablet_manager.cc:1397] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.058717 4575 raft_consensus.cc:357] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.058768 4575 raft_consensus.cc:383] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.058785 4575 raft_consensus.cc:738] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.058957 3413 raft_consensus.cc:2463] T 0fbb9cfc01df408eaae41b38e8c62c86 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.059237 3214 leader_election.cc:304] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.059351 4908 raft_consensus.cc:491] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.059387 4908 raft_consensus.cc:513] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.059468 4908 leader_election.cc:290] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.059494 4908 raft_consensus.cc:2798] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.059516 4908 raft_consensus.cc:695] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.059561 4557 tablet_bootstrap.cc:492] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.059547 4908 consensus_queue.cc:237] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.059600 4557 ts_tablet_manager.cc:1397] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.000s
I20250115 10:12:05.060201 4575 consensus_queue.cc:260] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.060849 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 0fbb9cfc01df408eaae41b38e8c62c86
W20250115 10:12:05.060896 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 424956b90563455d8140a49fcaa05206
I20250115 10:12:05.061132 4575 ts_tablet_manager.cc:1428] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:05.061249 4575 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.061635 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.061689 4575 tablet_bootstrap.cc:654] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.061704 3411 raft_consensus.cc:2463] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.061640 4472 catalog_manager.cc:5526] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.061743 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.061795 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f38308d61eec4f2988d3d98f6b47660a [id=c07c3cfb82be473395736827fc642890]). Expected version 4 got 0
I20250115 10:12:05.061921 3550 raft_consensus.cc:3054] T 766ddeab54194401aeb942516e42dc84 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.063078 3215 leader_election.cc:343] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:05.063278 3214 leader_election.cc:304] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.063359 4335 raft_consensus.cc:2798] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.063392 4335 raft_consensus.cc:491] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.063421 4335 raft_consensus.cc:3054] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.064033 3279 raft_consensus.cc:3054] T 7629a309511c4251b1e9ce231ef0fcf0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.064384 4335 raft_consensus.cc:513] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.064476 4335 leader_election.cc:290] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.064713 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet 0b401233481b445bbf0f394083719ed1 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.064931 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.064999 3411 raft_consensus.cc:3054] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.064958 4811 consensus_queue.cc:1035] T 7629a309511c4251b1e9ce231ef0fcf0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.065264 4811 consensus_queue.cc:1035] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.065538 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_5a7905b34476441d8365aa61213dd5f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.065649 3411 raft_consensus.cc:2463] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:05.065680 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a7905b34476441d8365aa61213dd5f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.066049 3214 leader_election.cc:304] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.066316 4557 raft_consensus.cc:357] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.066383 4557 raft_consensus.cc:383] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.066401 4557 raft_consensus.cc:738] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.066440 4557 consensus_queue.cc:260] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.066541 4557 ts_tablet_manager.cc:1428] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:05.066617 4557 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.066699 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c843e37ab0074c94b251c4efe16ea916"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.066840 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c843e37ab0074c94b251c4efe16ea916 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.067073 4557 tablet_bootstrap.cc:654] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.067853 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.067850 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.068300 4335 raft_consensus.cc:2798] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.068351 4335 raft_consensus.cc:695] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.068394 4335 consensus_queue.cc:237] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.068421 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet e8c99788dae6421b8b2dd4f40e2b63b2 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:05.069046 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 616166bc9d5d4651999b1d2e0a1851bb
W20250115 10:12:05.069315 3215 leader_election.cc:343] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.069394 3215 leader_election.cc:343] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.069737 4811 consensus_queue.cc:1035] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.070897 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet e8c99788dae6421b8b2dd4f40e2b63b2
I20250115 10:12:05.070971 4474 catalog_manager.cc:6596] ReplaceTablet: tablet e8c99788dae6421b8b2dd4f40e2b63b2 deleted and replaced by tablet 5ad04d0fa00947a68190662998792b02
I20250115 10:12:05.071028 4569 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.071076 4569 ts_tablet_manager.cc:1397] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:05.071159 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ad04d0fa00947a68190662998792b02) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:05.071236 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ad04d0fa00947a68190662998792b02) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.071219 4569 raft_consensus.cc:357] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.071278 4569 raft_consensus.cc:383] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.071295 4569 raft_consensus.cc:738] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.071305 4592 tablet_replica.cc:331] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:05.071331 4569 consensus_queue.cc:260] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.071357 4592 raft_consensus.cc:2238] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.071385 4592 raft_consensus.cc:2267] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.071424 4569 ts_tablet_manager.cc:1428] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.071478 4592 ts_tablet_manager.cc:1905] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.071478 4569 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.071993 4569 tablet_bootstrap.cc:654] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.072234 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet d368093a74ba4918b0efcc3a909c3a07 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.073019 4592 ts_tablet_manager.cc:1918] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.073022 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c99788dae6421b8b2dd4f40e2b63b2 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ad04d0fa00947a68190662998792b02) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.073067 4592 log.cc:1198] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/e8c99788dae6421b8b2dd4f40e2b63b2
I20250115 10:12:05.073099 4589 tablet_replica.cc:331] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.073179 4589 raft_consensus.cc:2238] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.073257 4589 pending_rounds.cc:62] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:05.073256 4592 ts_tablet_manager.cc:1939] T e8c99788dae6421b8b2dd4f40e2b63b2 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:05.073275 4589 pending_rounds.cc:69] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489546967801856 op_type: NO_OP noop_request { }
I20250115 10:12:05.073308 4589 raft_consensus.cc:2883] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:05.073328 4589 raft_consensus.cc:2267] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.073405 4551 tablet_replica.cc:331] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.073463 4551 raft_consensus.cc:2238] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.073498 4551 raft_consensus.cc:2267] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.073770 4475 catalog_manager.cc:5526] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.074220 4551 ts_tablet_manager.cc:1905] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.074527 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d368093a74ba4918b0efcc3a909c3a07
I20250115 10:12:05.074599 4471 catalog_manager.cc:6596] ReplaceTablet: tablet d368093a74ba4918b0efcc3a909c3a07 deleted and replaced by tablet b6a8229e85bf4e88a12fef1f4bc32958
I20250115 10:12:05.075492 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet d368093a74ba4918b0efcc3a909c3a07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6a8229e85bf4e88a12fef1f4bc32958) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.075786 4551 ts_tablet_manager.cc:1918] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.075814 4575 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.075834 4551 log.cc:1198] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/e8c99788dae6421b8b2dd4f40e2b63b2
I20250115 10:12:05.075861 4575 ts_tablet_manager.cc:1397] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250115 10:12:05.076000 4551 ts_tablet_manager.cc:1939] T e8c99788dae6421b8b2dd4f40e2b63b2 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.075979 4575 raft_consensus.cc:357] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.076040 4575 raft_consensus.cc:383] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.076066 4575 raft_consensus.cc:738] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.076108 4575 consensus_queue.cc:260] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.076236 4575 ts_tablet_manager.cc:1428] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.076299 4575 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.076341 3523 tablet_service.cc:1514] Processing DeleteTablet for tablet d368093a74ba4918b0efcc3a909c3a07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6a8229e85bf4e88a12fef1f4bc32958) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.076508 4875 consensus_queue.cc:1035] T 766ddeab54194401aeb942516e42dc84 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.076620 4875 raft_consensus.cc:491] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.076659 4875 raft_consensus.cc:513] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.076812 4875 leader_election.cc:290] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.076879 3386 tablet_service.cc:1514] Processing DeleteTablet for tablet d368093a74ba4918b0efcc3a909c3a07 with delete_type TABLET_DATA_DELETED (replaced by tablet b6a8229e85bf4e88a12fef1f4bc32958) from {username='slave'} at 127.0.0.1:46330
I20250115 10:12:05.077191 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.077647 4589 ts_tablet_manager.cc:1905] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.077742 4569 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.077800 4569 ts_tablet_manager.cc:1397] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:05.077968 4569 raft_consensus.cc:357] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.078027 4569 raft_consensus.cc:383] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.078047 4569 raft_consensus.cc:738] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.078083 4569 consensus_queue.cc:260] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.078173 4569 ts_tablet_manager.cc:1428] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.078231 4569 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.078779 4569 tablet_bootstrap.cc:654] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.079047 4589 ts_tablet_manager.cc:1918] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.079089 4589 log.cc:1198] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/e8c99788dae6421b8b2dd4f40e2b63b2
I20250115 10:12:05.079270 4589 ts_tablet_manager.cc:1939] T e8c99788dae6421b8b2dd4f40e2b63b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.079386 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d8e47c05a4b46d9a032852ad67b29ae" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.079775 3350 leader_election.cc:304] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:05.079838 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
W20250115 10:12:05.079895 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 3096adefffe04e008f58ecba3c3dd633
I20250115 10:12:05.079931 4557 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.079969 4557 ts_tablet_manager.cc:1397] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:05.080123 4557 raft_consensus.cc:357] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.080188 4557 raft_consensus.cc:383] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.080219 4557 raft_consensus.cc:738] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.080250 4557 consensus_queue.cc:260] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.080319 4569 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.080361 4875 raft_consensus.cc:2743] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.080381 4569 ts_tablet_manager.cc:1397] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:05.080510 4557 ts_tablet_manager.cc:1428] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:05.080569 4557 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.076661 4575 tablet_bootstrap.cc:654] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.080585 4569 raft_consensus.cc:357] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.080669 4569 raft_consensus.cc:383] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.080688 4569 raft_consensus.cc:738] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.080751 4569 consensus_queue.cc:260] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.080885 4569 ts_tablet_manager.cc:1428] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.081030 4557 tablet_bootstrap.cc:654] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.081115 4592 tablet_replica.cc:331] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: stopping tablet replica
I20250115 10:12:05.081192 4592 raft_consensus.cc:2238] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.081266 4592 raft_consensus.cc:2267] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.081367 4592 ts_tablet_manager.cc:1905] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.082288 4569 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.082715 4592 ts_tablet_manager.cc:1918] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.082760 4569 tablet_bootstrap.cc:654] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.082772 4592 log.cc:1198] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-1/wal/wals/d368093a74ba4918b0efcc3a909c3a07
I20250115 10:12:05.082988 4592 ts_tablet_manager.cc:1939] T d368093a74ba4918b0efcc3a909c3a07 P 25d7e460cb6d4ddabf387dc672cc26b3: Deleting consensus metadata
I20250115 10:12:05.083231 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]) successfully deleted
I20250115 10:12:05.083348 4462 catalog_manager.cc:4872] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]) successfully deleted
I20250115 10:12:05.083611 4569 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.083655 4569 ts_tablet_manager.cc:1397] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.083850 4569 raft_consensus.cc:357] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.083897 4569 raft_consensus.cc:383] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.083912 4569 raft_consensus.cc:738] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
W20250115 10:12:05.083910 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet c3f88d5d54b74f63a94bf88d3a33cfae
I20250115 10:12:05.083935 4569 consensus_queue.cc:260] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.083950 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:05.084005 4569 ts_tablet_manager.cc:1428] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.084049 4569 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.084293 4589 tablet_replica.cc:331] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.084350 4589 raft_consensus.cc:2238] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.084378 4589 raft_consensus.cc:2267] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.084393 4569 tablet_bootstrap.cc:654] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.084470 4589 ts_tablet_manager.cc:1905] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.085043 4557 tablet_bootstrap.cc:492] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.085086 4557 ts_tablet_manager.cc:1397] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:05.085137 4473 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1" } modify_external_catalogs: true
I20250115 10:12:05.085201 4473 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1" } modify_external_catalogs: true
I20250115 10:12:05.085235 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c9a4fdf26f954f40a3e13debd4b15d1b" } modify_external_catalogs: true
I20250115 10:12:05.085294 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c9a4fdf26f954f40a3e13debd4b15d1b" } modify_external_catalogs: true
I20250115 10:12:05.085409 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet ec6cdec27e9941ed9b485228f93b4d60 from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:05.085840 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:05.085876 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]) successfully deleted
I20250115 10:12:05.086251 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]). Expected version 1 got 0
I20250115 10:12:05.086737 3241 tablet_service.cc:1467] Processing CreateTablet for tablet 1e25918bfd2a485ca97e6f1c435c422e (DEFAULT_TABLE table=default.Table_b4fe8306357b48248969d0b4b3ffc3bc [id=cf7982d277da4447b2a628aa21d8edd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086858 3258 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad04d0fa00947a68190662998792b02 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086886 3246 tablet_service.cc:1467] Processing CreateTablet for tablet b6a8229e85bf4e88a12fef1f4bc32958 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086944 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 24c99fbb75764502b0bed10263c91d6d (DEFAULT_TABLE table=default.Table_c9c31c7a674d4f138960d564cc53686c [id=86b9be1b01414acfad5e25dbb93017fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086975 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 2c69970bab3c4ff3be09a513f1246c85 (DEFAULT_TABLE table=default.Table_5a7905b34476441d8365aa61213dd5f9 [id=3d6394f8e2594283848c153fbb1742bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086974 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 2c69970bab3c4ff3be09a513f1246c85 (DEFAULT_TABLE table=default.Table_5a7905b34476441d8365aa61213dd5f9 [id=3d6394f8e2594283848c153fbb1742bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087018 3516 tablet_service.cc:1467] Processing CreateTablet for tablet 9e30830286814435ab205a618c375a68 (DEFAULT_TABLE table=default.Table_fcc33e9a90f6491fa648c2c623dbb0d9 [id=36d405786fc84989bb47567a8dce0534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087046 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c99fbb75764502b0bed10263c91d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.087041 3260 tablet_service.cc:1467] Processing CreateTablet for tablet c5ab0fbfde14427ebb1714840c08ff6f (DEFAULT_TABLE table=default.Table_c843e37ab0074c94b251c4efe16ea916 [id=21001459973d4218ae87754ce15c50ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087106 3516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30830286814435ab205a618c375a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.087128 3252 tablet_service.cc:1467] Processing CreateTablet for tablet 9e30830286814435ab205a618c375a68 (DEFAULT_TABLE table=default.Table_fcc33e9a90f6491fa648c2c623dbb0d9 [id=36d405786fc84989bb47567a8dce0534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087110 3515 tablet_service.cc:1467] Processing CreateTablet for tablet c5ab0fbfde14427ebb1714840c08ff6f (DEFAULT_TABLE table=default.Table_c843e37ab0074c94b251c4efe16ea916 [id=21001459973d4218ae87754ce15c50ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.086861 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 24c99fbb75764502b0bed10263c91d6d (DEFAULT_TABLE table=default.Table_c9c31c7a674d4f138960d564cc53686c [id=86b9be1b01414acfad5e25dbb93017fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087184 3528 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad04d0fa00947a68190662998792b02 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087244 3515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ab0fbfde14427ebb1714840c08ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.087145 3513 tablet_service.cc:1467] Processing CreateTablet for tablet b6a8229e85bf4e88a12fef1f4bc32958 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087265 3523 tablet_service.cc:1467] Processing CreateTablet for tablet 2254763251ed40099e200580b750badc (DEFAULT_TABLE table=default.Table_a59b4ec5ddf041bfbd28831ba2e64618 [id=c34227d535d94e638570be645381622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087354 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a8229e85bf4e88a12fef1f4bc32958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.087396 3523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2254763251ed40099e200580b750badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.087456 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 2254763251ed40099e200580b750badc (DEFAULT_TABLE table=default.Table_a59b4ec5ddf041bfbd28831ba2e64618 [id=c34227d535d94e638570be645381622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.087543 3528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad04d0fa00947a68190662998792b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.086987 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 1e25918bfd2a485ca97e6f1c435c422e (DEFAULT_TABLE table=default.Table_b4fe8306357b48248969d0b4b3ffc3bc [id=cf7982d277da4447b2a628aa21d8edd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.088447 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e25918bfd2a485ca97e6f1c435c422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.088806 3241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e25918bfd2a485ca97e6f1c435c422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.088932 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c69970bab3c4ff3be09a513f1246c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089004 3252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30830286814435ab205a618c375a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089072 3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ab0fbfde14427ebb1714840c08ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089151 3246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a8229e85bf4e88a12fef1f4bc32958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089229 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c99fbb75764502b0bed10263c91d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089310 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2254763251ed40099e200580b750badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.089412 4589 ts_tablet_manager.cc:1918] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.089462 4589 log.cc:1198] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d368093a74ba4918b0efcc3a909c3a07
I20250115 10:12:05.089675 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 60cc9a1b2c4348ada0d8dab958aded09 (table default.Table_8efe8747d11e4af0a7df52864f2a926f [id=f93e7218dc4947b5bc778789c1be1480]). Expected version 2 got 0
I20250115 10:12:05.089900 4589 ts_tablet_manager.cc:1939] T d368093a74ba4918b0efcc3a909c3a07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.090306 4551 tablet_replica.cc:331] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.090373 4551 raft_consensus.cc:2238] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.090416 4551 raft_consensus.cc:2267] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.090513 4551 ts_tablet_manager.cc:1905] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.091101 4434 raft_consensus.cc:491] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.091145 4434 raft_consensus.cc:513] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.091259 4434 leader_election.cc:290] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.091385 3386 tablet_service.cc:1467] Processing CreateTablet for tablet 2254763251ed40099e200580b750badc (DEFAULT_TABLE table=default.Table_a59b4ec5ddf041bfbd28831ba2e64618 [id=c34227d535d94e638570be645381622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091413 3377 tablet_service.cc:1467] Processing CreateTablet for tablet 24c99fbb75764502b0bed10263c91d6d (DEFAULT_TABLE table=default.Table_c9c31c7a674d4f138960d564cc53686c [id=86b9be1b01414acfad5e25dbb93017fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091476 3395 tablet_service.cc:1467] Processing CreateTablet for tablet c5ab0fbfde14427ebb1714840c08ff6f (DEFAULT_TABLE table=default.Table_c843e37ab0074c94b251c4efe16ea916 [id=21001459973d4218ae87754ce15c50ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091506 3381 tablet_service.cc:1467] Processing CreateTablet for tablet b6a8229e85bf4e88a12fef1f4bc32958 (DEFAULT_TABLE table=default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091514 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6244234f7447debe9cdce30e4919b6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.091533 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6244234f7447debe9cdce30e4919b6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.091572 3278 raft_consensus.cc:2463] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.091571 3385 tablet_service.cc:1467] Processing CreateTablet for tablet 9e30830286814435ab205a618c375a68 (DEFAULT_TABLE table=default.Table_fcc33e9a90f6491fa648c2c623dbb0d9 [id=36d405786fc84989bb47567a8dce0534]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091600 3387 tablet_service.cc:1467] Processing CreateTablet for tablet 5ad04d0fa00947a68190662998792b02 (DEFAULT_TABLE table=default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091413 3389 tablet_service.cc:1467] Processing CreateTablet for tablet 1e25918bfd2a485ca97e6f1c435c422e (DEFAULT_TABLE table=default.Table_b4fe8306357b48248969d0b4b3ffc3bc [id=cf7982d277da4447b2a628aa21d8edd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091480 3386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2254763251ed40099e200580b750badc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.091696 3394 tablet_service.cc:1467] Processing CreateTablet for tablet 2c69970bab3c4ff3be09a513f1246c85 (DEFAULT_TABLE table=default.Table_5a7905b34476441d8365aa61213dd5f9 [id=3d6394f8e2594283848c153fbb1742bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.091755 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c69970bab3c4ff3be09a513f1246c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.091807 3394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c69970bab3c4ff3be09a513f1246c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.091886 3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5ab0fbfde14427ebb1714840c08ff6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.092820 3377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c99fbb75764502b0bed10263c91d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.091694 3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad04d0fa00947a68190662998792b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.092880 3387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad04d0fa00947a68190662998792b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.092927 3385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30830286814435ab205a618c375a68. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.093051 3381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a8229e85bf4e88a12fef1f4bc32958. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.093241 4551 ts_tablet_manager.cc:1918] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.093281 4551 log.cc:1198] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d368093a74ba4918b0efcc3a909c3a07
I20250115 10:12:05.093465 4551 ts_tablet_manager.cc:1939] T d368093a74ba4918b0efcc3a909c3a07 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.094216 3389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e25918bfd2a485ca97e6f1c435c422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.095376 4335 raft_consensus.cc:491] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.095443 4335 raft_consensus.cc:513] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.095541 4335 leader_election.cc:290] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.095666 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.095692 3484 leader_election.cc:343] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.096048 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e9c62a11d4744e199765f855fd0840b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.096282 3485 leader_election.cc:304] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.096385 4434 raft_consensus.cc:2798] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.096431 4434 raft_consensus.cc:491] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.096457 4434 raft_consensus.cc:3054] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.097095 4434 raft_consensus.cc:513] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.097199 4434 leader_election.cc:290] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.097167 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_96e74365d1724614bc58fc1f92d4f8a1" } modify_external_catalogs: true
I20250115 10:12:05.097229 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_96e74365d1724614bc58fc1f92d4f8a1" } modify_external_catalogs: true
I20250115 10:12:05.097499 3215 leader_election.cc:304] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.097563 5156 raft_consensus.cc:2743] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.097640 4473 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet fc6b5ec8e472414789f9619ae958fa34
I20250115 10:12:05.098238 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6244234f7447debe9cdce30e4919b6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.098292 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f6244234f7447debe9cdce30e4919b6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.098342 3277 raft_consensus.cc:3054] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.098433 3484 leader_election.cc:343] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.098790 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ec6cdec27e9941ed9b485228f93b4d60
I20250115 10:12:05.098847 4475 catalog_manager.cc:6596] ReplaceTablet: tablet ec6cdec27e9941ed9b485228f93b4d60 deleted and replaced by tablet 18ecaa8f587646aab81d60ca9ccf3541
I20250115 10:12:05.098896 3277 raft_consensus.cc:2463] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.099184 3485 leader_election.cc:304] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.099423 4434 raft_consensus.cc:2798] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.099473 4434 raft_consensus.cc:695] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.099522 4434 consensus_queue.cc:237] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.100594 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ac9bf5560f0142bda0cafd429777e9ff
I20250115 10:12:05.101037 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d200e7e299214ab8aad3a42a4d513da5
I20250115 10:12:05.101374 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet e8c99788dae6421b8b2dd4f40e2b63b2 (table default.Table_d7feadff267d4adcbd58c1243d812fe4 [id=8a0630954fd04a38828f02118934366a]) successfully deleted
I20250115 10:12:05.101439 4884 raft_consensus.cc:491] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.101469 3517 tablet_service.cc:1514] Processing DeleteTablet for tablet fc6b5ec8e472414789f9619ae958fa34 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.101486 4884 raft_consensus.cc:513] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.101534 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet d200e7e299214ab8aad3a42a4d513da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.101576 4884 leader_election.cc:290] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.101855 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.102016 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 with delete_type TABLET_DATA_DELETED (replaced by tablet 18ecaa8f587646aab81d60ca9ccf3541) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.102196 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet ac9bf5560f0142bda0cafd429777e9ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.102814 4557 raft_consensus.cc:357] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.102881 4557 raft_consensus.cc:383] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.102900 4557 raft_consensus.cc:738] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.102936 4557 consensus_queue.cc:260] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.103215 4875 consensus_queue.cc:1035] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.103468 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8ecc0818304f5e9522bba63a4aca4d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.103538 3277 raft_consensus.cc:2388] T cb8ecc0818304f5e9522bba63a4aca4d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:05.103725 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 18ecaa8f587646aab81d60ca9ccf3541 (DEFAULT_TABLE table=default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.103782 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 18ecaa8f587646aab81d60ca9ccf3541 (DEFAULT_TABLE table=default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.103878 3485 leader_election.cc:304] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.103922 3246 tablet_service.cc:1514] Processing DeleteTablet for tablet fc6b5ec8e472414789f9619ae958fa34 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.104032 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ebf48b3ee3564dcf9e39755c3cdab956" } modify_external_catalogs: true
I20250115 10:12:05.104126 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ebf48b3ee3564dcf9e39755c3cdab956" } modify_external_catalogs: true
I20250115 10:12:05.104228 4472 catalog_manager.cc:5526] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.104313 3260 tablet_service.cc:1514] Processing DeleteTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 with delete_type TABLET_DATA_DELETED (replaced by tablet 18ecaa8f587646aab81d60ca9ccf3541) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.104377 3252 tablet_service.cc:1514] Processing DeleteTablet for tablet ac9bf5560f0142bda0cafd429777e9ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.104419 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet d200e7e299214ab8aad3a42a4d513da5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.104684 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ecaa8f587646aab81d60ca9ccf3541. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.104766 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18ecaa8f587646aab81d60ca9ccf3541. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.105187 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 43fbb0a09ea8446eaee4cf38e222431b
I20250115 10:12:05.105800 3241 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fbb0a09ea8446eaee4cf38e222431b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.106040 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 43fbb0a09ea8446eaee4cf38e222431b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.106343 4434 raft_consensus.cc:3054] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.106736 4589 tablet_replica.cc:331] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.106808 4589 raft_consensus.cc:2238] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.106837 4589 raft_consensus.cc:2267] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.107033 4434 raft_consensus.cc:2743] T cb8ecc0818304f5e9522bba63a4aca4d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.107049 4589 ts_tablet_manager.cc:1905] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.107054 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]) successfully deleted
I20250115 10:12:05.107153 4557 ts_tablet_manager.cc:1428] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.022s user 0.000s sys 0.000s
W20250115 10:12:05.107683 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 2cff85958d3c46069b1dd9bf5cb75ca4
I20250115 10:12:05.107781 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_01cee5e7893944e280e7f3faa9b07f1c [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 2 got 0
I20250115 10:12:05.108335 4875 raft_consensus.cc:491] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.108386 4875 raft_consensus.cc:513] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.108490 4875 leader_election.cc:290] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.108855 4589 ts_tablet_manager.cc:1918] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.108934 4589 log.cc:1198] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/fc6b5ec8e472414789f9619ae958fa34
I20250115 10:12:05.109123 4589 ts_tablet_manager.cc:1939] T fc6b5ec8e472414789f9619ae958fa34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.109229 3278 raft_consensus.cc:3054] T 4ec3c400b50a4c8b9c490158732582f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.109488 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.109544 3547 raft_consensus.cc:2463] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.109622 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.109652 3350 leader_election.cc:304] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.109673 3276 raft_consensus.cc:2463] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.109737 4587 raft_consensus.cc:2798] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.109776 4587 raft_consensus.cc:491] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.109789 4587 raft_consensus.cc:3054] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.110402 4589 tablet_replica.cc:331] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.110431 4587 raft_consensus.cc:513] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.110544 4587 leader_election.cc:290] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.110558 4589 raft_consensus.cc:2238] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.110673 4589 raft_consensus.cc:2267] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.110689 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet fc6b5ec8e472414789f9619ae958fa34 (table default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]) successfully deleted
W20250115 10:12:05.110774 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet ec6cdec27e9941ed9b485228f93b4d60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ec6cdec27e9941ed9b485228f93b4d60 already in progress: creating tablet
W20250115 10:12:05.110837 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet ac9bf5560f0142bda0cafd429777e9ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac9bf5560f0142bda0cafd429777e9ff already in progress: creating tablet
I20250115 10:12:05.110873 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.110910 4587 consensus_queue.cc:1035] T 4ec3c400b50a4c8b9c490158732582f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.110932 3278 raft_consensus.cc:3054] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.111140 4589 ts_tablet_manager.cc:1905] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.111487 3278 raft_consensus.cc:2463] T 06c5994686054f51802fb9125beb85c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.111601 3350 leader_election.cc:304] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.111766 4587 raft_consensus.cc:2798] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.111778 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06c5994686054f51802fb9125beb85c4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.111814 4587 raft_consensus.cc:695] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.111835 3547 raft_consensus.cc:3054] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.111855 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d368093a74ba4918b0efcc3a909c3a07 (table default.Table_3178127dffd14c18a379abc82bbf56ed [id=ae729448e13640ec91bfd84661a02235]) successfully deleted
I20250115 10:12:05.111856 4587 consensus_queue.cc:237] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.112253 4434 raft_consensus.cc:491] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.112296 4434 raft_consensus.cc:513] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.112388 4434 leader_election.cc:290] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.112475 3547 raft_consensus.cc:2463] T 06c5994686054f51802fb9125beb85c4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.112574 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.112635 3415 raft_consensus.cc:2388] T 3f9295765384410d9ee9380b4db88ed0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.112903 4699 consensus_queue.cc:1035] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.112913 4472 catalog_manager.cc:5526] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:05.113384 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:05.113536 2918 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskjHaIeY/build/release/bin/kudu
/tmp/dist-test-taskjHaIeY/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--webserver_interface=127.2.217.189
--webserver_port=38131
--builtin_ntp_servers=127.2.217.148:42479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20250115 10:12:05.113691 4557 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.114137 4557 tablet_bootstrap.cc:654] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.114338 5156 raft_consensus.cc:491] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.114382 5156 raft_consensus.cc:513] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.114493 5156 leader_election.cc:290] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.114780 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f9295765384410d9ee9380b4db88ed0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.114868 4551 tablet_replica.cc:331] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.114929 4551 raft_consensus.cc:2238] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.114962 4551 raft_consensus.cc:2267] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.115144 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.115176 4551 ts_tablet_manager.cc:1905] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.115198 3415 raft_consensus.cc:2463] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.115337 3546 raft_consensus.cc:3054] T 87d8167b34064888be6e4df4dfde0b31 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.115468 3485 leader_election.cc:304] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.116118 3214 leader_election.cc:304] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.116199 5156 raft_consensus.cc:2798] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.116235 5156 raft_consensus.cc:491] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.116252 5156 raft_consensus.cc:3054] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.116524 4699 consensus_queue.cc:1035] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.116789 4551 ts_tablet_manager.cc:1918] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.116828 3548 raft_consensus.cc:3054] T e3dd43785e2541d8be54b6ca339a754d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.116835 4551 log.cc:1198] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/fc6b5ec8e472414789f9619ae958fa34
I20250115 10:12:05.117103 5156 raft_consensus.cc:513] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.117197 4551 ts_tablet_manager.cc:1939] T fc6b5ec8e472414789f9619ae958fa34 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.117237 5156 leader_election.cc:290] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.117414 4551 tablet_replica.cc:331] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.117475 4551 raft_consensus.cc:2238] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.117508 4551 raft_consensus.cc:2267] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.117496 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet fc6b5ec8e472414789f9619ae958fa34 (table default.Table_f8d6c0ddeb824b5e9a7a3e1253bd89b1 [id=683b23f9d88347f8a4e49a0e52e4eb25]) successfully deleted
I20250115 10:12:05.117751 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.117812 4699 consensus_queue.cc:1035] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.117820 3415 raft_consensus.cc:3054] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.117827 4575 tablet_bootstrap.cc:492] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.118036 4575 ts_tablet_manager.cc:1397] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.001s
I20250115 10:12:05.118196 4575 raft_consensus.cc:357] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.118248 4575 raft_consensus.cc:383] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.118265 4575 raft_consensus.cc:738] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.118297 4575 consensus_queue.cc:260] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.118311 4587 raft_consensus.cc:491] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.118348 4587 raft_consensus.cc:513] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.118384 4575 ts_tablet_manager.cc:1428] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.118417 4587 leader_election.cc:290] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.118438 4575 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.118680 3415 raft_consensus.cc:2463] T 0d5cf0e380d348f1ae2f05db1a010a19 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.118894 4575 tablet_bootstrap.cc:654] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.118898 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.119067 3215 leader_election.cc:343] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.119088 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:05.119236 3215 leader_election.cc:343] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.119297 4551 ts_tablet_manager.cc:1905] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.119400 3214 leader_election.cc:304] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.119555 4884 raft_consensus.cc:3054] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.119601 5155 raft_consensus.cc:2798] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.119640 5155 raft_consensus.cc:695] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.119683 5155 consensus_queue.cc:237] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.119817 3350 leader_election.cc:343] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 166e6390660c485c99b2e115fd1b272f
I20250115 10:12:05.119876 5155 raft_consensus.cc:491] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.119910 5155 raft_consensus.cc:513] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.119910 4811 consensus_queue.cc:1035] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.119976 5155 leader_election.cc:290] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.120266 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.119565 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e6390660c485c99b2e115fd1b272f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.120314 3550 raft_consensus.cc:2463] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.120325 3544 raft_consensus.cc:2463] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.120240 4884 raft_consensus.cc:2743] T 3f9295765384410d9ee9380b4db88ed0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.120483 3215 leader_election.cc:304] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.120563 4335 raft_consensus.cc:2798] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.120615 4335 raft_consensus.cc:491] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.120635 4335 raft_consensus.cc:3054] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.120653 3350 leader_election.cc:304] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.120736 4811 raft_consensus.cc:2798] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.120775 4811 raft_consensus.cc:491] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.120797 4811 raft_consensus.cc:3054] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.120946 3415 raft_consensus.cc:3054] T a154d22681d34329b497747e84ce41cf P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.121232 4335 raft_consensus.cc:513] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.121327 4335 leader_election.cc:290] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.121471 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7e7f081cc75747b8b4b7ffee7dcf9a55" } new_table_name: "default.Table_768ebc270e7b4019acf85bc3ed952c2d" modify_external_catalogs: true
I20250115 10:12:05.121496 4811 raft_consensus.cc:513] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.121582 4811 leader_election.cc:290] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.121752 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet ac8b3c397070467196b73dedcacf22de
I20250115 10:12:05.122138 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "166e6390660c485c99b2e115fd1b272f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.122216 3544 raft_consensus.cc:3054] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.122485 3350 leader_election.cc:343] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 166e6390660c485c99b2e115fd1b272f
I20250115 10:12:05.122722 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.122789 3550 raft_consensus.cc:3054] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.122823 3544 raft_consensus.cc:2463] T 166e6390660c485c99b2e115fd1b272f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.122951 3350 leader_election.cc:304] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.123512 3550 raft_consensus.cc:2463] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.123601 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.123742 4811 raft_consensus.cc:2798] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.123791 4811 raft_consensus.cc:695] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.123824 4811 consensus_queue.cc:237] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.124082 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.124219 3214 leader_election.cc:343] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.124702 3214 leader_election.cc:343] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.125126 3215 leader_election.cc:304] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.125296 5155 raft_consensus.cc:2798] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.125345 5155 raft_consensus.cc:695] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.125416 5155 consensus_queue.cc:237] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.125502 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
W20250115 10:12:05.125556 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 166e6390660c485c99b2e115fd1b272f
W20250115 10:12:05.125556 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:05.126046 4551 ts_tablet_manager.cc:1918] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.126065 4569 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.126119 4569 ts_tablet_manager.cc:1397] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.000s
I20250115 10:12:05.126224 4589 ts_tablet_manager.cc:1918] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.126302 4589 log.cc:1198] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d200e7e299214ab8aad3a42a4d513da5
I20250115 10:12:05.126370 4551 log.cc:1198] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d200e7e299214ab8aad3a42a4d513da5
I20250115 10:12:05.126289 4569 raft_consensus.cc:357] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.126453 4569 raft_consensus.cc:383] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.126483 4569 raft_consensus.cc:738] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.126533 4569 consensus_queue.cc:260] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.126601 4589 ts_tablet_manager.cc:1939] T d200e7e299214ab8aad3a42a4d513da5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.126678 4569 ts_tablet_manager.cc:1428] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.126737 4569 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.127166 4569 tablet_bootstrap.cc:654] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.127190 4551 ts_tablet_manager.cc:1939] T d200e7e299214ab8aad3a42a4d513da5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:05.127357 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet cc395ae76a494a8eb682b7ef34dcb169
I20250115 10:12:05.127424 4551 tablet_replica.cc:331] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.127411 4474 catalog_manager.cc:5526] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.127483 4551 raft_consensus.cc:2238] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.127508 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 0e23a070a8454f3b8bd1620ac4535a12 (table default.Table_768ebc270e7b4019acf85bc3ed952c2d [id=25897e7460ce44ab84a870fcae962481]). Expected version 1 got 0
I20250115 10:12:05.127516 4551 raft_consensus.cc:2267] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.127899 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d200e7e299214ab8aad3a42a4d513da5 (table default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]) successfully deleted
I20250115 10:12:05.127611 4551 ts_tablet_manager.cc:1905] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.128327 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d200e7e299214ab8aad3a42a4d513da5 (table default.Table_c9a4fdf26f954f40a3e13debd4b15d1b [id=c94ac6bcde7746238f33f996bc715204]) successfully deleted
W20250115 10:12:05.128414 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 43fbb0a09ea8446eaee4cf38e222431b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fbb0a09ea8446eaee4cf38e222431b already in progress: creating tablet
W20250115 10:12:05.129359 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
W20250115 10:12:05.129689 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:05.130749 4575 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.130779 4551 ts_tablet_manager.cc:1918] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.130818 4551 log.cc:1198] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/ec6cdec27e9941ed9b485228f93b4d60
I20250115 10:12:05.130810 4575 ts_tablet_manager.cc:1397] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:05.130973 4551 ts_tablet_manager.cc:1939] T ec6cdec27e9941ed9b485228f93b4d60 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.130960 4575 raft_consensus.cc:357] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.131146 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4a0811cad8454c2e871aad2101224f34
I20250115 10:12:05.131129 4811 consensus_queue.cc:1035] T f3cba581c6884fd98503d4883b09d4a6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.131017 4575 raft_consensus.cc:383] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.131481 4575 raft_consensus.cc:738] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.131533 4575 consensus_queue.cc:260] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.131664 4575 ts_tablet_manager.cc:1428] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.132052 4557 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.132063 4575 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.132097 4557 ts_tablet_manager.cc:1397] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250115 10:12:05.132239 4557 raft_consensus.cc:357] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.132294 4557 raft_consensus.cc:383] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.132313 4557 raft_consensus.cc:738] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.132350 4557 consensus_queue.cc:260] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.132441 4557 ts_tablet_manager.cc:1428] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.132463 4575 tablet_bootstrap.cc:654] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.132508 4557 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.132644 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:05.132743 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet ec6cdec27e9941ed9b485228f93b4d60 (table default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]) successfully deleted
W20250115 10:12:05.132784 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet ac9bf5560f0142bda0cafd429777e9ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac9bf5560f0142bda0cafd429777e9ff already in progress: creating tablet
W20250115 10:12:05.132829 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 43fbb0a09ea8446eaee4cf38e222431b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 43fbb0a09ea8446eaee4cf38e222431b already in progress: creating tablet
I20250115 10:12:05.132915 4557 tablet_bootstrap.cc:654] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.134315 4335 raft_consensus.cc:491] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.134373 4335 raft_consensus.cc:513] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.134480 4335 leader_election.cc:290] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.134737 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet f3cba581c6884fd98503d4883b09d4a6
I20250115 10:12:05.135171 4875 consensus_queue.cc:1035] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.135459 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.135625 3214 leader_election.cc:343] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.135951 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.136039 3547 raft_consensus.cc:2463] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.136159 3215 leader_election.cc:304] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.136267 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet bcd888d924fd43b590710613560f16d5 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.136687 5155 raft_consensus.cc:2798] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.136652 4811 consensus_queue.cc:1035] T e3dd43785e2541d8be54b6ca339a754d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.136725 5155 raft_consensus.cc:491] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.136745 5155 raft_consensus.cc:3054] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.136780 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_9a526e66b6da46c6a70efda61f98c0cc [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]). Expected version 2 got 0
I20250115 10:12:05.137042 4884 raft_consensus.cc:491] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.137090 4884 raft_consensus.cc:513] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.137223 4884 leader_election.cc:290] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.137557 5155 raft_consensus.cc:513] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.137650 5155 leader_election.cc:290] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.137676 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.137893 4335 raft_consensus.cc:491] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.137933 4335 raft_consensus.cc:513] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.138025 4335 leader_election.cc:290] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.138144 3484 leader_election.cc:343] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.138159 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.138203 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:05.138274 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 0e23a070a8454f3b8bd1620ac4535a12 (table default.Table_768ebc270e7b4019acf85bc3ed952c2d [id=25897e7460ce44ab84a870fcae962481]). Expected version 1 got 0
W20250115 10:12:05.138273 3350 consensus_peers.cc:487] T 0e23a070a8454f3b8bd1620ac4535a12 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:05.138309 3214 leader_election.cc:343] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.138355 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.138506 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet bcd888d924fd43b590710613560f16d5
W20250115 10:12:05.138533 3214 leader_election.cc:343] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.138584 4474 catalog_manager.cc:6596] ReplaceTablet: tablet bcd888d924fd43b590710613560f16d5 deleted and replaced by tablet 98e707b056a74f249b06636da56eb8d0
I20250115 10:12:05.138761 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet bcd888d924fd43b590710613560f16d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 98e707b056a74f249b06636da56eb8d0) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.138824 4589 tablet_replica.cc:331] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.138870 4589 raft_consensus.cc:2238] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.138933 4589 raft_consensus.cc:2267] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:05.139050 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2377c27855a64ac7bec95a6d6c5289af
I20250115 10:12:05.139055 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet bcd888d924fd43b590710613560f16d5 with delete_type TABLET_DATA_DELETED (replaced by tablet 98e707b056a74f249b06636da56eb8d0) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.139117 4551 tablet_replica.cc:331] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.139144 4589 ts_tablet_manager.cc:1905] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.139168 4551 raft_consensus.cc:2238] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.139200 4551 raft_consensus.cc:2267] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.139832 4551 ts_tablet_manager.cc:1905] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.140508 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.140571 3279 raft_consensus.cc:2463] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.140589 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.140655 3550 raft_consensus.cc:2463] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.140690 3485 leader_election.cc:304] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.140802 4884 raft_consensus.cc:2798] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.140821 4589 ts_tablet_manager.cc:1918] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.140833 4884 raft_consensus.cc:491] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.140851 4884 raft_consensus.cc:3054] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.140861 4589 log.cc:1198] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/bcd888d924fd43b590710613560f16d5
I20250115 10:12:05.140875 4587 consensus_queue.cc:1035] T 57d3800d79794d3bad6c50d2dc8e9258 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.141058 4589 ts_tablet_manager.cc:1939] T bcd888d924fd43b590710613560f16d5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.141112 4551 ts_tablet_manager.cc:1918] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.141172 4551 log.cc:1198] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/bcd888d924fd43b590710613560f16d5
I20250115 10:12:05.141367 4551 ts_tablet_manager.cc:1939] T bcd888d924fd43b590710613560f16d5 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.141537 4884 raft_consensus.cc:513] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.141644 4884 leader_election.cc:290] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.141660 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.141711 3548 raft_consensus.cc:3054] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.141774 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet bcd888d924fd43b590710613560f16d5 (table default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]) successfully deleted
I20250115 10:12:05.141834 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet bcd888d924fd43b590710613560f16d5 (table default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]) successfully deleted
I20250115 10:12:05.142019 3215 leader_election.cc:304] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.142143 4335 raft_consensus.cc:2798] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.142182 4335 raft_consensus.cc:491] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.142200 4335 raft_consensus.cc:3054] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.142314 3548 raft_consensus.cc:2463] T 367694b5edf143ef81e99e348543659a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.142390 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.142442 3278 raft_consensus.cc:3054] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.142870 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:05.142840 4335 raft_consensus.cc:513] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.142956 4335 leader_election.cc:290] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.143091 3278 raft_consensus.cc:2463] T aef601e6f3ef4ba387164c239c1139b0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.143224 3485 leader_election.cc:304] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.143306 4884 raft_consensus.cc:2798] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.143316 4587 raft_consensus.cc:491] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.143339 4884 raft_consensus.cc:695] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.143364 4587 raft_consensus.cc:513] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.143376 4884 consensus_queue.cc:237] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.143471 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.143469 4587 leader_election.cc:290] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.143532 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.143635 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.143761 3214 leader_election.cc:343] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.143769 3484 leader_election.cc:343] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.143857 3350 leader_election.cc:343] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.143914 4575 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.143937 4557 tablet_bootstrap.cc:492] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.143951 4575 ts_tablet_manager.cc:1397] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:05.143971 4557 ts_tablet_manager.cc:1397] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.000s
I20250115 10:12:05.144078 4575 raft_consensus.cc:357] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.144124 4575 raft_consensus.cc:383] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.144143 4575 raft_consensus.cc:738] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.144124 4557 raft_consensus.cc:357] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.144171 4557 raft_consensus.cc:383] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.144188 4557 raft_consensus.cc:738] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.144186 4575 consensus_queue.cc:260] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.144222 4557 consensus_queue.cc:260] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.144299 4575 ts_tablet_manager.cc:1428] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.144323 4557 ts_tablet_manager.cc:1428] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.144388 4575 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.144412 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:05.144430 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4727b40e9db4460b826fcc1ca67c9c8f
I20250115 10:12:05.144447 3548 raft_consensus.cc:3054] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.144464 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 57d3800d79794d3bad6c50d2dc8e9258
I20250115 10:12:05.144486 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 0e23a070a8454f3b8bd1620ac4535a12 (table default.Table_768ebc270e7b4019acf85bc3ed952c2d [id=25897e7460ce44ab84a870fcae962481]). Expected version 1 got 0
I20250115 10:12:05.144881 4575 tablet_bootstrap.cc:654] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.145030 3548 raft_consensus.cc:2463] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.145283 4569 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.145331 4569 ts_tablet_manager.cc:1397] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
W20250115 10:12:05.145395 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 4283a096b18b4be69e1f57e60c3efd3e
I20250115 10:12:05.145483 4569 raft_consensus.cc:357] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.145546 4569 raft_consensus.cc:383] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.145570 4569 raft_consensus.cc:738] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.145602 4569 consensus_queue.cc:260] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.145699 4569 ts_tablet_manager.cc:1428] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.145767 4569 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.146170 4569 tablet_bootstrap.cc:654] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.146723 4557 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.146741 4575 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.146793 4575 ts_tablet_manager.cc:1397] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.146770 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.146920 4575 raft_consensus.cc:357] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.146971 4575 raft_consensus.cc:383] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.146987 4575 raft_consensus.cc:738] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.147010 4575 consensus_queue.cc:260] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.147114 4575 ts_tablet_manager.cc:1428] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.147138 4557 tablet_bootstrap.cc:654] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.147178 4575 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.146694 3215 leader_election.cc:304] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.147572 4575 tablet_bootstrap.cc:654] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.147541 3215 leader_election.cc:304] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.147600 4335 raft_consensus.cc:2798] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.147703 5155 raft_consensus.cc:2798] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.147716 4335 raft_consensus.cc:695] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.147800 4335 consensus_queue.cc:237] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.147863 3350 leader_election.cc:343] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.147898 3350 leader_election.cc:304] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.148080 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 98e707b056a74f249b06636da56eb8d0 (DEFAULT_TABLE table=default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:05.148104 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 4283a096b18b4be69e1f57e60c3efd3e
I20250115 10:12:05.148177 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e707b056a74f249b06636da56eb8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.148211 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 98e707b056a74f249b06636da56eb8d0 (DEFAULT_TABLE table=default.Table_854274990cc14e9ab02633f53d2bb6ad [id=58174ef198d341d2a89b7da9ca676977]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.148290 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e707b056a74f249b06636da56eb8d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.148507 4699 raft_consensus.cc:2743] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.147756 5155 raft_consensus.cc:695] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.148810 5155 consensus_queue.cc:237] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.148876 4474 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5f37b29ba1cb4a0289268ba1241527b8 (table default.Table_3249ea9ae59247ca976f3c00dc0b4947 [id=2cd4c5e9ab1f4e018b47117186f14066]). Expected version 1 got 0
I20250115 10:12:05.149581 4569 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.149624 4569 ts_tablet_manager.cc:1397] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:05.149745 4569 raft_consensus.cc:357] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.149796 4569 raft_consensus.cc:383] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.149814 4569 raft_consensus.cc:738] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.149850 4569 consensus_queue.cc:260] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.149946 4569 ts_tablet_manager.cc:1428] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.150022 4569 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.150195 4468 catalog_manager.cc:5526] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.150295 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet aef601e6f3ef4ba387164c239c1139b0 (table default.Table_cecb6f1f23024733adb9c01fa147f123 [id=052d737a4b094e18bbdf60637f1bf00b]). Expected version 1 got 0
I20250115 10:12:05.150395 4569 tablet_bootstrap.cc:654] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.150826 3411 raft_consensus.cc:3054] T d07f6f091ee847e49d1c64bee583a7a4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.152026 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 367694b5edf143ef81e99e348543659a
I20250115 10:12:05.152091 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_8166964273cd466883c47516ef68ef46 [id=988e12ca3c094601a1189d8558614dae]). Expected version 1 got 0
I20250115 10:12:05.152127 4474 catalog_manager.cc:5526] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.152202 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]). Expected version 1 got 0
I20250115 10:12:05.152518 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1c3356d340b54d349223311a44e03f7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.152639 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c3356d340b54d349223311a44e03f7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.153155 4434 raft_consensus.cc:491] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.153211 4434 raft_consensus.cc:513] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.153306 4434 leader_election.cc:290] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.153497 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.153558 3279 raft_consensus.cc:2463] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.153708 3485 leader_election.cc:304] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.153815 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.153959 4434 raft_consensus.cc:2798] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.153992 4434 raft_consensus.cc:491] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.154009 4434 raft_consensus.cc:3054] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.154590 4434 raft_consensus.cc:513] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.154695 4434 leader_election.cc:290] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.155428 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.155484 3276 raft_consensus.cc:3054] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.155704 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 3119c276fa7a4363a1d5299f6cfb842e (DEFAULT_TABLE table=default.Table_1c3356d340b54d349223311a44e03f7b [id=d1af0262be8b4995bb32c4e22338aece]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.155824 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3119c276fa7a4363a1d5299f6cfb842e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.155843 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 3119c276fa7a4363a1d5299f6cfb842e (DEFAULT_TABLE table=default.Table_1c3356d340b54d349223311a44e03f7b [id=d1af0262be8b4995bb32c4e22338aece]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.155936 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3119c276fa7a4363a1d5299f6cfb842e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.156163 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_cf11404b146e4e1e8d59cb7501344676" } new_table_name: "default.Table_f013e6f4f6244eedae83de47bad7061c" modify_external_catalogs: true
I20250115 10:12:05.156272 3276 raft_consensus.cc:2463] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.156351 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfe0522e3e664012a00ec78a09c2816c" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.156466 3484 leader_election.cc:343] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.156562 3485 leader_election.cc:304] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.156635 4434 raft_consensus.cc:2798] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.156692 4434 raft_consensus.cc:695] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.156735 4434 consensus_queue.cc:237] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.157094 3484 leader_election.cc:343] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.157177 4569 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.157218 4569 ts_tablet_manager.cc:1397] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:05.157356 4569 raft_consensus.cc:357] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.157421 4569 raft_consensus.cc:383] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.157445 4569 raft_consensus.cc:738] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.157488 4569 consensus_queue.cc:260] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.157589 4569 ts_tablet_manager.cc:1428] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.157658 4569 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.158113 4569 tablet_bootstrap.cc:654] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.158171 4472 catalog_manager.cc:5526] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.158219 4699 consensus_queue.cc:1035] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.158264 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet bfe0522e3e664012a00ec78a09c2816c (table default.Table_2f22e0d020084d739129671161bf56c1 [id=682d6c56f2084f9abb758f7dea6ed1ab]). Expected version 1 got 0
I20250115 10:12:05.159204 4811 consensus_queue.cc:1035] T 87d8167b34064888be6e4df4dfde0b31 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.159507 4575 tablet_bootstrap.cc:492] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.159548 4575 ts_tablet_manager.cc:1397] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:05.159698 4575 raft_consensus.cc:357] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.159806 4575 raft_consensus.cc:383] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.159830 4575 raft_consensus.cc:738] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.159870 4575 consensus_queue.cc:260] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.159973 4575 ts_tablet_manager.cc:1428] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.159960 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f38308d61eec4f2988d3d98f6b47660a [id=c07c3cfb82be473395736827fc642890]). Expected version 4 got 0
I20250115 10:12:05.160036 4575 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.160310 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18c05e81b1354e26900949537465cf08 consensus state has no leader
I20250115 10:12:05.160449 4575 tablet_bootstrap.cc:654] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.160933 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:05.161437 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_ad87d204318d444aa5cb3db8c84895e8 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 1 got 0
I20250115 10:12:05.161988 4557 tablet_bootstrap.cc:492] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.162027 4557 ts_tablet_manager.cc:1397] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s
I20250115 10:12:05.162168 4557 raft_consensus.cc:357] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.162222 4557 raft_consensus.cc:383] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.162241 4557 raft_consensus.cc:738] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.162277 4557 consensus_queue.cc:260] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.162366 4557 ts_tablet_manager.cc:1428] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.162436 4557 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.162894 4557 tablet_bootstrap.cc:654] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.163178 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:05.163923 4557 tablet_bootstrap.cc:492] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.163959 4557 ts_tablet_manager.cc:1397] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.164085 4557 raft_consensus.cc:357] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.164144 4557 raft_consensus.cc:383] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.164163 4557 raft_consensus.cc:738] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:12:05.164151 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:05.164211 4557 consensus_queue.cc:260] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.164304 4557 ts_tablet_manager.cc:1428] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.164355 4557 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:05.164669 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 41e2e034ea974448922f2cb0529bd196
I20250115 10:12:05.164769 4557 tablet_bootstrap.cc:654] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.165185 5155 raft_consensus.cc:491] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.165235 5155 raft_consensus.cc:513] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.165349 5155 leader_election.cc:290] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.165544 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 87d8167b34064888be6e4df4dfde0b31
I20250115 10:12:05.165637 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3402dc674ab0402f8e0bdd7b8db4b88d (table default.Table_7b73790b66b24fa6a82b5059181ca640 [id=11052d4535194a8f86c25882817ffaca]). Expected version 2 got 0
I20250115 10:12:05.165756 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.165951 3214 leader_election.cc:343] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.166043 4811 raft_consensus.cc:491] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.166092 4811 raft_consensus.cc:513] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.166213 4811 leader_election.cc:290] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.166443 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.166473 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.166519 3277 raft_consensus.cc:2463] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.166599 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.166666 3548 raft_consensus.cc:2463] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.166672 3350 leader_election.cc:304] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.166755 4557 tablet_bootstrap.cc:492] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.166786 4811 raft_consensus.cc:2798] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.166806 4557 ts_tablet_manager.cc:1397] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
W20250115 10:12:05.166817 3350 leader_election.cc:343] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.166823 4811 raft_consensus.cc:491] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.166884 4811 raft_consensus.cc:3054] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.166934 3215 leader_election.cc:304] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.166945 4557 raft_consensus.cc:357] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.167006 4557 raft_consensus.cc:383] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.167032 4557 raft_consensus.cc:738] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.167078 4557 consensus_queue.cc:260] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.167115 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_36020db3fd0f4775babdeb0f2449300a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.167214 4557 ts_tablet_manager.cc:1428] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:05.167240 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36020db3fd0f4775babdeb0f2449300a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.167291 4557 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.167668 4557 tablet_bootstrap.cc:654] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.167645 4811 raft_consensus.cc:513] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.167793 4811 leader_election.cc:290] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.167848 4811 raft_consensus.cc:491] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.167878 4811 raft_consensus.cc:513] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.167970 4811 leader_election.cc:290] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.168040 5155 raft_consensus.cc:2798] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.168084 5155 raft_consensus.cc:491] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.168118 5155 raft_consensus.cc:3054] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.168205 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.168370 3350 leader_election.cc:343] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.168670 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.168735 3279 raft_consensus.cc:2463] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.168802 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.168840 3277 raft_consensus.cc:3054] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.169423 3350 leader_election.cc:304] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.169518 3277 raft_consensus.cc:2463] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.169674 3350 leader_election.cc:304] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.169679 4877 raft_consensus.cc:2798] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.169770 4877 raft_consensus.cc:491] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.169788 4877 raft_consensus.cc:3054] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.170480 4877 raft_consensus.cc:513] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.170593 4877 leader_election.cc:290] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.170634 4877 raft_consensus.cc:2798] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.170670 4877 raft_consensus.cc:695] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.170717 4877 consensus_queue.cc:237] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.170871 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:05.171056 3350 leader_election.cc:343] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.171550 4434 raft_consensus.cc:491] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.171602 4434 raft_consensus.cc:513] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.171768 4434 leader_election.cc:290] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.171933 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.171957 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.172053 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7e2086241df4b4fac5e481c5e8295a9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.172112 3277 raft_consensus.cc:3054] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.172192 3484 leader_election.cc:343] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.172262 3350 leader_election.cc:343] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.172464 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.172524 3279 raft_consensus.cc:2463] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.172786 3277 raft_consensus.cc:2463] T a7e2086241df4b4fac5e481c5e8295a9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.172824 3513 tablet_service.cc:1467] Processing CreateTablet for tablet eb659a11e3ed4f23ac90bfa8ee108c9b (DEFAULT_TABLE table=default.Table_36020db3fd0f4775babdeb0f2449300a [id=bb718e31b34c49babdff478fd2e3c252]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.172881 3257 tablet_service.cc:1467] Processing CreateTablet for tablet eb659a11e3ed4f23ac90bfa8ee108c9b (DEFAULT_TABLE table=default.Table_36020db3fd0f4775babdeb0f2449300a [id=bb718e31b34c49babdff478fd2e3c252]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.172932 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb659a11e3ed4f23ac90bfa8ee108c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.172963 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb659a11e3ed4f23ac90bfa8ee108c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.172959 3485 leader_election.cc:304] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.173048 4434 raft_consensus.cc:2798] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.173071 4434 raft_consensus.cc:491] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.173089 4434 raft_consensus.cc:3054] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.173027 4472 catalog_manager.cc:5526] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.173817 4434 raft_consensus.cc:513] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.173957 4434 leader_election.cc:290] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.174048 5156 raft_consensus.cc:491] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.174093 5156 raft_consensus.cc:513] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.174199 5156 leader_election.cc:290] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.174289 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.174343 3277 raft_consensus.cc:3054] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.174420 5155 raft_consensus.cc:513] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.174484 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0922008e726c4e53b00b287261a2f0a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.174530 5155 leader_election.cc:290] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.174535 3411 raft_consensus.cc:2463] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.174899 3350 leader_election.cc:304] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.175052 3277 raft_consensus.cc:2463] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.175053 4714 raft_consensus.cc:491] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.175096 4714 raft_consensus.cc:513] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.175172 4714 leader_election.cc:290] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.175141 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.175199 4714 raft_consensus.cc:2798] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.175189 3485 leader_election.cc:304] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.175225 4714 raft_consensus.cc:695] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.175254 4714 consensus_queue.cc:237] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.175420 4434 raft_consensus.cc:2798] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.175486 4434 raft_consensus.cc:695] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.175532 4434 consensus_queue.cc:237] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.175544 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.175700 4557 tablet_bootstrap.cc:492] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.175767 4557 ts_tablet_manager.cc:1397] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
W20250115 10:12:05.175853 3484 leader_election.cc:343] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.176012 3350 leader_election.cc:343] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.176265 4557 raft_consensus.cc:357] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.176322 4557 raft_consensus.cc:383] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.176342 4557 raft_consensus.cc:738] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.176378 4557 consensus_queue.cc:260] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.176550 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0922008e726c4e53b00b287261a2f0a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.176652 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.176698 3550 raft_consensus.cc:3054] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.176676 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.176731 3277 raft_consensus.cc:2463] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.176821 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f469479d54a445cc94bea2d511828e08" } new_table_name: "default.Table_697980ec22a34e649e8b5ee438986747" modify_external_catalogs: true
I20250115 10:12:05.176964 3350 leader_election.cc:304] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.176999 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ad87d204318d444aa5cb3db8c84895e8" } new_table_name: "default.Table_d17f933658224a6cb2296f32c86f8973" modify_external_catalogs: true
I20250115 10:12:05.177066 4714 raft_consensus.cc:2798] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.177091 4714 raft_consensus.cc:491] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.177109 4714 raft_consensus.cc:3054] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.177147 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9a356d4a12e34a579e4bb768f68ebf11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.177259 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a356d4a12e34a579e4bb768f68ebf11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.177392 3550 raft_consensus.cc:2463] T c85d63cc502f418b91aec39245c707b9 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.177655 3214 leader_election.cc:304] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.177829 4714 raft_consensus.cc:513] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.177827 4473 catalog_manager.cc:5526] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.177915 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_2bc1f827e44144f4b2bcc3b6a0229a54 [id=75a3cabc6ab0415992e902b02ea54d47]). Expected version 1 got 0
I20250115 10:12:05.177932 4714 leader_election.cc:290] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.178023 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.178119 3215 leader_election.cc:343] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.178225 3215 leader_election.cc:304] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.178369 4557 ts_tablet_manager.cc:1428] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:05.178431 4557 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.178653 5156 raft_consensus.cc:2798] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.178690 5156 raft_consensus.cc:491] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.178707 5156 raft_consensus.cc:3054] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.178820 4557 tablet_bootstrap.cc:654] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.178938 3214 leader_election.cc:343] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.179014 5155 raft_consensus.cc:2798] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.179049 5155 raft_consensus.cc:695] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.179083 5155 consensus_queue.cc:237] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.179347 5156 raft_consensus.cc:513] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.179443 5156 leader_election.cc:290] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.179915 4557 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.179951 4557 ts_tablet_manager.cc:1397] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.180068 4557 raft_consensus.cc:357] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.180114 4557 raft_consensus.cc:383] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.180128 4557 raft_consensus.cc:738] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.180245 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0922008e726c4e53b00b287261a2f0a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:05.180343 3215 leader_election.cc:343] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.180179 4557 consensus_queue.cc:260] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.180431 4472 catalog_manager.cc:5526] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.180507 4557 ts_tablet_manager.cc:1428] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.180572 4557 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.181157 4557 tablet_bootstrap.cc:654] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.181674 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 359eb3a976bd409b8e2d4b72f0b2348c consensus state has no leader
I20250115 10:12:05.181919 4471 catalog_manager.cc:5526] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.182003 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a7e2086241df4b4fac5e481c5e8295a9 (table default.Table_99fc538b849348e19ef1968953d83866 [id=0b1b8cdb67244dc19aed82671327d212]). Expected version 1 got 0
I20250115 10:12:05.182227 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.182278 3277 raft_consensus.cc:3054] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.182410 4877 consensus_queue.cc:1035] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.182925 3277 raft_consensus.cc:2463] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:05.182953 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:05.183459 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0922008e726c4e53b00b287261a2f0a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.183518 3415 raft_consensus.cc:3054] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.183605 4575 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.183655 4575 ts_tablet_manager.cc:1397] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250115 10:12:05.183843 3350 leader_election.cc:304] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.183946 4575 raft_consensus.cc:357] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.184005 4575 raft_consensus.cc:383] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.184027 4575 raft_consensus.cc:738] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.184069 4575 consensus_queue.cc:260] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.184180 4575 ts_tablet_manager.cc:1428] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.184228 3415 raft_consensus.cc:2463] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.184635 4811 raft_consensus.cc:2798] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.184681 4811 raft_consensus.cc:695] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.184720 4811 consensus_queue.cc:237] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.184942 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.185045 3214 leader_election.cc:304] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.184235 4575 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.185742 3350 leader_election.cc:343] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.185931 4575 tablet_bootstrap.cc:654] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.186283 4877 consensus_queue.cc:1035] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.186811 4569 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.186861 4569 ts_tablet_manager.cc:1397] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.001s
I20250115 10:12:05.187078 4569 raft_consensus.cc:357] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.187145 4569 raft_consensus.cc:383] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.187170 4569 raft_consensus.cc:738] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.187214 4569 consensus_queue.cc:260] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.187316 4569 ts_tablet_manager.cc:1428] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.187376 4569 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.187783 4569 tablet_bootstrap.cc:654] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.187095 3770 raft_consensus.cc:2798] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.188082 3770 raft_consensus.cc:695] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.188158 3770 consensus_queue.cc:237] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.188419 4569 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.188474 4569 ts_tablet_manager.cc:1397] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.188604 4569 raft_consensus.cc:357] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.188655 4569 raft_consensus.cc:383] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.188673 4569 raft_consensus.cc:738] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.188709 4569 consensus_queue.cc:260] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.188784 4569 ts_tablet_manager.cc:1428] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.189726 4471 catalog_manager.cc:5526] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
W20250115 10:12:05.189790 3350 consensus_peers.cc:487] T 707f0e47915e4a8998a97a8680394e5d P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.190094 4472 catalog_manager.cc:5526] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.190191 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet a577ace8245744d1a42938ddd99ce89b (table default.Table_f38308d61eec4f2988d3d98f6b47660a [id=c07c3cfb82be473395736827fc642890]). Expected version 4 got 0
I20250115 10:12:05.190331 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 46ee290b29ff425e80e5833c4055f4b1 (DEFAULT_TABLE table=default.Table_9a356d4a12e34a579e4bb768f68ebf11 [id=eabe95506bc24ec68350cef1e9f28215]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.190353 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 46ee290b29ff425e80e5833c4055f4b1 (DEFAULT_TABLE table=default.Table_9a356d4a12e34a579e4bb768f68ebf11 [id=eabe95506bc24ec68350cef1e9f28215]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.190469 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ee290b29ff425e80e5833c4055f4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.190518 4569 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.190548 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]). Expected version 3 got 0
I20250115 10:12:05.190999 4569 tablet_bootstrap.cc:654] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.191486 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:05.191975 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ee290b29ff425e80e5833c4055f4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.193841 4714 raft_consensus.cc:491] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.193897 4714 raft_consensus.cc:513] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.193979 3350 consensus_peers.cc:487] T 63980fabd5634bf39c41215740cd4d72 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.193980 4714 leader_election.cc:290] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.194258 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.194319 3548 raft_consensus.cc:2463] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.194433 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_d17f933658224a6cb2296f32c86f8973 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 2 got 0
I20250115 10:12:05.194558 3350 leader_election.cc:304] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.194692 4335 raft_consensus.cc:491] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.194741 4335 raft_consensus.cc:513] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.194788 4714 raft_consensus.cc:2798] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.194824 4714 raft_consensus.cc:491] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.194844 4714 raft_consensus.cc:3054] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.194823 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.194857 4335 leader_election.cc:290] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.194877 3279 raft_consensus.cc:2463] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:05.195022 3214 consensus_peers.cc:487] T 6e56c83017b54e65a066e8e377293b13 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e56c83017b54e65a066e8e377293b13. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:05.195178 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.195272 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.195335 3548 raft_consensus.cc:2463] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.195566 3215 leader_election.cc:304] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.195580 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:05.195539 4714 raft_consensus.cc:513] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.195675 4714 leader_election.cc:290] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.195881 3214 leader_election.cc:343] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.195940 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.195955 5155 raft_consensus.cc:2798] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.195998 3548 raft_consensus.cc:3054] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.196000 5155 raft_consensus.cc:491] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.196031 5155 raft_consensus.cc:3054] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.196696 5155 raft_consensus.cc:513] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.196799 3548 raft_consensus.cc:2463] T 616166bc9d5d4651999b1d2e0a1851bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.196813 5155 leader_election.cc:290] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.196925 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 63980fabd5634bf39c41215740cd4d72 (table default.Table_d17f933658224a6cb2296f32c86f8973 [id=a2ca82a76a4749ffb9602319f4f14839]). Expected version 2 got 0
I20250115 10:12:05.197037 3350 leader_election.cc:304] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.197116 4587 raft_consensus.cc:2798] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.197165 4587 raft_consensus.cc:695] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.197185 3548 raft_consensus.cc:3054] T 1385fb81dff24e709d5d45fb9d616369 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.197206 4587 consensus_queue.cc:237] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.197979 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616166bc9d5d4651999b1d2e0a1851bb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.198040 3279 raft_consensus.cc:3054] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.198298 4587 consensus_queue.cc:1035] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.198709 3279 raft_consensus.cc:2463] T 616166bc9d5d4651999b1d2e0a1851bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.198917 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.198982 3548 raft_consensus.cc:3054] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.199604 3548 raft_consensus.cc:2463] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.199781 3215 leader_election.cc:304] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.199867 5155 raft_consensus.cc:2798] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.199932 5155 raft_consensus.cc:695] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.199977 5155 consensus_queue.cc:237] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.200477 4575 tablet_bootstrap.cc:492] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.200516 4575 ts_tablet_manager.cc:1397] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250115 10:12:05.200667 4575 raft_consensus.cc:357] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.200757 4575 raft_consensus.cc:383] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.200780 4575 raft_consensus.cc:738] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.200814 4575 consensus_queue.cc:260] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.200922 4575 ts_tablet_manager.cc:1428] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.200995 4575 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.201419 4575 tablet_bootstrap.cc:654] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.201722 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.201962 3214 leader_election.cc:343] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.201983 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 2cff85958d3c46069b1dd9bf5cb75ca4
I20250115 10:12:05.202153 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet ec6cdec27e9941ed9b485228f93b4d60 with delete_type TABLET_DATA_DELETED (replaced by tablet 18ecaa8f587646aab81d60ca9ccf3541) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.202225 4589 tablet_replica.cc:331] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.202286 4589 raft_consensus.cc:2238] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.202319 4589 raft_consensus.cc:2267] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:05.202589 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 616166bc9d5d4651999b1d2e0a1851bb
I20250115 10:12:05.204222 4884 raft_consensus.cc:491] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.204274 4884 raft_consensus.cc:513] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.204293 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet c68f61c8b72b4628bba5c52f8025a240 (table default.Table_2bc1f827e44144f4b2bcc3b6a0229a54 [id=75a3cabc6ab0415992e902b02ea54d47]). Expected version 1 got 0
I20250115 10:12:05.204373 4884 leader_election.cc:290] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.204583 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.204653 3279 raft_consensus.cc:2463] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.204751 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.204805 3485 leader_election.cc:304] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.204813 3415 raft_consensus.cc:2463] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.204870 4884 raft_consensus.cc:2798] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.204892 4884 raft_consensus.cc:491] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.204908 4884 raft_consensus.cc:3054] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.205551 4884 raft_consensus.cc:513] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.205657 4884 leader_election.cc:290] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.205943 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.206012 3279 raft_consensus.cc:3054] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.206703 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_4a944e0264fe4724960c3d592a927064"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.206787 3279 raft_consensus.cc:2463] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:12:05.206846 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a944e0264fe4724960c3d592a927064 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.206878 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afe405846f924decb1786b338a306f62" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.206944 3415 raft_consensus.cc:3054] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.207033 3485 leader_election.cc:304] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.207134 4589 ts_tablet_manager.cc:1905] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.207237 4884 raft_consensus.cc:2798] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.207307 4884 raft_consensus.cc:695] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.207355 4884 consensus_queue.cc:237] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.207711 3415 raft_consensus.cc:2463] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.208549 4471 catalog_manager.cc:5526] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.208637 4589 ts_tablet_manager.cc:1918] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.208685 4589 log.cc:1198] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/ec6cdec27e9941ed9b485228f93b4d60
I20250115 10:12:05.208868 4589 ts_tablet_manager.cc:1939] T ec6cdec27e9941ed9b485228f93b4d60 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.209098 4714 consensus_queue.cc:1035] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.209614 4557 tablet_bootstrap.cc:492] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.209667 4557 ts_tablet_manager.cc:1397] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20250115 10:12:05.209815 4569 tablet_bootstrap.cc:492] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.209836 4557 raft_consensus.cc:357] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.209877 4569 ts_tablet_manager.cc:1397] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
I20250115 10:12:05.209896 4557 raft_consensus.cc:383] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.209914 4557 raft_consensus.cc:738] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.209946 4557 consensus_queue.cc:260] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.210027 4557 ts_tablet_manager.cc:1428] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.210024 4569 raft_consensus.cc:357] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.210074 4569 raft_consensus.cc:383] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.210088 4557 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.210093 4569 raft_consensus.cc:738] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.210132 4569 consensus_queue.cc:260] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.210220 4569 ts_tablet_manager.cc:1428] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.210279 4569 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.210477 4557 tablet_bootstrap.cc:654] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.210686 4569 tablet_bootstrap.cc:654] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.211215 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet ec6cdec27e9941ed9b485228f93b4d60 (table default.Table_423c7ade2b48460a9a3f81ae55f94b86 [id=8baef913fb72470199c564e12b26622a]) successfully deleted
I20250115 10:12:05.212831 4473 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]). Expected version 3 got 0
I20250115 10:12:05.213418 4811 consensus_queue.cc:1035] T dc2b34be581f44028fed1514c78d1874 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.213709 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:05.213789 4575 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.213830 4575 ts_tablet_manager.cc:1397] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:05.213960 4575 raft_consensus.cc:357] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.214020 4575 raft_consensus.cc:383] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.214039 4575 raft_consensus.cc:738] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.214076 4575 consensus_queue.cc:260] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.214169 4575 ts_tablet_manager.cc:1428] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.214231 4575 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.214608 4575 tablet_bootstrap.cc:654] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.214823 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:05.215152 4587 consensus_queue.cc:1035] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.215245 4587 consensus_queue.cc:1035] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.215451 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:05.216493 4557 tablet_bootstrap.cc:492] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.216536 4557 ts_tablet_manager.cc:1397] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
W20250115 10:12:05.216670 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
W20250115 10:12:05.216708 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet dc2b34be581f44028fed1514c78d1874
I20250115 10:12:05.216675 4557 raft_consensus.cc:357] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.216732 4557 raft_consensus.cc:383] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.216765 4557 raft_consensus.cc:738] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.216792 4557 consensus_queue.cc:260] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.216849 4569 tablet_bootstrap.cc:492] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.216889 4569 ts_tablet_manager.cc:1397] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:05.216887 4557 ts_tablet_manager.cc:1428] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.216943 4557 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.217015 4569 raft_consensus.cc:357] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.217063 4569 raft_consensus.cc:383] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.217077 4569 raft_consensus.cc:738] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.217113 4569 consensus_queue.cc:260] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.217124 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:05.217196 4569 ts_tablet_manager.cc:1428] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.217273 4569 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.217375 4557 tablet_bootstrap.cc:654] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.217675 4569 tablet_bootstrap.cc:654] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.217897 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet dc7e96ba921d4fbb96afbbf8c5f354f2
W20250115 10:12:05.218461 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:05.218822 3257 tablet_service.cc:1467] Processing CreateTablet for tablet f8032bb1e5aa44e9a2b0e4602c36fe5c (DEFAULT_TABLE table=default.Table_4a944e0264fe4724960c3d592a927064 [id=fca9b49079d04d7ebc75ab20257e79a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.218847 3513 tablet_service.cc:1467] Processing CreateTablet for tablet f8032bb1e5aa44e9a2b0e4602c36fe5c (DEFAULT_TABLE table=default.Table_4a944e0264fe4724960c3d592a927064 [id=fca9b49079d04d7ebc75ab20257e79a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.218916 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8032bb1e5aa44e9a2b0e4602c36fe5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.218924 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8032bb1e5aa44e9a2b0e4602c36fe5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.220502 4335 raft_consensus.cc:491] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.220546 4335 raft_consensus.cc:513] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.220639 4335 leader_election.cc:290] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.220618 4699 consensus_queue.cc:1035] T 1385fb81dff24e709d5d45fb9d616369 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.221035 3215 consensus_peers.cc:487] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.221030 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "359eb3a976bd409b8e2d4b72f0b2348c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.221225 3215 leader_election.cc:343] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.221437 4575 tablet_bootstrap.cc:492] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.221479 4575 ts_tablet_manager.cc:1397] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
W20250115 10:12:05.221510 3350 consensus_peers.cc:487] T 77b422773c3346199383ca64330719c6 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.221611 4575 raft_consensus.cc:357] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.221668 4575 raft_consensus.cc:383] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.221688 4575 raft_consensus.cc:738] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.221726 4575 consensus_queue.cc:260] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.221832 4575 ts_tablet_manager.cc:1428] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.221889 4575 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.222136 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:05.222268 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "359eb3a976bd409b8e2d4b72f0b2348c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.222297 4575 tablet_bootstrap.cc:654] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.222322 3415 raft_consensus.cc:2463] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:05.222728 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:05.223297 4434 raft_consensus.cc:491] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.223344 4434 raft_consensus.cc:513] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.223445 4434 leader_election.cc:290] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.223769 4569 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.223837 4569 ts_tablet_manager.cc:1397] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:05.224015 4569 raft_consensus.cc:357] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.224085 4569 raft_consensus.cc:383] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.224110 4569 raft_consensus.cc:738] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.224148 4569 consensus_queue.cc:260] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.224248 4569 ts_tablet_manager.cc:1428] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.224234 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cee0b04c6e4eb39dd22668aacb2801" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.224309 4569 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.224399 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
W20250115 10:12:05.224511 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 77b422773c3346199383ca64330719c6
I20250115 10:12:05.224565 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_8166964273cd466883c47516ef68ef46 [id=988e12ca3c094601a1189d8558614dae]). Expected version 1 got 0
I20250115 10:12:05.224753 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cee0b04c6e4eb39dd22668aacb2801" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.224810 3280 raft_consensus.cc:2463] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.224824 4569 tablet_bootstrap.cc:654] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.225100 4557 tablet_bootstrap.cc:492] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.225127 3214 leader_election.cc:304] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.225147 4557 ts_tablet_manager.cc:1397] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:05.225256 5155 raft_consensus.cc:2798] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.225288 5155 raft_consensus.cc:491] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.225306 5155 raft_consensus.cc:3054] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.225343 4557 raft_consensus.cc:357] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.225412 4557 raft_consensus.cc:383] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.225430 4557 raft_consensus.cc:738] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.225458 4557 consensus_queue.cc:260] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.225564 4557 ts_tablet_manager.cc:1428] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.225629 4557 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.225689 4884 consensus_queue.cc:1035] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.225915 3485 leader_election.cc:304] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.226101 4884 raft_consensus.cc:2798] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.226089 5155 raft_consensus.cc:513] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.226152 4884 raft_consensus.cc:491] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.226169 4557 tablet_bootstrap.cc:654] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.226222 5155 leader_election.cc:290] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.226347 3484 leader_election.cc:343] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.226172 4884 raft_consensus.cc:3054] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.226624 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "359eb3a976bd409b8e2d4b72f0b2348c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.227327 4884 raft_consensus.cc:513] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.227437 4884 leader_election.cc:290] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.227418 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "359eb3a976bd409b8e2d4b72f0b2348c" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.227480 3415 raft_consensus.cc:3054] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.227635 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cee0b04c6e4eb39dd22668aacb2801" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.227974 3484 leader_election.cc:343] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.228106 4575 tablet_bootstrap.cc:492] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.228144 4575 ts_tablet_manager.cc:1397] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:05.228211 3415 raft_consensus.cc:2463] T 359eb3a976bd409b8e2d4b72f0b2348c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.228281 4575 raft_consensus.cc:357] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.228339 4575 raft_consensus.cc:383] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.228359 4575 raft_consensus.cc:738] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
W20250115 10:12:05.228358 3215 leader_election.cc:343] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.228389 4575 consensus_queue.cc:260] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.228474 3277 raft_consensus.cc:3054] T ce84190f55b14902ab678a98e622dc4f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.228557 3214 leader_election.cc:304] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.228628 4335 raft_consensus.cc:2798] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.228655 4335 raft_consensus.cc:695] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.228680 4877 raft_consensus.cc:491] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.228688 4335 consensus_queue.cc:237] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.228726 4877 raft_consensus.cc:513] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.228844 4877 leader_election.cc:290] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.229257 4569 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.229297 4569 ts_tablet_manager.cc:1397] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.229389 4575 ts_tablet_manager.cc:1428] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.229425 4569 raft_consensus.cc:357] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.229456 4575 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.229475 4569 raft_consensus.cc:383] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.229491 4569 raft_consensus.cc:738] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.229512 4569 consensus_queue.cc:260] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.229626 4569 ts_tablet_manager.cc:1428] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.229684 4569 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.229939 4575 tablet_bootstrap.cc:654] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.230134 4569 tablet_bootstrap.cc:654] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.230438 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.230500 3548 raft_consensus.cc:2463] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.230686 3350 leader_election.cc:304] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.230767 4877 raft_consensus.cc:2798] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.230809 4877 raft_consensus.cc:491] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.230834 4877 raft_consensus.cc:3054] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.231031 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.231096 3277 raft_consensus.cc:2463] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.231542 4877 raft_consensus.cc:513] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.231665 4877 leader_election.cc:290] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.231670 4338 raft_consensus.cc:491] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.231750 4714 consensus_queue.cc:1035] T ce84190f55b14902ab678a98e622dc4f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.231732 4338 raft_consensus.cc:513] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.231838 4714 consensus_queue.cc:1035] T 3c778d7be748405285068f36650902b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.231850 4338 leader_election.cc:290] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.231899 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4cee0b04c6e4eb39dd22668aacb2801" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.231950 3277 raft_consensus.cc:3054] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.232044 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.232175 3484 leader_election.cc:343] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.232535 3277 raft_consensus.cc:2463] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.232692 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d30f49da63241a2a794a7a18e026473 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.232771 4589 tablet_replica.cc:331] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.232834 4589 raft_consensus.cc:2238] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.232824 4473 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:05.232877 4589 raft_consensus.cc:2267] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.232941 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.233000 3550 raft_consensus.cc:3054] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.233601 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6435fd1953d440c8b4d9745a5dcd15f6" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.233680 3277 raft_consensus.cc:3054] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.233740 3550 raft_consensus.cc:2463] T 6435fd1953d440c8b4d9745a5dcd15f6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.234205 3277 raft_consensus.cc:2463] T 6435fd1953d440c8b4d9745a5dcd15f6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.234462 3350 leader_election.cc:304] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.234539 4877 raft_consensus.cc:2798] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.234594 4877 raft_consensus.cc:695] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.234638 4877 consensus_queue.cc:237] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.234691 4569 tablet_bootstrap.cc:492] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.234726 4569 ts_tablet_manager.cc:1397] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.234877 4569 raft_consensus.cc:357] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.234930 4569 raft_consensus.cc:383] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.234927 3485 leader_election.cc:304] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.234948 4569 raft_consensus.cc:738] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.234982 4569 consensus_queue.cc:260] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.235062 4569 ts_tablet_manager.cc:1428] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.235126 4569 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.235285 3279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.235350 3279 raft_consensus.cc:2463] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.235509 3279 raft_consensus.cc:3054] T 1e9c62a11d4744e199765f855fd0840b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.235569 4569 tablet_bootstrap.cc:654] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.236008 4433 raft_consensus.cc:2798] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.236052 4433 raft_consensus.cc:695] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.236088 4433 consensus_queue.cc:237] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.236768 4589 ts_tablet_manager.cc:1905] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.236893 4908 raft_consensus.cc:491] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.236910 3485 leader_election.cc:304] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.236936 4908 raft_consensus.cc:513] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.237031 4908 leader_election.cc:290] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.237336 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 8cbfcedc2f5447a1acb095066d131d52
I20250115 10:12:05.237396 4473 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:05.237438 4473 catalog_manager.cc:5526] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.238000 4557 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.238047 4557 ts_tablet_manager.cc:1397] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:05.238171 4557 raft_consensus.cc:357] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.238219 4557 raft_consensus.cc:383] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.238217 4589 ts_tablet_manager.cc:1918] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.238237 4557 raft_consensus.cc:738] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.238265 4589 log.cc:1198] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/2d30f49da63241a2a794a7a18e026473
I20250115 10:12:05.238278 4557 consensus_queue.cc:260] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.238386 4557 ts_tablet_manager.cc:1428] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.238425 4589 ts_tablet_manager.cc:1939] T 2d30f49da63241a2a794a7a18e026473 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.238442 4557 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.238842 4557 tablet_bootstrap.cc:654] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.239174 4338 raft_consensus.cc:2798] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250115 10:12:05.239193 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 86d086cd94664d40a653d64d06438bda
I20250115 10:12:05.239212 4338 raft_consensus.cc:491] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250115 10:12:05.239229 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet fd76846bc164480d9b77aa3d096260cb
I20250115 10:12:05.239233 4338 raft_consensus.cc:3054] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.239274 4472 catalog_manager.cc:5526] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.239356 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 359eb3a976bd409b8e2d4b72f0b2348c (table default.Table_697980ec22a34e649e8b5ee438986747 [id=83adf17cb14849c7839e7682093de0c9]). Expected version 1 got 0
I20250115 10:12:05.239390 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3c778d7be748405285068f36650902b0 (table default.Table_7253ee8c9b8345828dee96f057f1203d [id=366a8aed3a624725a160cd6a3d329b61]). Expected version 1 got 0
I20250115 10:12:05.239403 4811 consensus_queue.cc:1035] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.239945 4338 raft_consensus.cc:513] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.240041 4338 leader_election.cc:290] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.240475 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.240490 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.240787 3484 leader_election.cc:343] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.240896 3214 leader_election.cc:343] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.240955 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.241000 3550 raft_consensus.cc:2463] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.240952 4473 catalog_manager.cc:5526] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.241147 3215 leader_election.cc:304] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.241286 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 2d30f49da63241a2a794a7a18e026473 (table default.Table_2f418c5b15134aa58e94ad53b68ba2b2 [id=a5da5f258250489a9d39ce2b87fc1a86]) successfully deleted
I20250115 10:12:05.241387 4908 raft_consensus.cc:2798] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.241420 4908 raft_consensus.cc:491] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.241436 4908 raft_consensus.cc:3054] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.241497 4575 tablet_bootstrap.cc:492] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.241540 4575 ts_tablet_manager.cc:1397] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:05.241519 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.241575 3274 raft_consensus.cc:3054] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.241689 4575 raft_consensus.cc:357] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.241747 4575 raft_consensus.cc:383] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.241775 4575 raft_consensus.cc:738] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.241824 4575 consensus_queue.cc:260] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.241918 4575 ts_tablet_manager.cc:1428] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.241968 4575 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.242069 4908 raft_consensus.cc:513] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.242180 4908 leader_election.cc:290] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.242195 3274 raft_consensus.cc:2463] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.242343 4575 tablet_bootstrap.cc:654] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.242527 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_90ef46426add4005851c5eff0f43e3af [id=3078581f1b544badaeded5f2ab32f05e]). Expected version 2 got 0
I20250115 10:12:05.243299 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.243472 3214 leader_election.cc:343] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.243695 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.243790 3550 raft_consensus.cc:3054] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.243801 3485 leader_election.cc:304] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.244428 3550 raft_consensus.cc:2463] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.244482 4884 raft_consensus.cc:2798] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.244539 4884 raft_consensus.cc:695] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.244546 3215 leader_election.cc:304] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.244585 4884 consensus_queue.cc:237] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.244634 4908 raft_consensus.cc:2798] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.244665 4908 raft_consensus.cc:695] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.244696 4908 consensus_queue.cc:237] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.245612 4471 catalog_manager.cc:5526] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.245712 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:05.245693 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_925518f7db574e608d5da899a04ae2b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.245891 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_925518f7db574e608d5da899a04ae2b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.246312 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b4fe8306357b48248969d0b4b3ffc3bc" } modify_external_catalogs: true
I20250115 10:12:05.246387 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b4fe8306357b48248969d0b4b3ffc3bc" } modify_external_catalogs: true
I20250115 10:12:05.246322 4473 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_e19c4a50994246ffb3eb3137b793ed9a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.246466 4473 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19c4a50994246ffb3eb3137b793ed9a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.247215 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d373e83f428b4fa4adf3e4237e28160e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.247258 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_56128aebf9504aad94e009774f3b6bf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.247316 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56128aebf9504aad94e009774f3b6bf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.247349 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0d43a0379fa042929ffb70c09407e4f2" } new_table_name: "default.Table_f870f494fa11484abadb2004d22b73aa" modify_external_catalogs: true
W20250115 10:12:05.247495 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d373e83f428b4fa4adf3e4237e28160e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:05.248183 3484 consensus_peers.cc:487] T 368df29ba175447ba4c009c7eb15a49d P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.248275 4433 raft_consensus.cc:491] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.248302 4433 raft_consensus.cc:513] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.248370 4433 leader_election.cc:290] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.248564 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d9aaaa37d540cab41de4a083b36917" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.248767 3484 leader_election.cc:343] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.248818 4335 raft_consensus.cc:491] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.248865 4335 raft_consensus.cc:513] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.248947 4335 leader_election.cc:290] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.249301 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.249562 3214 leader_election.cc:343] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.249760 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d9aaaa37d540cab41de4a083b36917" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.249817 3280 raft_consensus.cc:2463] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.250087 3415 raft_consensus.cc:1270] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.250196 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.250241 3550 raft_consensus.cc:2463] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.250378 3215 leader_election.cc:304] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.250408 4433 consensus_queue.cc:1035] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.250444 4335 raft_consensus.cc:2798] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.250465 4335 raft_consensus.cc:491] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.250479 4335 raft_consensus.cc:3054] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.250731 3280 raft_consensus.cc:1270] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.251076 3485 leader_election.cc:304] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.251137 4335 raft_consensus.cc:513] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.251230 4335 leader_election.cc:290] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.251250 4887 raft_consensus.cc:2798] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.251293 4887 raft_consensus.cc:491] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.251322 4887 raft_consensus.cc:3054] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.251454 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.251780 3214 leader_election.cc:343] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.251961 4887 raft_consensus.cc:513] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.252084 4887 leader_election.cc:290] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.252121 4887 consensus_queue.cc:1035] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.252244 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.252281 3550 raft_consensus.cc:3054] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.252421 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 4d67f40aa99e48f0a61b11e530e2ffc8 (DEFAULT_TABLE table=default.Table_56128aebf9504aad94e009774f3b6bf3 [id=104cae3d990a411b9aa61710128d4169]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.252506 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d67f40aa99e48f0a61b11e530e2ffc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.252553 3517 tablet_service.cc:1467] Processing CreateTablet for tablet 8ff58ac697904d638365f106a62a9e92 (DEFAULT_TABLE table=default.Table_925518f7db574e608d5da899a04ae2b0 [id=071a871f94d14118898194d7becef33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.252645 3517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff58ac697904d638365f106a62a9e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.252660 3530 tablet_service.cc:1467] Processing CreateTablet for tablet c11553049aa6409281e5040ba9f7f685 (DEFAULT_TABLE table=default.Table_e19c4a50994246ffb3eb3137b793ed9a [id=00baaf176cab456f8d3b56ac22f07210]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.252722 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11553049aa6409281e5040ba9f7f685. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.252861 3550 raft_consensus.cc:2463] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.252949 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 76238bca73114e2d8284ac1c0c28fa64 (DEFAULT_TABLE table=default.Table_d373e83f428b4fa4adf3e4237e28160e [id=88cb2cb4ba244928b784ff1879e71cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.253032 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76238bca73114e2d8284ac1c0c28fa64. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.253708 3242 tablet_service.cc:1467] Processing CreateTablet for tablet c11553049aa6409281e5040ba9f7f685 (DEFAULT_TABLE table=default.Table_e19c4a50994246ffb3eb3137b793ed9a [id=00baaf176cab456f8d3b56ac22f07210]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.253809 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11553049aa6409281e5040ba9f7f685. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.254376 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 1e25918bfd2a485ca97e6f1c435c422e
I20250115 10:12:05.254691 3215 leader_election.cc:304] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.254774 4335 raft_consensus.cc:2798] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.254803 4335 raft_consensus.cc:695] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.254834 4335 consensus_queue.cc:237] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.254913 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 8ff58ac697904d638365f106a62a9e92 (DEFAULT_TABLE table=default.Table_925518f7db574e608d5da899a04ae2b0 [id=071a871f94d14118898194d7becef33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.254999 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff58ac697904d638365f106a62a9e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.255419 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet afe405846f924decb1786b338a306f62 (table default.Table_f870f494fa11484abadb2004d22b73aa [id=3094f0694b4b4f308b40e4ffe25cfbf4]). Expected version 1 got 0
I20250115 10:12:05.256245 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e25918bfd2a485ca97e6f1c435c422e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.256327 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d9aaaa37d540cab41de4a083b36917" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.256441 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 76238bca73114e2d8284ac1c0c28fa64 (DEFAULT_TABLE table=default.Table_d373e83f428b4fa4adf3e4237e28160e [id=88cb2cb4ba244928b784ff1879e71cea]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.256547 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76238bca73114e2d8284ac1c0c28fa64. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.256544 3484 leader_election.cc:343] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.256704 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 1e25918bfd2a485ca97e6f1c435c422e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e25918bfd2a485ca97e6f1c435c422e already in progress: creating tablet
I20250115 10:12:05.256724 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 4d67f40aa99e48f0a61b11e530e2ffc8 (DEFAULT_TABLE table=default.Table_56128aebf9504aad94e009774f3b6bf3 [id=104cae3d990a411b9aa61710128d4169]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.256814 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d67f40aa99e48f0a61b11e530e2ffc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.257751 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e25918bfd2a485ca97e6f1c435c422e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.257942 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 1e25918bfd2a485ca97e6f1c435c422e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e25918bfd2a485ca97e6f1c435c422e already in progress: creating tablet
I20250115 10:12:05.258183 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54d9aaaa37d540cab41de4a083b36917" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.258245 3276 raft_consensus.cc:3054] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.258303 4557 tablet_bootstrap.cc:492] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.258354 4557 ts_tablet_manager.cc:1397] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20250115 10:12:05.258553 4557 raft_consensus.cc:357] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.258548 4472 catalog_manager.cc:5526] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.258615 4557 raft_consensus.cc:383] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.258648 4557 raft_consensus.cc:738] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.258690 4557 consensus_queue.cc:260] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.258793 4557 ts_tablet_manager.cc:1428] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.258817 3276 raft_consensus.cc:2463] T 54d9aaaa37d540cab41de4a083b36917 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.258863 4557 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.259286 4557 tablet_bootstrap.cc:654] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.259557 4575 tablet_bootstrap.cc:492] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.259600 4575 ts_tablet_manager.cc:1397] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250115 10:12:05.259865 4569 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.259905 4569 ts_tablet_manager.cc:1397] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20250115 10:12:05.260049 4569 raft_consensus.cc:357] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.260102 4569 raft_consensus.cc:383] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.260123 4569 raft_consensus.cc:738] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.260154 4569 consensus_queue.cc:260] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.260257 4569 ts_tablet_manager.cc:1428] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.260327 4569 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.260730 4569 tablet_bootstrap.cc:654] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.261337 4890 tablet.cc:1721] T afe405846f924decb1786b338a306f62 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.261440 4714 consensus_queue.cc:1035] T bb4d112daca24c82931daf050edbd846 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.261524 4908 raft_consensus.cc:491] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.261567 4908 raft_consensus.cc:513] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.261655 4908 leader_election.cc:290] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.262223 4575 raft_consensus.cc:357] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.262286 4575 raft_consensus.cc:383] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.262303 4575 raft_consensus.cc:738] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.262332 4575 consensus_queue.cc:260] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.262427 4575 ts_tablet_manager.cc:1428] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:05.262436 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.262492 4575 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.262948 4575 tablet_bootstrap.cc:654] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.263368 3214 leader_election.cc:343] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.264794 4575 tablet_bootstrap.cc:492] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.264837 4575 ts_tablet_manager.cc:1397] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.264950 4575 raft_consensus.cc:357] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.265017 4575 raft_consensus.cc:383] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.265038 4575 raft_consensus.cc:738] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.265074 4575 consensus_queue.cc:260] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.265092 4908 raft_consensus.cc:491] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.265128 4908 raft_consensus.cc:513] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.265193 4575 ts_tablet_manager.cc:1428] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.265221 4908 leader_election.cc:290] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.265249 4575 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.265650 4575 tablet_bootstrap.cc:654] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.266234 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.266573 3214 leader_election.cc:343] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.266772 4875 raft_consensus.cc:491] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.266815 4875 raft_consensus.cc:513] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.266899 3215 consensus_peers.cc:487] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.266916 4875 leader_election.cc:290] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.266917 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet b7a6ec9020494019a32cfb428554bd07
I20250115 10:12:05.266971 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet afe405846f924decb1786b338a306f62 (table default.Table_f870f494fa11484abadb2004d22b73aa [id=3094f0694b4b4f308b40e4ffe25cfbf4]). Expected version 1 got 0
I20250115 10:12:05.267025 4468 catalog_manager.cc:5526] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.259402 3485 leader_election.cc:304] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.267205 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.267268 3544 raft_consensus.cc:2463] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.260805 4873 tablet.cc:1721] T afe405846f924decb1786b338a306f62 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.261979 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.267544 3548 raft_consensus.cc:2463] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.267642 3350 leader_election.cc:304] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.267882 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_f870f494fa11484abadb2004d22b73aa [id=3094f0694b4b4f308b40e4ffe25cfbf4] alter complete (version 1)
I20250115 10:12:05.266497 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.268680 4557 tablet_bootstrap.cc:492] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.268715 4557 ts_tablet_manager.cc:1397] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.268788 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.268851 3278 raft_consensus.cc:2463] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.268836 4557 raft_consensus.cc:357] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.268886 4557 raft_consensus.cc:383] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.268908 4557 raft_consensus.cc:738] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.268937 4557 consensus_queue.cc:260] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.269052 4557 ts_tablet_manager.cc:1428] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.269126 4557 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.269284 4569 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.269320 4569 ts_tablet_manager.cc:1397] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:05.269449 4569 raft_consensus.cc:357] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.269508 4569 raft_consensus.cc:383] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.269529 4569 raft_consensus.cc:738] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.269542 4557 tablet_bootstrap.cc:654] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.269577 4569 consensus_queue.cc:260] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.269681 4569 ts_tablet_manager.cc:1428] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.269744 4569 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.269821 4338 raft_consensus.cc:2798] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.269865 4338 raft_consensus.cc:695] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.269881 3215 leader_election.cc:304] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.269899 4338 consensus_queue.cc:237] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.269964 3215 leader_election.cc:343] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.269989 3215 leader_election.cc:304] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.270051 4335 raft_consensus.cc:2798] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.270087 4335 raft_consensus.cc:491] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.270108 4335 raft_consensus.cc:3054] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.270138 4569 tablet_bootstrap.cc:654] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.270429 4908 raft_consensus.cc:2743] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.270551 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_0fec3b49433249318af0865469074d91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.270671 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0fec3b49433249318af0865469074d91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.270771 4335 raft_consensus.cc:513] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.270870 4335 leader_election.cc:290] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.271087 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.271216 3214 leader_election.cc:343] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.271255 4434 raft_consensus.cc:491] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.271298 4434 raft_consensus.cc:513] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.271374 4434 leader_election.cc:290] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:05.271456 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:05.271502 4474 catalog_manager.cc:5526] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.271549 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.271675 3484 leader_election.cc:343] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.271940 4875 raft_consensus.cc:2798] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.271998 4875 raft_consensus.cc:491] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.272032 4875 raft_consensus.cc:3054] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.272483 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 14cea13b41bd47faafe774471c4163dc
I20250115 10:12:05.272768 4875 raft_consensus.cc:513] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.272913 4875 leader_election.cc:290] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.273085 4557 tablet_bootstrap.cc:492] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.273118 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8967b15f8b6a4587bd56a2dfd68b9fe9" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.273181 3548 raft_consensus.cc:3054] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.273748 4569 tablet_bootstrap.cc:492] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.273801 4569 ts_tablet_manager.cc:1397] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:05.273891 3548 raft_consensus.cc:2463] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.273933 4569 raft_consensus.cc:357] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.273999 4569 raft_consensus.cc:383] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.274015 4569 raft_consensus.cc:738] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.274017 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.274052 4569 consensus_queue.cc:260] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.274073 3547 raft_consensus.cc:3054] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.274147 4569 ts_tablet_manager.cc:1428] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.274206 4569 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.274246 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c49b39058164387990c4f6dc170785e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.274318 3280 raft_consensus.cc:3054] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.274550 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 2ba4b779b29841f69fe72527763ab7a1
I20250115 10:12:05.274688 4569 tablet_bootstrap.cc:654] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.274722 3547 raft_consensus.cc:2463] T 4c49b39058164387990c4f6dc170785e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.274875 3350 leader_election.cc:304] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.274961 4587 raft_consensus.cc:2798] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.275017 4587 raft_consensus.cc:695] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.275013 3280 raft_consensus.cc:2463] T 4c49b39058164387990c4f6dc170785e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.275058 4587 consensus_queue.cc:237] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.273128 4557 ts_tablet_manager.cc:1397] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:05.275560 4908 consensus_queue.cc:1035] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.275660 4557 raft_consensus.cc:357] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.275727 4557 raft_consensus.cc:383] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.275748 4557 raft_consensus.cc:738] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.276049 4557 consensus_queue.cc:260] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.276191 4557 ts_tablet_manager.cc:1428] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.276262 4557 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.276376 3215 leader_election.cc:304] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.276669 4557 tablet_bootstrap.cc:654] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.276705 4731 raft_consensus.cc:2798] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.276768 4731 raft_consensus.cc:695] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.276815 4731 consensus_queue.cc:237] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.278117 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 9b83fa6920a344e39287a99d9865b56c (DEFAULT_TABLE table=default.Table_0fec3b49433249318af0865469074d91 [id=750c706d3ece4570a500339d3bab6196]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.278218 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b83fa6920a344e39287a99d9865b56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.278324 4472 catalog_manager.cc:5526] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.278692 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 9b83fa6920a344e39287a99d9865b56c (DEFAULT_TABLE table=default.Table_0fec3b49433249318af0865469074d91 [id=750c706d3ece4570a500339d3bab6196]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.278815 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b83fa6920a344e39287a99d9865b56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.279443 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3263c7a4d1b5448ba6c67d8c88c917f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.279557 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3263c7a4d1b5448ba6c67d8c88c917f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.280175 4875 consensus_queue.cc:1035] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.280608 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.280666 3278 raft_consensus.cc:2463] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.280812 4338 raft_consensus.cc:491] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.280858 4338 raft_consensus.cc:513] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.280931 4338 leader_election.cc:290] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.280982 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:05.281095 4908 raft_consensus.cc:491] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.281129 4908 raft_consensus.cc:513] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.281206 4908 leader_election.cc:290] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.281149 4471 catalog_manager.cc:5526] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.281491 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6de4d57d53c648b491f66f257414394d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.281549 3411 raft_consensus.cc:2463] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.281664 3484 leader_election.cc:304] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.281730 4887 raft_consensus.cc:2798] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.281767 4887 raft_consensus.cc:491] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.281785 4887 raft_consensus.cc:3054] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.281862 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.281919 3547 raft_consensus.cc:2463] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.282107 3485 leader_election.cc:304] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.282322 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6de4d57d53c648b491f66f257414394d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.282373 3278 raft_consensus.cc:2463] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.282341 4887 raft_consensus.cc:513] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.282472 4887 leader_election.cc:290] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.282511 4887 raft_consensus.cc:2798] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.282533 4887 raft_consensus.cc:491] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.282550 4887 raft_consensus.cc:3054] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.283180 4731 raft_consensus.cc:491] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.283197 4887 raft_consensus.cc:513] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.283226 4731 raft_consensus.cc:513] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.283284 4887 leader_election.cc:290] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.283318 4731 leader_election.cc:290] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.283396 4662 tablet.cc:1721] T afe405846f924decb1786b338a306f62 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.283504 3215 leader_election.cc:304] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.283619 4908 raft_consensus.cc:2798] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.283669 4908 raft_consensus.cc:491] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.283689 4908 raft_consensus.cc:3054] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.284132 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.284269 3214 leader_election.cc:343] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.284386 4908 raft_consensus.cc:513] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.284487 4908 leader_election.cc:290] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.284587 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6de4d57d53c648b491f66f257414394d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.284632 3411 raft_consensus.cc:3054] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.284651 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b83ca446824b88978e3dc3269d43a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.284703 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.285141 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet b3e3be71c4324a5589a397ae76198f27 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.285328 3411 raft_consensus.cc:2463] T 6de4d57d53c648b491f66f257414394d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:12:05.285588 3484 leader_election.cc:343] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.285624 3214 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.285657 3484 leader_election.cc:304] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.285722 4434 raft_consensus.cc:2798] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.285754 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.285785 4434 raft_consensus.cc:695] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.285806 3546 raft_consensus.cc:3054] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.285825 4434 consensus_queue.cc:237] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.286427 3546 raft_consensus.cc:2463] T 5fac40fff8de4004858af6e2ae986d46 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.286602 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b83ca446824b88978e3dc3269d43a3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.286710 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fac40fff8de4004858af6e2ae986d46" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.286785 3215 leader_election.cc:304] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.286850 3215 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.286891 3215 leader_election.cc:304] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.287068 4731 raft_consensus.cc:2798] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.287109 4731 raft_consensus.cc:695] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.287110 4884 raft_consensus.cc:491] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.287154 4731 consensus_queue.cc:237] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.287156 4884 raft_consensus.cc:513] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.287253 4884 leader_election.cc:290] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.287281 4908 raft_consensus.cc:2743] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.286851 3214 leader_election.cc:343] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.287545 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9305b7ac82cd4393b28017831a0687ff" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.287621 3278 raft_consensus.cc:3054] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.288129 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet b3e3be71c4324a5589a397ae76198f27
I20250115 10:12:05.288208 4472 catalog_manager.cc:6596] ReplaceTablet: tablet b3e3be71c4324a5589a397ae76198f27 deleted and replaced by tablet b0311a54e0644e3787c44106cd41fc4e
I20250115 10:12:05.288260 3278 raft_consensus.cc:2463] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.288516 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6de4d57d53c648b491f66f257414394d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.288566 3280 raft_consensus.cc:3054] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.288604 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:05.288940 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet b3e3be71c4324a5589a397ae76198f27 with delete_type TABLET_DATA_DELETED (replaced by tablet b0311a54e0644e3787c44106cd41fc4e) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.289021 4551 tablet_replica.cc:331] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.289070 4551 raft_consensus.cc:2238] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.289121 4551 raft_consensus.cc:2267] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.289264 3280 raft_consensus.cc:2463] T 6de4d57d53c648b491f66f257414394d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.289299 4551 ts_tablet_manager.cc:1905] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.289928 4569 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.289966 4569 ts_tablet_manager.cc:1397] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.000s
I20250115 10:12:05.290105 4569 raft_consensus.cc:357] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.290148 4569 raft_consensus.cc:383] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.290163 4569 raft_consensus.cc:738] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.290195 4569 consensus_queue.cc:260] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.290274 4569 ts_tablet_manager.cc:1428] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.290323 4569 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.290661 4551 ts_tablet_manager.cc:1918] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.290705 4551 log.cc:1198] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/b3e3be71c4324a5589a397ae76198f27
I20250115 10:12:05.290730 4569 tablet_bootstrap.cc:654] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.290913 4551 ts_tablet_manager.cc:1939] T b3e3be71c4324a5589a397ae76198f27 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.291105 4875 raft_consensus.cc:491] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.291150 4875 raft_consensus.cc:513] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.291208 4557 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.291225 4875 leader_election.cc:290] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.291246 4557 ts_tablet_manager.cc:1397] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250115 10:12:05.291347 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14cea13b41bd47faafe774471c4163dc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.291390 3411 raft_consensus.cc:2463] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.291384 4557 raft_consensus.cc:357] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.291445 4557 raft_consensus.cc:383] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.291467 4557 raft_consensus.cc:738] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.291494 3484 leader_election.cc:304] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.291559 4884 raft_consensus.cc:2798] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.291579 4884 raft_consensus.cc:491] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.291594 4884 raft_consensus.cc:3054] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.292011 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 6de4d57d53c648b491f66f257414394d
I20250115 10:12:05.292135 4884 raft_consensus.cc:513] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.292222 4884 leader_election.cc:290] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.291496 4557 consensus_queue.cc:260] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.292362 4557 ts_tablet_manager.cc:1428] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.292431 4557 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.292451 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 3404f05c497e4236a7a9f3e6b5257dd0 (DEFAULT_TABLE table=default.Table_3263c7a4d1b5448ba6c67d8c88c917f0 [id=28abc9fa55b0431e8d0fae3a6d7e6727]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.292539 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3404f05c497e4236a7a9f3e6b5257dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.292917 4557 tablet_bootstrap.cc:654] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.292953 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 0922008e726c4e53b00b287261a2f0a3 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.293212 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e55b7e2b95b4eb895da942829c4556f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.293270 3280 raft_consensus.cc:2463] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.293314 4335 raft_consensus.cc:491] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.293344 4335 raft_consensus.cc:513] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.293434 4335 leader_election.cc:290] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.293853 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e55b7e2b95b4eb895da942829c4556f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.293855 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.293920 3547 raft_consensus.cc:2463] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.294081 3350 leader_election.cc:304] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.294086 3214 leader_election.cc:343] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.294189 4714 raft_consensus.cc:2798] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.294222 4714 raft_consensus.cc:491] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.294242 4714 raft_consensus.cc:3054] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.294344 4335 raft_consensus.cc:491] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.294384 4335 raft_consensus.cc:513] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.294469 4335 leader_election.cc:290] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.294878 4714 raft_consensus.cc:513] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.294966 4714 leader_election.cc:290] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.294998 4714 consensus_queue.cc:1035] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.295264 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e55b7e2b95b4eb895da942829c4556f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.295292 3514 tablet_service.cc:1467] Processing CreateTablet for tablet b0311a54e0644e3787c44106cd41fc4e (DEFAULT_TABLE table=default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.295339 3280 raft_consensus.cc:3054] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.295403 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0311a54e0644e3787c44106cd41fc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.295985 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0922008e726c4e53b00b287261a2f0a3
I20250115 10:12:05.296092 4472 catalog_manager.cc:6596] ReplaceTablet: tablet 0922008e726c4e53b00b287261a2f0a3 deleted and replaced by tablet 452dcc3f39f144d5abad603eb586f2a3
I20250115 10:12:05.296089 3280 raft_consensus.cc:2463] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.296343 3350 leader_election.cc:304] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.296394 3242 tablet_service.cc:1514] Processing DeleteTablet for tablet 0922008e726c4e53b00b287261a2f0a3 with delete_type TABLET_DATA_DELETED (replaced by tablet 452dcc3f39f144d5abad603eb586f2a3) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.296466 4589 tablet_replica.cc:331] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.296520 4589 raft_consensus.cc:2238] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.296572 4589 pending_rounds.cc:62] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:05.296607 4589 pending_rounds.cc:69] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489549571018752 op_type: NO_OP noop_request { }
I20250115 10:12:05.296643 4589 raft_consensus.cc:2883] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:05.296663 4589 raft_consensus.cc:2267] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.296708 4587 raft_consensus.cc:2798] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.296751 4587 raft_consensus.cc:695] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.296794 4587 consensus_queue.cc:237] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.296808 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 0922008e726c4e53b00b287261a2f0a3 with delete_type TABLET_DATA_DELETED (replaced by tablet 452dcc3f39f144d5abad603eb586f2a3) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.296957 4589 ts_tablet_manager.cc:1905] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.297564 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.297650 3549 raft_consensus.cc:2463] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.297719 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.297886 3215 leader_election.cc:304] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.297952 4731 raft_consensus.cc:2798] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250115 10:12:05.297969 3215 leader_election.cc:343] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.297981 4731 raft_consensus.cc:491] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.298015 4731 raft_consensus.cc:3054] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.297994 3215 leader_election.cc:304] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.298173 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.298297 4589 ts_tablet_manager.cc:1918] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.298264 4335 raft_consensus.cc:2743] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.298404 3214 leader_election.cc:343] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.298341 4589 log.cc:1198] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/0922008e726c4e53b00b287261a2f0a3
I20250115 10:12:05.298593 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e55b7e2b95b4eb895da942829c4556f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.298650 3547 raft_consensus.cc:3054] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.298727 4589 ts_tablet_manager.cc:1939] T 0922008e726c4e53b00b287261a2f0a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.299229 3547 raft_consensus.cc:2463] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.299543 4731 raft_consensus.cc:513] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.299685 4731 leader_election.cc:290] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.299974 4884 raft_consensus.cc:491] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.300031 4884 raft_consensus.cc:513] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.300107 4884 leader_election.cc:290] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.300280 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc7e96ba921d4fbb96afbbf8c5f354f2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.300298 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.300346 3415 raft_consensus.cc:2463] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.300338 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 3404f05c497e4236a7a9f3e6b5257dd0 (DEFAULT_TABLE table=default.Table_3263c7a4d1b5448ba6c67d8c88c917f0 [id=28abc9fa55b0431e8d0fae3a6d7e6727]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.300436 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3404f05c497e4236a7a9f3e6b5257dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.300535 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 0922008e726c4e53b00b287261a2f0a3 (table default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]) successfully deleted
I20250115 10:12:05.300688 4557 tablet_bootstrap.cc:492] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.300729 4557 ts_tablet_manager.cc:1397] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:05.300774 4471 catalog_manager.cc:5526] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.300886 4557 raft_consensus.cc:357] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.300940 4557 raft_consensus.cc:383] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.300956 4557 raft_consensus.cc:738] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.300997 4557 consensus_queue.cc:260] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.301095 4557 ts_tablet_manager.cc:1428] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.301170 4557 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.301169 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet ec6cdec27e9941ed9b485228f93b4d60 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.301443 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet b3e3be71c4324a5589a397ae76198f27 with delete_type TABLET_DATA_DELETED (replaced by tablet b0311a54e0644e3787c44106cd41fc4e) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.301533 4557 tablet_bootstrap.cc:654] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.301631 4474 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_cc03dd32d9d440339095b8814765158f" } modify_external_catalogs: true
I20250115 10:12:05.301694 4434 raft_consensus.cc:491] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.301710 4474 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_cc03dd32d9d440339095b8814765158f" } modify_external_catalogs: true
I20250115 10:12:05.301733 4434 raft_consensus.cc:513] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.301808 4434 leader_election.cc:290] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.301941 4468 catalog_manager.cc:5526] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.302357 3257 tablet_service.cc:1467] Processing CreateTablet for tablet b0311a54e0644e3787c44106cd41fc4e (DEFAULT_TABLE table=default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.302445 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0311a54e0644e3787c44106cd41fc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.302726 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c843e37ab0074c94b251c4efe16ea916" } modify_external_catalogs: true
I20250115 10:12:05.302786 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c843e37ab0074c94b251c4efe16ea916" } modify_external_catalogs: true
I20250115 10:12:05.302829 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.302839 3484 leader_election.cc:304] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.302919 3214 leader_election.cc:343] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.302976 4884 raft_consensus.cc:2798] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.303014 4884 raft_consensus.cc:491] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.303035 4884 raft_consensus.cc:3054] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.303602 4569 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.303639 4569 ts_tablet_manager.cc:1397] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.000s
I20250115 10:12:05.303643 4884 raft_consensus.cc:513] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.303772 4473 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:05.303781 4884 leader_election.cc:290] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.303815 4569 raft_consensus.cc:357] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.303879 4569 raft_consensus.cc:383] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.303900 4569 raft_consensus.cc:738] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.303903 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14cea13b41bd47faafe774471c4163dc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.303946 4569 consensus_queue.cc:260] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.303977 3411 raft_consensus.cc:3054] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.304070 4569 ts_tablet_manager.cc:1428] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.304136 4569 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.304167 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f9afec8418444e6a9efd2a70f734c330" } modify_external_catalogs: true
I20250115 10:12:05.304212 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f9afec8418444e6a9efd2a70f734c330" } modify_external_catalogs: true
I20250115 10:12:05.304517 4569 tablet_bootstrap.cc:654] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.304698 3411 raft_consensus.cc:2463] T 14cea13b41bd47faafe774471c4163dc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.304744 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 689207c595a4465fac76333b8ecb0a11
I20250115 10:12:05.304769 4587 consensus_queue.cc:1035] T 6d9a83c4de3849498be5c6e4f9c8b00c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.305028 3484 leader_election.cc:304] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.305253 4908 raft_consensus.cc:491] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.305312 4908 raft_consensus.cc:513] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.305439 4908 leader_election.cc:290] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.305765 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet c5ab0fbfde14427ebb1714840c08ff6f
I20250115 10:12:05.305881 4884 raft_consensus.cc:2798] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.305887 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.306011 3544 raft_consensus.cc:2463] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.306183 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.306237 3547 raft_consensus.cc:3054] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.306265 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet b3e3be71c4324a5589a397ae76198f27 (table default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]) successfully deleted
I20250115 10:12:05.306277 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c26d7b0a2c464ea4bd7fe81719d44b19" } modify_external_catalogs: true
W20250115 10:12:05.306332 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 0922008e726c4e53b00b287261a2f0a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0922008e726c4e53b00b287261a2f0a3 already in progress: creating tablet
I20250115 10:12:05.306342 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c26d7b0a2c464ea4bd7fe81719d44b19" } modify_external_catalogs: true
I20250115 10:12:05.306515 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet c5ab0fbfde14427ebb1714840c08ff6f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.306720 4731 raft_consensus.cc:491] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.306766 4731 raft_consensus.cc:513] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.306861 4731 leader_election.cc:290] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.306860 3547 raft_consensus.cc:2463] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.306876 3215 leader_election.cc:304] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.306916 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet c5ab0fbfde14427ebb1714840c08ff6f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.306955 4731 raft_consensus.cc:2798] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.306982 4731 raft_consensus.cc:491] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.307017 4731 raft_consensus.cc:3054] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.307035 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 96625c3a7d59404ca73a29454063b07e
I20250115 10:12:05.305943 4884 raft_consensus.cc:695] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.307268 4884 consensus_queue.cc:237] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.307562 4731 raft_consensus.cc:513] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.307641 4731 leader_election.cc:290] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.307834 3214 leader_election.cc:343] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:05.307972 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.308029 3415 raft_consensus.cc:3054] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.308470 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc7e96ba921d4fbb96afbbf8c5f354f2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.308518 3411 raft_consensus.cc:3054] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.308645 3415 raft_consensus.cc:2463] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.308856 4731 raft_consensus.cc:491] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.308902 4731 raft_consensus.cc:513] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.309167 4731 leader_election.cc:290] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.309177 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.309247 3414 raft_consensus.cc:2371] T cb9629071de44cf69621ae3b2fd4e762 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1. Re-sending same reply.
I20250115 10:12:05.309265 3214 leader_election.cc:304] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.309394 3485 leader_election.cc:304] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.309485 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14cea13b41bd47faafe774471c4163dc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.309551 3275 raft_consensus.cc:2463] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.309698 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14cea13b41bd47faafe774471c4163dc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.309765 3215 leader_election.cc:304] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.309767 3276 raft_consensus.cc:3054] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.309965 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet c5ab0fbfde14427ebb1714840c08ff6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5ab0fbfde14427ebb1714840c08ff6f already in progress: creating tablet
I20250115 10:12:05.310232 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb9629071de44cf69621ae3b2fd4e762" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.310254 4884 raft_consensus.cc:2798] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.310281 3544 raft_consensus.cc:3054] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.310297 4884 raft_consensus.cc:695] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.310333 4884 consensus_queue.cc:237] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.310457 3276 raft_consensus.cc:2463] T 14cea13b41bd47faafe774471c4163dc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.310529 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.310585 3545 raft_consensus.cc:2463] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.310747 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 96625c3a7d59404ca73a29454063b07e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.310828 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca2e043501b04096b648d179a13e8653" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.310891 3544 raft_consensus.cc:2463] T cb9629071de44cf69621ae3b2fd4e762 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.310891 4908 raft_consensus.cc:2798] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.310920 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 96625c3a7d59404ca73a29454063b07e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.310935 4908 raft_consensus.cc:695] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.310968 4908 consensus_queue.cc:237] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.311136 4908 raft_consensus.cc:2798] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.311167 4908 raft_consensus.cc:695] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.311192 4908 consensus_queue.cc:237] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.311610 3215 leader_election.cc:343] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f0ae1ff74cce48ada0a373f9e65508a2
I20250115 10:12:05.311655 3215 leader_election.cc:304] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:05.311770 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:05.311851 3770 raft_consensus.cc:2743] T f0ae1ff74cce48ada0a373f9e65508a2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.312068 4589 tablet_replica.cc:331] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.312139 4589 raft_consensus.cc:2238] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.312173 4589 raft_consensus.cc:2267] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.312222 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 14f3aea0cf684f749027f817eb3b13b7
I20250115 10:12:05.310895 3274 raft_consensus.cc:2388] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:05.312428 3215 leader_election.cc:304] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.312431 4589 ts_tablet_manager.cc:1905] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.312850 4575 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
W20250115 10:12:05.312870 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 6d9a83c4de3849498be5c6e4f9c8b00c
I20250115 10:12:05.312889 4575 ts_tablet_manager.cc:1397] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.000s
W20250115 10:12:05.312920 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet cb353ea066dc474cac07e3adcfa6574d
W20250115 10:12:05.312939 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 6e56c83017b54e65a066e8e377293b13
I20250115 10:12:05.312999 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f3aea0cf684f749027f817eb3b13b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.313050 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet f8114f64577245c2b3ce70e4399de0c8 (table default.Table_6f44b54d97af46758931ddbc30f2ec77 [id=88bd1e99f90a4528b2d7c4e6a81f6173]). Expected version 2 got 0
I20250115 10:12:05.313078 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:05.313145 4731 raft_consensus.cc:2798] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.313174 4731 raft_consensus.cc:491] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.313189 4731 raft_consensus.cc:3054] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.313143 4575 raft_consensus.cc:357] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.313211 4575 raft_consensus.cc:383] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.313234 4575 raft_consensus.cc:738] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.313277 4575 consensus_queue.cc:260] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.313370 4575 ts_tablet_manager.cc:1428] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.313426 4575 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.313716 4731 raft_consensus.cc:513] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.313746 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 14cea13b41bd47faafe774471c4163dc
I20250115 10:12:05.313805 4731 leader_election.cc:290] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.313829 4575 tablet_bootstrap.cc:654] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.313880 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 452dcc3f39f144d5abad603eb586f2a3 (DEFAULT_TABLE table=default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.313889 4589 ts_tablet_manager.cc:1918] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.313932 4589 log.cc:1198] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/b3e3be71c4324a5589a397ae76198f27
I20250115 10:12:05.309194 3411 raft_consensus.cc:2463] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.313994 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dcc3f39f144d5abad603eb586f2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.314124 4589 ts_tablet_manager.cc:1939] T b3e3be71c4324a5589a397ae76198f27 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.314435 3242 tablet_service.cc:1467] Processing CreateTablet for tablet 452dcc3f39f144d5abad603eb586f2a3 (DEFAULT_TABLE table=default.Table_ee7563357e9e4b3e9c38fa32c25a5aa7 [id=a8cd252d637540ba80c51f08bf2486f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.314515 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452dcc3f39f144d5abad603eb586f2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.314828 4875 raft_consensus.cc:491] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.314872 4875 raft_consensus.cc:513] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.314985 4875 leader_election.cc:290] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.315433 3350 leader_election.cc:343] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8c045349a48644eda41ea8965b16174d
I20250115 10:12:05.315690 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f3aea0cf684f749027f817eb3b13b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.315956 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.316040 4587 raft_consensus.cc:491] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.316089 4551 tablet_replica.cc:331] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.316090 4587 raft_consensus.cc:513] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.316170 4551 raft_consensus.cc:2238] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.316187 4587 leader_election.cc:290] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.316183 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.316241 3544 raft_consensus.cc:3054] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.316273 3484 leader_election.cc:304] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.316565 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.316689 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet d73af05d7fd349b083eb74352a62a1fe from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.316792 4434 raft_consensus.cc:2798] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.316823 3544 raft_consensus.cc:2463] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.316829 4434 raft_consensus.cc:695] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.316893 4434 consensus_queue.cc:237] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.317030 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 689207c595a4465fac76333b8ecb0a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.317098 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 96625c3a7d59404ca73a29454063b07e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96625c3a7d59404ca73a29454063b07e already in progress: creating tablet
I20250115 10:12:05.316244 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c045349a48644eda41ea8965b16174d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.310537 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 689207c595a4465fac76333b8ecb0a11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.317209 4472 catalog_manager.cc:5526] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.317317 4472 catalog_manager.cc:5526] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.317368 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_01cee5e7893944e280e7f3faa9b07f1c [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 2 got 0
I20250115 10:12:05.317507 3215 leader_election.cc:304] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.317582 4731 raft_consensus.cc:2798] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.317620 4731 raft_consensus.cc:695] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.317662 4731 consensus_queue.cc:237] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.317768 3350 leader_election.cc:343] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.317807 3350 leader_election.cc:304] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.317896 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet b3e3be71c4324a5589a397ae76198f27 (table default.Table_c5392bdd434949c4bda797e323e1adb1 [id=da2854c8a2844dd684be2366842fa501]) successfully deleted
W20250115 10:12:05.317950 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet c5ab0fbfde14427ebb1714840c08ff6f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5ab0fbfde14427ebb1714840c08ff6f already in progress: creating tablet
W20250115 10:12:05.317951 3214 leader_election.cc:343] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.318006 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 96625c3a7d59404ca73a29454063b07e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96625c3a7d59404ca73a29454063b07e already in progress: creating tablet
I20250115 10:12:05.316208 4551 raft_consensus.cc:2267] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:05.318039 3214 leader_election.cc:343] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.318086 4875 raft_consensus.cc:2743] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.318240 3485 leader_election.cc:343] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: dc7e96ba921d4fbb96afbbf8c5f354f2
W20250115 10:12:05.318300 3350 leader_election.cc:343] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: ec6cdec27e9941ed9b485228f93b4d60
W20250115 10:12:05.318324 3485 leader_election.cc:343] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:05.318410 3485 leader_election.cc:304] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.318459 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]). Expected version 1 got 0
I20250115 10:12:05.318572 4731 consensus_queue.cc:1035] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.318603 3350 leader_election.cc:343] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: ec6cdec27e9941ed9b485228f93b4d60
I20250115 10:12:05.318639 3350 leader_election.cc:304] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.318822 4434 raft_consensus.cc:3054] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.318958 4475 catalog_manager.cc:5526] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.319046 4475 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_90ef46426add4005851c5eff0f43e3af [id=3078581f1b544badaeded5f2ab32f05e]). Expected version 2 got 0
I20250115 10:12:05.319154 3770 consensus_queue.cc:1035] T 0496864e655e40dfac38619adbf4fd87 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.319463 4434 raft_consensus.cc:2743] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.319566 4875 raft_consensus.cc:2743] T ec6cdec27e9941ed9b485228f93b4d60 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.319934 4551 ts_tablet_manager.cc:1905] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.320237 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d73af05d7fd349b083eb74352a62a1fe
I20250115 10:12:05.320308 4468 catalog_manager.cc:6596] ReplaceTablet: tablet d73af05d7fd349b083eb74352a62a1fe deleted and replaced by tablet edc54579f85a4b24b022fc96c2cfb443
I20250115 10:12:05.321022 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:05.321173 4551 ts_tablet_manager.cc:1918] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.321213 4551 log.cc:1198] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/14f3aea0cf684f749027f817eb3b13b7
I20250115 10:12:05.321352 4551 ts_tablet_manager.cc:1939] T 14f3aea0cf684f749027f817eb3b13b7 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.322036 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet d73af05d7fd349b083eb74352a62a1fe with delete_type TABLET_DATA_DELETED (replaced by tablet edc54579f85a4b24b022fc96c2cfb443) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.322113 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet d73af05d7fd349b083eb74352a62a1fe with delete_type TABLET_DATA_DELETED (replaced by tablet edc54579f85a4b24b022fc96c2cfb443) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.322546 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 14f3aea0cf684f749027f817eb3b13b7 (table default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]) successfully deleted
I20250115 10:12:05.322700 4589 tablet_replica.cc:331] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.322845 4589 raft_consensus.cc:2238] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.322986 4589 raft_consensus.cc:2267] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.323184 4589 ts_tablet_manager.cc:1905] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.324123 4557 tablet_bootstrap.cc:492] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.324168 4557 ts_tablet_manager.cc:1397] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.001s
I20250115 10:12:05.324314 4557 raft_consensus.cc:357] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.324373 4557 raft_consensus.cc:383] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.324393 4557 raft_consensus.cc:738] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.324445 4557 consensus_queue.cc:260] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.324537 4557 ts_tablet_manager.cc:1428] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.324604 4557 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.325012 4557 tablet_bootstrap.cc:654] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.325241 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet dc7e96ba921d4fbb96afbbf8c5f354f2
I20250115 10:12:05.326200 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_81cbb970502040e38384e43cc9935f43" } new_table_name: "default.Table_5fc407387c094c53b0de028f7b997f75" modify_external_catalogs: true
I20250115 10:12:05.326218 3257 tablet_service.cc:1467] Processing CreateTablet for tablet edc54579f85a4b24b022fc96c2cfb443 (DEFAULT_TABLE table=default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.326318 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc54579f85a4b24b022fc96c2cfb443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.326364 4875 raft_consensus.cc:491] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.326409 4875 raft_consensus.cc:513] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.326500 4875 leader_election.cc:290] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.326714 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 4283a096b18b4be69e1f57e60c3efd3e
I20250115 10:12:05.327021 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.327227 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.327287 3550 raft_consensus.cc:2463] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:05.327350 3350 leader_election.cc:343] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.327512 3350 leader_election.cc:304] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.327646 4587 raft_consensus.cc:2798] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.327693 4587 raft_consensus.cc:491] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.327715 4587 raft_consensus.cc:3054] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.327674 3513 tablet_service.cc:1467] Processing CreateTablet for tablet edc54579f85a4b24b022fc96c2cfb443 (DEFAULT_TABLE table=default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.327838 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc54579f85a4b24b022fc96c2cfb443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.328425 4587 raft_consensus.cc:513] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.328542 4587 leader_election.cc:290] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.327359 4875 raft_consensus.cc:491] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.328622 4875 raft_consensus.cc:513] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.328706 4875 leader_election.cc:290] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.328790 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.328836 3550 raft_consensus.cc:3054] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.328919 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.328954 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.329008 3276 raft_consensus.cc:2463] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:05.329203 3350 leader_election.cc:343] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.329269 3350 leader_election.cc:304] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.329486 3550 raft_consensus.cc:2463] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.329563 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.329632 4875 raft_consensus.cc:2798] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.329663 4875 raft_consensus.cc:491] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.329679 4875 raft_consensus.cc:3054] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.329895 3350 leader_election.cc:304] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:05.329985 3350 leader_election.cc:343] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.330317 4875 raft_consensus.cc:513] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.330442 4875 leader_election.cc:290] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.330478 4875 raft_consensus.cc:2798] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.330510 4875 raft_consensus.cc:695] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.330474 4589 ts_tablet_manager.cc:1918] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.330547 4875 consensus_queue.cc:237] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.330850 3412 raft_consensus.cc:3054] T 6d8e47c05a4b46d9a032852ad67b29ae P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.330853 4589 log.cc:1198] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/14f3aea0cf684f749027f817eb3b13b7
I20250115 10:12:05.331221 4589 ts_tablet_manager.cc:1939] T 14f3aea0cf684f749027f817eb3b13b7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.331656 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.331775 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.331851 3276 raft_consensus.cc:3054] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.332005 4475 catalog_manager.cc:5526] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.332098 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]). Expected version 1 got 0
I20250115 10:12:05.332470 3276 raft_consensus.cc:2463] T d02e33022c3840c28623200adb56e3bc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:05.332476 3350 leader_election.cc:343] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.332777 4662 tablet.cc:1721] T ba609491f7ed4686b374fd7c0a5e39f8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.333307 4589 tablet_replica.cc:331] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.333339 3350 leader_election.cc:304] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.333438 4589 raft_consensus.cc:2238] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.333505 4587 raft_consensus.cc:2798] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.333547 4587 raft_consensus.cc:695] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.333561 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 14f3aea0cf684f749027f817eb3b13b7 (table default.Table_c26d7b0a2c464ea4bd7fe81719d44b19 [id=dc6b611327b24f19bd102024d86a0cd7]) successfully deleted
I20250115 10:12:05.333585 4587 consensus_queue.cc:237] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.333595 4589 raft_consensus.cc:2267] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250115 10:12:05.333636 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 689207c595a4465fac76333b8ecb0a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689207c595a4465fac76333b8ecb0a11 already in progress: creating tablet
I20250115 10:12:05.334334 4890 tablet.cc:1721] T ba609491f7ed4686b374fd7c0a5e39f8 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.334470 3770 consensus_queue.cc:1035] T 3f9295765384410d9ee9380b4db88ed0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.334450 4468 catalog_manager.cc:5526] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.334542 4468 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 60cc9a1b2c4348ada0d8dab958aded09 (table default.Table_8efe8747d11e4af0a7df52864f2a926f [id=f93e7218dc4947b5bc778789c1be1480]). Expected version 2 got 0
I20250115 10:12:05.335377 4811 raft_consensus.cc:491] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.335459 4811 raft_consensus.cc:513] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.335554 4811 leader_election.cc:290] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.335542 4873 tablet.cc:1721] T ba609491f7ed4686b374fd7c0a5e39f8 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.336069 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.336138 3278 raft_consensus.cc:2463] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.336272 3350 leader_election.cc:304] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.336282 4714 consensus_queue.cc:1035] T 26351bbe70044075a99982bb380d86a0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.336426 4714 raft_consensus.cc:2798] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.336455 4714 raft_consensus.cc:491] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.336480 4714 raft_consensus.cc:3054] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.336616 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.336776 3350 leader_election.cc:343] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.337093 4551 tablet_replica.cc:331] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.337162 4551 raft_consensus.cc:2238] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.337153 4714 raft_consensus.cc:513] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.337193 4551 raft_consensus.cc:2267] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.337250 4714 leader_election.cc:290] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.337296 4434 consensus_queue.cc:1035] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.337317 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 689207c595a4465fac76333b8ecb0a11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 689207c595a4465fac76333b8ecb0a11 already in progress: creating tablet
I20250115 10:12:05.337540 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.337599 3278 raft_consensus.cc:3054] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.337728 4551 ts_tablet_manager.cc:1905] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.337862 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ac231c1b8e04e8788f7bc368a87acdb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.338245 3278 raft_consensus.cc:2463] T 5ac231c1b8e04e8788f7bc368a87acdb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.338721 4468 catalog_manager.cc:5526] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.338850 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:05.340864 3413 raft_consensus.cc:3054] T 0d7c1c0ac4d3487187907a49343381c0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.341372 4551 ts_tablet_manager.cc:1918] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.341553 3350 leader_election.cc:304] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:05.341614 3350 leader_election.cc:343] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.342025 4468 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_5fc407387c094c53b0de028f7b997f75 [id=0097f32bdaf5478bbdd7cb6e58c2e223] alter complete (version 1)
W20250115 10:12:05.342199 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:05.342253 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:05.342280 4587 raft_consensus.cc:2798] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.342330 4587 raft_consensus.cc:695] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.342366 4587 consensus_queue.cc:237] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.344710 4472 catalog_manager.cc:5526] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.344815 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]). Expected version 1 got 0
W20250115 10:12:05.345346 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:05.345412 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 26351bbe70044075a99982bb380d86a0 (table default.Table_a9c119acee6b4b71bf1aa582ed92fda3 [id=0c70df6695eb4e33af89f0499678d514]). Expected version 1 got 0
I20250115 10:12:05.346024 4589 ts_tablet_manager.cc:1905] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:05.347424 3350 consensus_peers.cc:487] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc6b5ec8e472414789f9619ae958fa34. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.347847 4699 consensus_queue.cc:1035] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.347998 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:05.348462 4589 ts_tablet_manager.cc:1918] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.348554 4589 log.cc:1198] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/d73af05d7fd349b083eb74352a62a1fe
I20250115 10:12:05.343571 4884 consensus_queue.cc:1035] T 0d7c1c0ac4d3487187907a49343381c0 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.349288 4551 log.cc:1198] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/d73af05d7fd349b083eb74352a62a1fe
I20250115 10:12:05.349545 4551 ts_tablet_manager.cc:1939] T d73af05d7fd349b083eb74352a62a1fe P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.349876 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet d73af05d7fd349b083eb74352a62a1fe (table default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]) successfully deleted
W20250115 10:12:05.350126 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
W20250115 10:12:05.350440 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 0d7c1c0ac4d3487187907a49343381c0
I20250115 10:12:05.349046 4589 ts_tablet_manager.cc:1939] T d73af05d7fd349b083eb74352a62a1fe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.350997 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet d73af05d7fd349b083eb74352a62a1fe (table default.Table_6543dbbf3cbe4e1793c9a1744b1e8f60 [id=3eaf5ca246fd48fd9a590c374fd43da9]) successfully deleted
I20250115 10:12:05.351094 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 616166bc9d5d4651999b1d2e0a1851bb from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.351925 4433 raft_consensus.cc:491] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.351975 4433 raft_consensus.cc:513] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.352074 4433 leader_election.cc:290] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.352171 4884 raft_consensus.cc:491] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.352205 4884 raft_consensus.cc:513] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.352272 4884 leader_election.cc:290] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.352286 4575 tablet_bootstrap.cc:492] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.352329 4575 ts_tablet_manager.cc:1397] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.000s
I20250115 10:12:05.352483 4575 raft_consensus.cc:357] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.352547 4575 raft_consensus.cc:383] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.352572 4575 raft_consensus.cc:738] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.352599 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.352612 4575 consensus_queue.cc:260] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.352828 4575 ts_tablet_manager.cc:1428] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.352897 4575 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.353173 3484 leader_election.cc:343] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 4ae4f2e19e4443b38430cdb95bd82f91
W20250115 10:12:05.353237 3484 leader_election.cc:343] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.353310 4575 tablet_bootstrap.cc:654] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.353379 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.353461 3274 raft_consensus.cc:2463] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.353971 3485 leader_election.cc:304] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:05.354066 3485 leader_election.cc:343] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 4ae4f2e19e4443b38430cdb95bd82f91
I20250115 10:12:05.354091 3485 leader_election.cc:304] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:05.354189 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet ec9406dc72bb4e489d76011a69ee2838
I20250115 10:12:05.354296 4887 raft_consensus.cc:2798] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.354331 4887 raft_consensus.cc:491] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.354348 4887 raft_consensus.cc:3054] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.355047 4887 raft_consensus.cc:513] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.355130 4887 leader_election.cc:290] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.355158 4887 raft_consensus.cc:2743] T 4ae4f2e19e4443b38430cdb95bd82f91 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.355197 4887 consensus_queue.cc:1035] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.355239 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.355296 3276 raft_consensus.cc:3054] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.355818 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2e77a1f1d72b4e45bdb96df81debb39b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.355994 3770 raft_consensus.cc:491] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:05.356030 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet 46b8efd1622a4efcb009f999cb915dfc
I20250115 10:12:05.356066 3770 raft_consensus.cc:513] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.356168 3770 leader_election.cc:290] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.356312 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e77a1f1d72b4e45bdb96df81debb39b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.356323 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.356513 3215 leader_election.cc:343] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.356870 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.356889 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "347621ded3fd4380b1502d1a8c5b0c4a" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.357065 3214 leader_election.cc:343] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.357100 3214 leader_election.cc:304] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.357422 3770 raft_consensus.cc:2743] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.358033 3484 leader_election.cc:343] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.358598 4575 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.358642 4575 ts_tablet_manager.cc:1397] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:05.358785 4575 raft_consensus.cc:357] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.358836 4575 raft_consensus.cc:383] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.358853 4575 raft_consensus.cc:738] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.358886 4575 consensus_queue.cc:260] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.358974 4575 ts_tablet_manager.cc:1428] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.359035 4575 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.356014 3276 raft_consensus.cc:2463] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.359205 3485 leader_election.cc:304] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.359297 4433 raft_consensus.cc:2798] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.359344 4433 raft_consensus.cc:695] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.359378 4433 consensus_queue.cc:237] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.359628 4575 tablet_bootstrap.cc:654] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.361230 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0fec3b49433249318af0865469074d91" } new_table_name: "default.Table_123c7bf739304777bad37610687f9d69" modify_external_catalogs: true
I20250115 10:12:05.361680 4557 tablet_bootstrap.cc:492] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.361725 4557 ts_tablet_manager.cc:1397] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.000s
I20250115 10:12:05.362030 4557 raft_consensus.cc:357] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.362092 4557 raft_consensus.cc:383] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.362114 4557 raft_consensus.cc:738] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.362152 4557 consensus_queue.cc:260] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.362170 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9b83fa6920a344e39287a99d9865b56c consensus state has no leader
I20250115 10:12:05.362250 4557 ts_tablet_manager.cc:1428] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.362309 4557 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.362751 4557 tablet_bootstrap.cc:654] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.363291 4699 consensus_queue.cc:1035] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.363492 4335 raft_consensus.cc:491] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.363543 4335 raft_consensus.cc:513] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.363659 4335 leader_election.cc:290] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.363852 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.363838 4472 catalog_manager.cc:5526] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.363934 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 347621ded3fd4380b1502d1a8c5b0c4a (table default.Table_cab9252630814ab69c879985e3c01f06 [id=71819bfc734a4e0d9e38041345bbd29b]). Expected version 2 got 0
W20250115 10:12:05.364027 3214 leader_election.cc:343] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.364122 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 15d4b76c613a40afa1d92b5b3df6851a (DEFAULT_TABLE table=default.Table_2e77a1f1d72b4e45bdb96df81debb39b [id=f0772d9a0f324bf68b66859d9b8ed127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.364137 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.364184 3548 raft_consensus.cc:2463] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.364217 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d4b76c613a40afa1d92b5b3df6851a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.364296 3215 leader_election.cc:304] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.364506 4335 raft_consensus.cc:2798] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.364544 4335 raft_consensus.cc:491] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.364560 4335 raft_consensus.cc:3054] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.364897 3350 consensus_peers.cc:487] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14f3aea0cf684f749027f817eb3b13b7. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.365243 4335 raft_consensus.cc:513] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.365361 4335 leader_election.cc:290] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.365550 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 15d4b76c613a40afa1d92b5b3df6851a (DEFAULT_TABLE table=default.Table_2e77a1f1d72b4e45bdb96df81debb39b [id=f0772d9a0f324bf68b66859d9b8ed127]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.365651 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d4b76c613a40afa1d92b5b3df6851a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.365685 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.365741 3548 raft_consensus.cc:3054] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.366098 4569 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.366148 4569 ts_tablet_manager.cc:1397] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.000s
I20250115 10:12:05.366343 4569 raft_consensus.cc:357] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.366379 3548 raft_consensus.cc:2463] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.366410 4569 raft_consensus.cc:383] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.366436 4569 raft_consensus.cc:738] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.366484 4569 consensus_queue.cc:260] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.366593 4338 raft_consensus.cc:491] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.366605 4569 ts_tablet_manager.cc:1428] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.366647 4338 raft_consensus.cc:513] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.366683 4569 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.366730 4338 leader_election.cc:290] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.367187 4569 tablet_bootstrap.cc:654] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.367662 3215 leader_election.cc:304] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.367853 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a357badf1cd43e384d2de92e3413898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.367921 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e78a8b61e142199ba7bf73e3879b98" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.368188 4731 raft_consensus.cc:2798] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.368249 4731 raft_consensus.cc:695] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
W20250115 10:12:05.368283 3214 leader_election.cc:343] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.368444 4569 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.368491 4569 ts_tablet_manager.cc:1397] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
W20250115 10:12:05.368541 3484 leader_election.cc:343] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.368619 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 12082ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:05.368296 4731 consensus_queue.cc:237] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.368647 4569 raft_consensus.cc:357] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.368700 4569 raft_consensus.cc:383] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.368721 4569 raft_consensus.cc:738] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.368762 4569 consensus_queue.cc:260] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.368856 4569 ts_tablet_manager.cc:1428] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.368914 4569 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.369001 4575 tablet_bootstrap.cc:492] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.369045 4575 ts_tablet_manager.cc:1397] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.369174 4575 raft_consensus.cc:357] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.369225 4575 raft_consensus.cc:383] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.369246 4575 raft_consensus.cc:738] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.369282 4575 consensus_queue.cc:260] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.369295 4569 tablet_bootstrap.cc:654] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.369385 4575 ts_tablet_manager.cc:1428] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.369446 4575 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.369863 4575 tablet_bootstrap.cc:654] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.370076 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e78a8b61e142199ba7bf73e3879b98" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.370136 3280 raft_consensus.cc:2463] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.370458 3485 leader_election.cc:304] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.370785 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a7e2086241df4b4fac5e481c5e8295a9 (table default.Table_99fc538b849348e19ef1968953d83866 [id=0b1b8cdb67244dc19aed82671327d212]). Expected version 1 got 0
I20250115 10:12:05.370923 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:05.370972 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:05.371011 4338 raft_consensus.cc:2798] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.371048 4338 raft_consensus.cc:491] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.371073 4338 raft_consensus.cc:3054] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.371724 4338 raft_consensus.cc:513] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.371837 4338 leader_election.cc:290] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.371942 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e78a8b61e142199ba7bf73e3879b98" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.372013 3274 raft_consensus.cc:3054] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.372160 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00e78a8b61e142199ba7bf73e3879b98" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.372357 3484 leader_election.cc:343] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.372465 4338 consensus_queue.cc:1035] T fcf567628009460dbb7bfa582f69b4f1 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.372689 3274 raft_consensus.cc:2463] T 00e78a8b61e142199ba7bf73e3879b98 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.372972 3485 leader_election.cc:304] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.373235 4338 raft_consensus.cc:2798] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.373286 4338 raft_consensus.cc:695] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.373327 4338 consensus_queue.cc:237] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.373622 4575 tablet_bootstrap.cc:492] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.373574 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3c9eb28f3a204aeb84c464bb15730a5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.373662 4575 ts_tablet_manager.cc:1397] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
W20250115 10:12:05.373692 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c9eb28f3a204aeb84c464bb15730a5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.373806 4575 raft_consensus.cc:357] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.373855 4575 raft_consensus.cc:383] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.373872 4575 raft_consensus.cc:738] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.373917 4575 consensus_queue.cc:260] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.374029 4575 ts_tablet_manager.cc:1428] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.374084 4575 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.374490 4575 tablet_bootstrap.cc:654] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.375196 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 00e78a8b61e142199ba7bf73e3879b98
I20250115 10:12:05.375226 5579 ts_tablet_manager.cc:927] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Initiating tablet copy from peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:05.375353 4569 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.375411 4569 ts_tablet_manager.cc:1397] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:05.375687 4569 raft_consensus.cc:357] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.375763 4569 raft_consensus.cc:383] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.375784 4569 raft_consensus.cc:738] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.375811 4569 consensus_queue.cc:260] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.375430 5579 tablet_copy_client.cc:323] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet copy: Beginning tablet copy session from remote peer at address 127.2.217.130:35883
I20250115 10:12:05.375934 4569 ts_tablet_manager.cc:1428] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.376004 4569 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.376420 4569 tablet_bootstrap.cc:654] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.376428 3435 tablet_copy_service.cc:140] P 25d7e460cb6d4ddabf387dc672cc26b3: Received BeginTabletCopySession request for tablet d35847dc829b4b3d94c0fb68ec6c2b31 from peer 4c9ab337b4ea47d18b4208d424cf5fd1 ({username='slave'} at 127.2.217.129:33345)
I20250115 10:12:05.376482 3435 tablet_copy_service.cc:161] P 25d7e460cb6d4ddabf387dc672cc26b3: Beginning new tablet copy session on tablet d35847dc829b4b3d94c0fb68ec6c2b31 from peer 4c9ab337b4ea47d18b4208d424cf5fd1 at {username='slave'} at 127.2.217.129:33345: session id = 4c9ab337b4ea47d18b4208d424cf5fd1-d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:05.377274 3435 tablet_copy_source_session.cc:215] T d35847dc829b4b3d94c0fb68ec6c2b31 P 25d7e460cb6d4ddabf387dc672cc26b3: Tablet Copy: opened 0 blocks and 1 log segments
I20250115 10:12:05.377516 4557 tablet_bootstrap.cc:492] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.377560 4557 ts_tablet_manager.cc:1397] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.000s
I20250115 10:12:05.377736 4557 raft_consensus.cc:357] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.377794 4557 raft_consensus.cc:383] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.377816 4557 raft_consensus.cc:738] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.377851 4557 consensus_queue.cc:260] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.377934 4557 ts_tablet_manager.cc:1428] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.377995 4557 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.378414 4557 tablet_bootstrap.cc:654] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.378526 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:05.378568 4471 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 98993cb75de34c0babb894a5d17d6d12 (table default.Table_9c6387abf6594f90a0d300f9e8decf73 [id=b130fa3af11f4240a10a22833b91c091]). Expected version 1 got 0
I20250115 10:12:05.378717 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 2d8ee71afb6d4488861d2d6ddfc6dd0e (DEFAULT_TABLE table=default.Table_3c9eb28f3a204aeb84c464bb15730a5c [id=0f5ff93f36b04c38a14ba86187b0dee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.378825 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 2d8ee71afb6d4488861d2d6ddfc6dd0e (DEFAULT_TABLE table=default.Table_3c9eb28f3a204aeb84c464bb15730a5c [id=0f5ff93f36b04c38a14ba86187b0dee7]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.378921 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d8ee71afb6d4488861d2d6ddfc6dd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.379020 4575 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.379055 4575 ts_tablet_manager.cc:1397] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:05.379052 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d8ee71afb6d4488861d2d6ddfc6dd0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.379169 4575 raft_consensus.cc:357] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.379212 4575 raft_consensus.cc:383] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.379228 4575 raft_consensus.cc:738] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.379261 4575 consensus_queue.cc:260] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.379446 4575 ts_tablet_manager.cc:1428] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.379501 4575 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.380028 4575 tablet_bootstrap.cc:654] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.380390 3350 consensus_peers.cc:487] T 82c66363913e47399c4e1e8533bdadd0 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.380561 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]). Expected version 1 got 0
I20250115 10:12:05.380611 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:05.380656 4475 catalog_manager.cc:5526] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.380759 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_e2336efa12724d77804d65cd42e446df [id=a917e062f0334d9ab4cd3ee08ba2ce98]). Expected version 2 got 0
I20250115 10:12:05.380795 4569 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.380827 4569 ts_tablet_manager.cc:1397] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.380951 4569 raft_consensus.cc:357] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.381016 4569 raft_consensus.cc:383] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.381038 4569 raft_consensus.cc:738] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.381083 4569 consensus_queue.cc:260] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.381191 4569 ts_tablet_manager.cc:1428] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.381268 4569 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.381201 5579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d35847dc829b4b3d94c0fb68ec6c2b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.381919 4569 tablet_bootstrap.cc:654] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.382629 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f98e93dc1edf457d8b10bd2882677285" } new_table_name: "default.Table_581f09765dce491ca96069c0d429565f" modify_external_catalogs: true
I20250115 10:12:05.382655 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_dc82fd7dcb014062858076f3e91f5a52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.382961 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc82fd7dcb014062858076f3e91f5a52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.383150 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_31b2efef8cc44cccbf5dac2674a4c2e3" } new_table_name: "default.Table_28366606003345e2be6339e85093926b" modify_external_catalogs: true
I20250115 10:12:05.384027 5579 tablet_copy_client.cc:806] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet copy: Starting download of 0 data blocks...
I20250115 10:12:05.384093 4587 consensus_queue.cc:1035] T cb8ecc0818304f5e9522bba63a4aca4d P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.384559 4434 raft_consensus.cc:491] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.384610 4434 raft_consensus.cc:513] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.384723 4434 leader_election.cc:290] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.384856 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.384891 3274 raft_consensus.cc:1270] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.384924 3278 raft_consensus.cc:2388] T ce8455d282d34bbe9822a00a28d4c3ec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:05.384984 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce8455d282d34bbe9822a00a28d4c3ec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.385044 4338 consensus_queue.cc:1035] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.385589 3484 consensus_peers.cc:487] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.385653 3484 leader_election.cc:304] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.385722 4434 raft_consensus.cc:3054] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.385723 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:05.386448 4434 raft_consensus.cc:2743] T ce8455d282d34bbe9822a00a28d4c3ec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.386891 5579 tablet_copy_client.cc:670] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet copy: Starting download of 1 WAL segments...
I20250115 10:12:05.387218 4471 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 3f81769b500149f7b2bf7cdf76f7ee27 (table default.Table_47c3cc66d3ad4c95be45caf7ee18b108 [id=0298d09bab6149af8c9c418b3d064b97]). Expected version 1 got 0
I20250115 10:12:05.387275 4575 tablet_bootstrap.cc:492] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.387311 4575 ts_tablet_manager.cc:1397] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:05.387440 4575 raft_consensus.cc:357] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.387496 4575 raft_consensus.cc:383] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.387516 4575 raft_consensus.cc:738] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.387547 4575 consensus_queue.cc:260] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.387589 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d969e18112464753bb51d02357c57bfa consensus state has no leader
I20250115 10:12:05.387642 4575 ts_tablet_manager.cc:1428] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.387704 4575 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.388150 4575 tablet_bootstrap.cc:654] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.388736 4569 tablet_bootstrap.cc:492] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.388778 4569 ts_tablet_manager.cc:1397] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:05.388904 4569 raft_consensus.cc:357] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.388963 4569 raft_consensus.cc:383] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.388981 4569 raft_consensus.cc:738] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.389025 4569 consensus_queue.cc:260] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.389125 4569 ts_tablet_manager.cc:1428] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.389185 4569 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.389245 3214 consensus_peers.cc:487] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.389590 4569 tablet_bootstrap.cc:654] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.390345 3548 raft_consensus.cc:1270] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.390518 4335 consensus_queue.cc:1035] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.390537 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 1650bac5bd96467fb3d586b23ebd77be
W20250115 10:12:05.390600 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet fc423aad4e7a49eaacb21c73d5d8c341
I20250115 10:12:05.390626 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:05.390656 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]). Expected version 1 got 0
I20250115 10:12:05.390642 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 3f84545c10aa4d228bafe5f3ac94627e (DEFAULT_TABLE table=default.Table_dc82fd7dcb014062858076f3e91f5a52 [id=b047f88bc9ee42209592faa00e8db63d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.390755 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f84545c10aa4d228bafe5f3ac94627e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.390964 4338 raft_consensus.cc:491] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.391026 4338 raft_consensus.cc:513] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.391142 4338 leader_election.cc:290] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.391281 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.391300 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.391340 3415 raft_consensus.cc:2463] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.391358 3280 raft_consensus.cc:2463] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.391474 4335 consensus_queue.cc:1035] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.391500 3485 leader_election.cc:304] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.391702 4338 raft_consensus.cc:2798] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.391760 4338 raft_consensus.cc:491] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.391782 4338 raft_consensus.cc:3054] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.391938 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 3f84545c10aa4d228bafe5f3ac94627e (DEFAULT_TABLE table=default.Table_dc82fd7dcb014062858076f3e91f5a52 [id=b047f88bc9ee42209592faa00e8db63d]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.392035 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f84545c10aa4d228bafe5f3ac94627e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.392139 4887 raft_consensus.cc:491] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.392184 4887 raft_consensus.cc:513] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.392294 4887 leader_election.cc:290] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.392372 4338 raft_consensus.cc:513] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.392400 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.392455 3280 raft_consensus.cc:2463] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.392469 4338 leader_election.cc:290] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.392539 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_9a526e66b6da46c6a70efda61f98c0cc [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]). Expected version 2 got 0
I20250115 10:12:05.392575 3485 leader_election.cc:304] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.392735 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.392786 3280 raft_consensus.cc:3054] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.393285 4887 raft_consensus.cc:2798] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.393286 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.393329 4887 raft_consensus.cc:491] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.393349 4887 raft_consensus.cc:3054] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.393350 3414 raft_consensus.cc:2463] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.393489 3280 raft_consensus.cc:2463] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.393630 3485 leader_election.cc:304] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.394063 4887 raft_consensus.cc:513] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.394182 4887 leader_election.cc:290] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.394228 4887 raft_consensus.cc:2798] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.394253 4887 raft_consensus.cc:695] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.394281 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.394291 4887 consensus_queue.cc:237] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.394344 3280 raft_consensus.cc:3054] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.394568 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8dde69ff2f574d838d81bea5a53700f5" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.394620 3411 raft_consensus.cc:3054] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.394939 3280 raft_consensus.cc:2463] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.395364 3411 raft_consensus.cc:2463] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.395844 5377 mvcc.cc:204] Tried to move back new op lower bound from 7114489550391824384 to 7114489549802450944. Current Snapshot: MvccSnapshot[applied={T|T < 7114489550391824384}]
I20250115 10:12:05.395963 4662 tablet.cc:1721] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.396049 4873 tablet.cc:1721] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.396133 4557 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.396173 4557 ts_tablet_manager.cc:1397] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.000s
I20250115 10:12:05.396344 4557 raft_consensus.cc:357] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.396404 4557 raft_consensus.cc:383] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.396395 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet b114b291fd734797bd6622d89e309925 (table default.Table_581f09765dce491ca96069c0d429565f [id=a49d7416b0c84365bc92418b8d448a65]). Expected version 1 got 0
I20250115 10:12:05.396426 4557 raft_consensus.cc:738] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.396469 4557 consensus_queue.cc:260] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.396446 4472 catalog_manager.cc:5526] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.396525 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8dde69ff2f574d838d81bea5a53700f5 (table default.Table_9a526e66b6da46c6a70efda61f98c0cc [id=1e8d95b292ea4c6fb2f9a0c64fe9f985]). Expected version 2 got 0
I20250115 10:12:05.396555 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a76df2d8b00c46949afac48a55d8200f (table default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48]). Expected version 1 got 0
I20250115 10:12:05.396633 4557 ts_tablet_manager.cc:1428] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.396689 4557 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.397114 3485 leader_election.cc:304] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.397213 4433 raft_consensus.cc:2798] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.397251 4433 raft_consensus.cc:695] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.397289 4433 consensus_queue.cc:237] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.397668 5410 tablet.cc:1721] T b1b423922cbb4a42bbdb4de025227118 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.397100 4557 tablet_bootstrap.cc:654] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.398563 4662 tablet.cc:1721] T b1b423922cbb4a42bbdb4de025227118 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.398743 5579 tablet_copy_client.cc:538] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20250115 10:12:05.399333 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 0f4dc0c74f2e43db8b87446a236771f2
W20250115 10:12:05.399371 4474 catalog_manager.cc:5359] Ignoring report from unknown tablet 01a8681daa9b459ba85dea9410d83256
I20250115 10:12:05.399521 5579 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.400171 3350 consensus_peers.cc:487] T 14f3aea0cf684f749027f817eb3b13b7 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14f3aea0cf684f749027f817eb3b13b7. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.400586 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a076172bba8e4878978c318d441577bd" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.400658 3411 raft_consensus.cc:3054] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.400876 4569 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.400914 4569 ts_tablet_manager.cc:1397] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:05.401043 4569 raft_consensus.cc:357] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.401103 4569 raft_consensus.cc:383] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.401124 4569 raft_consensus.cc:738] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.401171 4569 consensus_queue.cc:260] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.401278 4569 ts_tablet_manager.cc:1428] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.401330 4569 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.401352 3411 raft_consensus.cc:2463] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.401700 4569 tablet_bootstrap.cc:654] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.402204 5156 raft_consensus.cc:491] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.402247 5156 raft_consensus.cc:513] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.402341 5156 leader_election.cc:290] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.403371 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.403450 3550 raft_consensus.cc:2463] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.403800 3770 consensus_queue.cc:1035] T 76499a085d9d4f74818684d3148a4866 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.403885 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.403694 3215 leader_election.cc:304] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.404201 4474 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_581f09765dce491ca96069c0d429565f [id=a49d7416b0c84365bc92418b8d448a65] alter complete (version 1)
I20250115 10:12:05.404211 5156 raft_consensus.cc:2798] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.404253 5156 raft_consensus.cc:491] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.404271 5156 raft_consensus.cc:3054] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.404596 3214 leader_election.cc:343] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.404753 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 7352b551832b40039715e5bf18a31ffb
I20250115 10:12:05.404814 4472 catalog_manager.cc:5526] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.404889 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]). Expected version 1 got 0
I20250115 10:12:05.404887 5156 raft_consensus.cc:513] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.404986 5156 leader_election.cc:290] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.405779 4575 tablet_bootstrap.cc:492] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.405833 4575 ts_tablet_manager.cc:1397] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20250115 10:12:05.406009 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.406201 3214 leader_election.cc:343] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.405972 4575 raft_consensus.cc:357] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.406531 4575 raft_consensus.cc:383] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.406584 4575 raft_consensus.cc:738] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.406634 4575 consensus_queue.cc:260] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.406786 4575 ts_tablet_manager.cc:1428] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.406859 4575 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.407271 4575 tablet_bootstrap.cc:654] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.407591 4557 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.407649 4557 ts_tablet_manager.cc:1397] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:05.407778 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]). Expected version 1 got 0
I20250115 10:12:05.407799 4557 raft_consensus.cc:357] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.407856 4557 raft_consensus.cc:383] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.407873 4557 raft_consensus.cc:738] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.407910 4557 consensus_queue.cc:260] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.407995 4557 ts_tablet_manager.cc:1428] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.408061 4557 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.408474 4557 tablet_bootstrap.cc:654] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.403688 4569 tablet_bootstrap.cc:492] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.409067 4569 ts_tablet_manager.cc:1397] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:05.409229 4569 raft_consensus.cc:357] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.409291 4569 raft_consensus.cc:383] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.409312 4569 raft_consensus.cc:738] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.409340 4569 consensus_queue.cc:260] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.409425 4569 ts_tablet_manager.cc:1428] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.409447 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:05.409472 4569 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.409650 4335 raft_consensus.cc:491] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.409693 4335 raft_consensus.cc:513] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.409746 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.409790 4335 leader_election.cc:290] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.409804 3550 raft_consensus.cc:3054] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.409904 4569 tablet_bootstrap.cc:654] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.410280 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070] alter complete (version 2)
I20250115 10:12:05.410512 3550 raft_consensus.cc:2463] T f2230f6de9a54e98aa83435d37f68807 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.411717 4474 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 7144ec81e9244eb49715450aeda5f82f (table default.Table_fe545b7b662f4b1ea513d915b9c36acf [id=6ef4f40281e34b0c95e1b3eb2a8f04a0]). Expected version 1 got 0
I20250115 10:12:05.411782 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.411888 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet b1b423922cbb4a42bbdb4de025227118 (table default.Table_da72eec03bd048bab9fe6aefe065145c [id=1877c975a9fb4a2db7df19a0938f7070]). Expected version 2 got 0
I20250115 10:12:05.412099 4884 raft_consensus.cc:491] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.412132 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 0a612decf0634bd588f45c8953c6b201 (table default.Table_4dd032a6e5bd4cfea08bb2dd20592783 [id=a895bd62e991430e8cda36f668b60855]). Expected version 1 got 0
I20250115 10:12:05.412142 4884 raft_consensus.cc:513] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.412223 4884 leader_election.cc:290] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:05.412232 3214 leader_election.cc:343] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.412539 3485 leader_election.cc:343] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:05.412894 3215 leader_election.cc:304] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.413030 4335 raft_consensus.cc:2798] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.413074 4335 raft_consensus.cc:695] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.413105 4335 consensus_queue.cc:237] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.413157 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 4f559e7cafb04ae39af12e7681bbaf24
I20250115 10:12:05.413174 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.413230 3550 raft_consensus.cc:2463] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.413295 4587 consensus_queue.cc:1035] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.413448 3215 leader_election.cc:304] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:05.413558 3484 leader_election.cc:343] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d3326a9a37a64e9a9485e5abadc2e493
I20250115 10:12:05.413576 3770 raft_consensus.cc:2798] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.413599 3484 leader_election.cc:304] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.413612 3770 raft_consensus.cc:491] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.413635 3770 raft_consensus.cc:3054] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.413663 4887 raft_consensus.cc:2743] T d3326a9a37a64e9a9485e5abadc2e493 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.414326 3770 raft_consensus.cc:513] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.414486 3770 leader_election.cc:290] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.414691 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.414748 3550 raft_consensus.cc:3054] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.415413 3550 raft_consensus.cc:2463] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.415769 3215 leader_election.cc:304] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.415822 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.415922 4731 raft_consensus.cc:2798] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.415993 4731 raft_consensus.cc:695] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.416055 4731 consensus_queue.cc:237] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.416115 5579 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250115 10:12:05.416329 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_f3ecaa29866d4eecba0b28723277579c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.416476 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3ecaa29866d4eecba0b28723277579c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:05.416579 3214 leader_election.cc:343] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.416575 5579 tablet_bootstrap.cc:492] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap complete.
I20250115 10:12:05.416858 5579 ts_tablet_manager.cc:1397] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
W20250115 10:12:05.417003 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet e3a4b1b801c84cbcae634a965be09734
I20250115 10:12:05.417079 4575 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.417049 4472 catalog_manager.cc:5526] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.417120 4575 ts_tablet_manager.cc:1397] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.417129 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:05.417258 4575 raft_consensus.cc:357] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.417323 4575 raft_consensus.cc:383] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.417346 4575 raft_consensus.cc:738] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.417385 4575 consensus_queue.cc:260] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.417330 5579 raft_consensus.cc:357] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.417462 5579 raft_consensus.cc:738] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.417500 4575 ts_tablet_manager.cc:1428] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.417569 4575 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.417539 5579 consensus_queue.cc:260] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.417884 5579 ts_tablet_manager.cc:1428] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.418089 4575 tablet_bootstrap.cc:654] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.418689 4575 tablet_bootstrap.cc:492] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.418723 4575 ts_tablet_manager.cc:1397] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
W20250115 10:12:05.419421 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet f682c7942a454d86a5df19eeac533361
I20250115 10:12:05.419505 4335 raft_consensus.cc:491] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.419551 4335 raft_consensus.cc:513] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.419683 4335 leader_election.cc:290] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.419837 4569 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.419875 4569 ts_tablet_manager.cc:1397] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:05.419994 4569 raft_consensus.cc:357] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.420058 4569 raft_consensus.cc:383] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.420075 4569 raft_consensus.cc:738] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.420101 4569 consensus_queue.cc:260] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.420184 4569 ts_tablet_manager.cc:1428] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.419459 3435 tablet_copy_service.cc:342] P 25d7e460cb6d4ddabf387dc672cc26b3: Request end of tablet copy session 4c9ab337b4ea47d18b4208d424cf5fd1-d35847dc829b4b3d94c0fb68ec6c2b31 received from {username='slave'} at 127.2.217.129:33345
I20250115 10:12:05.420516 3435 tablet_copy_service.cc:434] P 25d7e460cb6d4ddabf387dc672cc26b3: ending tablet copy session 4c9ab337b4ea47d18b4208d424cf5fd1-d35847dc829b4b3d94c0fb68ec6c2b31 on tablet d35847dc829b4b3d94c0fb68ec6c2b31 with peer 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.420619 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.420671 3550 raft_consensus.cc:2463] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.420732 4873 tablet.cc:1721] T a76df2d8b00c46949afac48a55d8200f P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:05.420884 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet d35847dc829b4b3d94c0fb68ec6c2b31
I20250115 10:12:05.420925 4472 catalog_manager.cc:5526] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.418861 4575 raft_consensus.cc:357] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.421000 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 3552b8e936ad4aeba0eadc95577f5414 (table default.Table_baba9f0634bd454bab116625f5bbbda6 [id=f03783b8301b4115af49aa260e2ff35b]). Expected version 1 got 0
I20250115 10:12:05.421010 4575 raft_consensus.cc:383] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.421064 4575 raft_consensus.cc:738] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.421119 4575 consensus_queue.cc:260] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.421285 4575 ts_tablet_manager.cc:1428] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:05.421355 4569 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.421408 4575 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.421765 4569 tablet_bootstrap.cc:654] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.422991 4662 tablet.cc:1721] T a76df2d8b00c46949afac48a55d8200f P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.423362 4575 tablet_bootstrap.cc:654] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.424197 3215 leader_election.cc:304] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.424284 4731 raft_consensus.cc:2798] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.424319 4731 raft_consensus.cc:491] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.424337 4731 raft_consensus.cc:3054] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.424959 4731 raft_consensus.cc:513] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.425060 4731 leader_election.cc:290] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.425138 4811 consensus_queue.cc:1035] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.425294 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.425346 3550 raft_consensus.cc:3054] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.426080 3550 raft_consensus.cc:2463] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.426126 4575 tablet_bootstrap.cc:492] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.426167 4575 ts_tablet_manager.cc:1397] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:05.426337 4575 raft_consensus.cc:357] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.426400 4575 raft_consensus.cc:383] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.426424 4575 raft_consensus.cc:738] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.426468 4575 consensus_queue.cc:260] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.426504 4699 consensus_queue.cc:1035] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.426508 3215 leader_election.cc:304] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.426566 4575 ts_tablet_manager.cc:1428] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.426632 4575 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.426818 5155 raft_consensus.cc:491] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.426867 5155 raft_consensus.cc:513] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.427012 5155 leader_election.cc:290] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.427033 4575 tablet_bootstrap.cc:654] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.427044 5155 raft_consensus.cc:2798] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.427078 5155 raft_consensus.cc:695] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.427114 5155 consensus_queue.cc:237] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.428397 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.428457 3550 raft_consensus.cc:2463] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.428983 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 280a20f9803943bca7847e95877be34a (DEFAULT_TABLE table=default.Table_f3ecaa29866d4eecba0b28723277579c [id=023272a3c3484200b216a959223ec244]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.429081 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280a20f9803943bca7847e95877be34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.429150 4475 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 4d31f180a3fc499fbd505c986593a7f5 (table default.Table_04e0d5c168bb43f69631a4c3349ea8df [id=270edc3310cd4a09aaa6f46e4f889188]). Expected version 2 got 0
I20250115 10:12:05.429335 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 280a20f9803943bca7847e95877be34a (DEFAULT_TABLE table=default.Table_f3ecaa29866d4eecba0b28723277579c [id=023272a3c3484200b216a959223ec244]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.429437 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 280a20f9803943bca7847e95877be34a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.429560 4699 raft_consensus.cc:491] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.429596 4699 raft_consensus.cc:513] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.429674 4699 leader_election.cc:290] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.429698 4699 raft_consensus.cc:491] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.429718 4699 raft_consensus.cc:513] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.429783 4699 leader_election.cc:290] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.430122 4557 tablet_bootstrap.cc:492] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.430163 4557 ts_tablet_manager.cc:1397] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.001s
I20250115 10:12:05.430307 4557 raft_consensus.cc:357] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.430356 4557 raft_consensus.cc:383] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.430371 4557 raft_consensus.cc:738] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.430424 4557 consensus_queue.cc:260] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.430446 3215 leader_election.cc:304] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.430495 4557 ts_tablet_manager.cc:1428] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.430552 4557 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.430612 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.430671 3411 raft_consensus.cc:3054] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.430764 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5403eb7ca3b74d6e8110f97c17e1aa67" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.430871 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.430918 3414 raft_consensus.cc:2463] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.430944 4557 tablet_bootstrap.cc:654] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.431337 3411 raft_consensus.cc:2463] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.431665 4335 raft_consensus.cc:2798] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.431704 4335 raft_consensus.cc:491] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.431759 4335 raft_consensus.cc:3054] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.431783 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.431867 3544 raft_consensus.cc:2463] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.431952 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.432015 3550 raft_consensus.cc:2388] T 98993cb75de34c0babb894a5d17d6d12 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
W20250115 10:12:05.432124 4475 catalog_manager.cc:5359] Ignoring report from unknown tablet f682c7942a454d86a5df19eeac533361
I20250115 10:12:05.432379 4335 raft_consensus.cc:513] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.432466 4335 leader_election.cc:290] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.433235 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.433295 3278 raft_consensus.cc:2463] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.433394 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98993cb75de34c0babb894a5d17d6d12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.433393 4474 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:05.433446 4474 catalog_manager.cc:5526] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.433531 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.433579 3545 raft_consensus.cc:3054] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.433705 3350 leader_election.cc:304] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.433876 4699 raft_consensus.cc:2798] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.433912 4699 raft_consensus.cc:491] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.433928 4699 raft_consensus.cc:3054] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.434003 3350 leader_election.cc:304] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.434170 3545 raft_consensus.cc:2463] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.434283 4875 raft_consensus.cc:3054] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.434414 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "353b2e8e545e44768ec77f0cd0caa6e6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.434469 3411 raft_consensus.cc:3054] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.434576 4699 raft_consensus.cc:513] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.434677 4699 leader_election.cc:290] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.434926 4875 raft_consensus.cc:2743] T 98993cb75de34c0babb894a5d17d6d12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.435021 4472 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: default.Table_1de5428c45384daea1c3cf0c936fd367 [id=1a36a0dbf9eb490ba53332a260571b48] alter complete (version 1)
I20250115 10:12:05.435098 3411 raft_consensus.cc:2463] T 353b2e8e545e44768ec77f0cd0caa6e6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.435231 3215 leader_election.cc:304] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.435935 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.436031 3280 raft_consensus.cc:3054] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.436264 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 3ab77abe34374a6ba6f30bf3a2bd67de
I20250115 10:12:05.436677 4884 raft_consensus.cc:491] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.436749 3280 raft_consensus.cc:2463] T 5f37b29ba1cb4a0289268ba1241527b8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.436739 4884 raft_consensus.cc:513] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.436833 4884 leader_election.cc:290] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.436861 3350 leader_election.cc:304] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.436964 4811 raft_consensus.cc:2798] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.437008 4811 raft_consensus.cc:695] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.437048 4811 consensus_queue.cc:237] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.437139 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8a357badf1cd43e384d2de92e3413898 (table default.Table_e2336efa12724d77804d65cd42e446df [id=a917e062f0334d9ab4cd3ee08ba2ce98]). Expected version 2 got 0
I20250115 10:12:05.437199 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:05.437428 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.437525 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.437577 3278 raft_consensus.cc:2463] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:05.437901 3484 leader_election.cc:343] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.437882 5448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 10:12:05.438136 5448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20250115 10:12:05.438153 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f37b29ba1cb4a0289268ba1241527b8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.438180 3485 leader_election.cc:304] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.438215 3545 raft_consensus.cc:3054] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.438259 4884 raft_consensus.cc:2798] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.438304 4884 raft_consensus.cc:491] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250115 10:12:05.438300 5448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20250115 10:12:05.438325 4884 raft_consensus.cc:3054] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.438653 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]). Expected version 3 got 0
I20250115 10:12:05.438694 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5f37b29ba1cb4a0289268ba1241527b8 (table default.Table_3249ea9ae59247ca976f3c00dc0b4947 [id=2cd4c5e9ab1f4e018b47117186f14066]). Expected version 1 got 0
I20250115 10:12:05.438815 3545 raft_consensus.cc:2463] T 5f37b29ba1cb4a0289268ba1241527b8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.438884 4884 raft_consensus.cc:513] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.438971 4884 leader_election.cc:290] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.438949 4475 catalog_manager.cc:5526] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.439033 4475 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 5f37b29ba1cb4a0289268ba1241527b8 (table default.Table_3249ea9ae59247ca976f3c00dc0b4947 [id=2cd4c5e9ab1f4e018b47117186f14066]). Expected version 1 got 0
I20250115 10:12:05.439334 4731 raft_consensus.cc:2798] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.439392 4731 raft_consensus.cc:695] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.439427 4731 consensus_queue.cc:237] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.439579 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.439640 3274 raft_consensus.cc:3054] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.439749 4890 tablet.cc:1721] T a76df2d8b00c46949afac48a55d8200f P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.440251 3274 raft_consensus.cc:2463] T b110fe6c13204cf295abb29839f3380b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
W20250115 10:12:05.440905 5448 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20250115 10:12:05.441002 5448 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20250115 10:12:05.441066 5448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 10:12:05.441150 5448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 10:12:05.441208 5448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 10:12:05.441269 5448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 10:12:05.441318 3485 leader_election.cc:304] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.441402 4434 raft_consensus.cc:2798] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.441465 4434 raft_consensus.cc:695] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.441516 4434 consensus_queue.cc:237] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.441722 4875 raft_consensus.cc:491] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.441793 4875 raft_consensus.cc:513] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.441891 4875 leader_election.cc:290] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.442591 4875 raft_consensus.cc:491] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.442700 4875 raft_consensus.cc:513] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.442802 4875 leader_election.cc:290] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.442814 4475 catalog_manager.cc:5526] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
W20250115 10:12:05.443545 3350 leader_election.cc:343] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: ac8b3c397070467196b73dedcacf22de
W20250115 10:12:05.443608 3350 consensus_peers.cc:487] T 98e5519e80144b7582d76b7f9d8d6ffa P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:05.443639 3350 leader_election.cc:343] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: ac8b3c397070467196b73dedcacf22de
I20250115 10:12:05.443672 3350 leader_election.cc:304] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.443650 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.443898 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "368df29ba175447ba4c009c7eb15a49d" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.444005 5448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.217.148:42479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.2.217.190:46859,127.2.217.189:36717,127.2.217.188:38283
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.217.189:36717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.217.189
--webserver_port=38131
--never_fsync=true
--heap_profile_path=/tmp/kudu.5448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type RELEASE
built by None at 15 Jan 2025 09:54:15 UTC on a633016ff5c9
build id 4186
I20250115 10:12:05.444238 5448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 10:12:05.444478 5448 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20250115 10:12:05.444576 4875 raft_consensus.cc:2743] T ac8b3c397070467196b73dedcacf22de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.444659 4875 raft_consensus.cc:491] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.444694 4875 raft_consensus.cc:513] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.444586 3350 leader_election.cc:304] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.444799 4875 leader_election.cc:290] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.444835 4875 raft_consensus.cc:2743] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.444777 4472 catalog_manager.cc:5526] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.444881 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]). Expected version 3 got 0
I20250115 10:12:05.444996 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.444996 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.445056 3274 raft_consensus.cc:2463] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.445063 3550 raft_consensus.cc:2463] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.445322 4335 raft_consensus.cc:491] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.445398 4335 raft_consensus.cc:513] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.444599 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b110fe6c13204cf295abb29839f3380b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.445490 4335 leader_election.cc:290] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.445721 3484 leader_election.cc:343] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.445878 3350 leader_election.cc:304] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.445910 4587 raft_consensus.cc:491] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.445947 4587 raft_consensus.cc:513] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.446055 4587 leader_election.cc:290] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.446102 4587 raft_consensus.cc:2798] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.446138 4587 raft_consensus.cc:491] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.446174 4587 raft_consensus.cc:3054] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.446409 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.446481 3550 raft_consensus.cc:2463] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.446671 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.446735 3274 raft_consensus.cc:2463] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.446877 3350 leader_election.cc:304] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.447028 4699 raft_consensus.cc:2798] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.447069 4699 raft_consensus.cc:491] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.447086 4699 raft_consensus.cc:3054] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.447696 4699 raft_consensus.cc:513] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.447825 4699 leader_election.cc:290] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.447826 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.447893 3545 raft_consensus.cc:2463] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.445876 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.448149 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 52c44b485fd84ea8a954c1eb5b8ff5b5
W20250115 10:12:05.448194 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 13abbfea00154474b1082cf8ccd14899
I20250115 10:12:05.446887 4587 raft_consensus.cc:513] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.448266 4587 leader_election.cc:290] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.448273 3215 leader_election.cc:304] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.448359 4335 raft_consensus.cc:2798] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.448401 4335 raft_consensus.cc:491] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.448423 4335 raft_consensus.cc:3054] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.448480 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_5132e5dde47e4608bbb951a93609ab7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.448583 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5132e5dde47e4608bbb951a93609ab7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.448734 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.448786 3274 raft_consensus.cc:3054] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.448809 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c94cb50778e44890bd8c4bdc868673e3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.448869 3550 raft_consensus.cc:3054] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.449090 4335 raft_consensus.cc:513] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.449198 4335 leader_election.cc:290] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.449492 3274 raft_consensus.cc:2463] T c94cb50778e44890bd8c4bdc868673e3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.449591 3550 raft_consensus.cc:2463] T c94cb50778e44890bd8c4bdc868673e3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.448783 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.449721 3280 raft_consensus.cc:3054] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.449780 3214 leader_election.cc:343] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.449818 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d1416c23bfb64fd684934aa0671cec95" } new_table_name: "default.Table_e5d9bbb0041f4c01868c87baf9d69201" modify_external_catalogs: true
I20250115 10:12:05.449884 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_efea3aa2bf48438c875eac9783634b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.450001 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efea3aa2bf48438c875eac9783634b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.450047 3350 leader_election.cc:304] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.450145 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9bf9ab1fe4b248a8970c070b58fd4ae4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.450218 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bf9ab1fe4b248a8970c070b58fd4ae4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.450348 3280 raft_consensus.cc:2463] T fa36e39d9f1c4cecbd0f6679b0397e3c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.450333 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.450405 3550 raft_consensus.cc:3054] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.450554 4569 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.450591 4569 ts_tablet_manager.cc:1397] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.001s
I20250115 10:12:05.450740 4569 raft_consensus.cc:357] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.450805 4569 raft_consensus.cc:383] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.450824 4569 raft_consensus.cc:738] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.450855 4569 consensus_queue.cc:260] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.450994 4569 ts_tablet_manager.cc:1428] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.451061 4569 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.451092 3550 raft_consensus.cc:2463] T 6fe929017262442094800c874183f5de P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.451411 3215 leader_election.cc:304] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.451407 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa36e39d9f1c4cecbd0f6679b0397e3c" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.451468 4569 tablet_bootstrap.cc:654] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.451475 3545 raft_consensus.cc:3054] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.451566 3350 leader_election.cc:304] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.451726 4699 raft_consensus.cc:2798] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.451764 4699 raft_consensus.cc:695] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.451795 4699 consensus_queue.cc:237] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.451943 5155 raft_consensus.cc:2798] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.451999 5155 raft_consensus.cc:695] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.452011 4699 raft_consensus.cc:2798] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.452055 4699 raft_consensus.cc:695] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.452042 5155 consensus_queue.cc:237] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.452095 4699 consensus_queue.cc:237] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.452131 3545 raft_consensus.cc:2463] T fa36e39d9f1c4cecbd0f6679b0397e3c P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:05.453249 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef7d25c542714a6ea0b75591aea35b9e consensus state has no leader
I20250115 10:12:05.453761 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe929017262442094800c874183f5de" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.449915 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d6892b2a17564d088d07c8ae8dcdd744"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.453918 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6892b2a17564d088d07c8ae8dcdd744 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.454802 4569 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.454846 4569 ts_tablet_manager.cc:1397] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
W20250115 10:12:05.454948 3214 leader_election.cc:343] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.454994 4569 raft_consensus.cc:357] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.455066 4569 raft_consensus.cc:383] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.455088 4569 raft_consensus.cc:738] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.455123 4569 consensus_queue.cc:260] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.455217 4569 ts_tablet_manager.cc:1428] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.455262 4569 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.455468 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet d92890d082e242ccae8ad4e40d056c74
I20250115 10:12:05.455683 4569 tablet_bootstrap.cc:654] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.455866 4557 tablet_bootstrap.cc:492] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.455916 4557 ts_tablet_manager.cc:1397] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.001s
I20250115 10:12:05.456070 4557 raft_consensus.cc:357] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.456142 4557 raft_consensus.cc:383] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.456166 4557 raft_consensus.cc:738] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.456209 4557 consensus_queue.cc:260] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.456318 4557 ts_tablet_manager.cc:1428] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.456427 4557 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:05.456669 5625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:12:05.457093 4557 tablet_bootstrap.cc:654] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.457602 4569 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.457646 4569 ts_tablet_manager.cc:1397] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:05.457775 4569 raft_consensus.cc:357] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.457852 4569 raft_consensus.cc:383] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.457871 4569 raft_consensus.cc:738] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.457921 4569 consensus_queue.cc:260] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.458061 4569 ts_tablet_manager.cc:1428] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.458076 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_efa1540f57c4480ba745894780a97e2c" } modify_external_catalogs: true
I20250115 10:12:05.458122 4569 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.458127 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_efa1540f57c4480ba745894780a97e2c" } modify_external_catalogs: true
W20250115 10:12:05.458213 5624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:12:05.458485 4569 tablet_bootstrap.cc:654] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.458644 4575 tablet_bootstrap.cc:492] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.458689 4575 ts_tablet_manager.cc:1397] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20250115 10:12:05.458842 4575 raft_consensus.cc:357] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.458900 4575 raft_consensus.cc:383] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.458922 4575 raft_consensus.cc:738] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.458963 4575 consensus_queue.cc:260] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.459065 4575 ts_tablet_manager.cc:1428] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.459059 5448 server_base.cc:1034] running on GCE node
I20250115 10:12:05.459138 4575 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.459353 3280 raft_consensus.cc:1270] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.459578 4575 tablet_bootstrap.cc:654] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.459920 4569 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.459962 4569 ts_tablet_manager.cc:1397] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:05.460016 4884 consensus_queue.cc:1035] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.460108 4569 raft_consensus.cc:357] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.460157 4569 raft_consensus.cc:383] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.460179 4569 raft_consensus.cc:738] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.460206 4884 raft_consensus.cc:491] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.460229 4569 consensus_queue.cc:260] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.460243 4884 raft_consensus.cc:513] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.460320 4884 leader_election.cc:290] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.460318 4569 ts_tablet_manager.cc:1428] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.460369 4569 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.460723 4569 tablet_bootstrap.cc:654] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.460675 4468 catalog_manager.cc:5526] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.460760 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet c94cb50778e44890bd8c4bdc868673e3 (table default.Table_8166964273cd466883c47516ef68ef46 [id=988e12ca3c094601a1189d8558614dae]). Expected version 1 got 0
I20250115 10:12:05.460791 4468 catalog_manager.cc:5526] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.460830 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet fa36e39d9f1c4cecbd0f6679b0397e3c (table default.Table_b4cf6a94f66841f9b76c78de6287614e [id=9eb9d10afdf744c78a2c4e2a5c5eed6e]). Expected version 1 got 0
I20250115 10:12:05.460995 3548 raft_consensus.cc:1270] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.461097 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9f966e26174800b640a4762bcd8306 (DEFAULT_TABLE table=default.Table_efea3aa2bf48438c875eac9783634b15 [id=55ee616299564cac95888fe0cebc1a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.461191 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9f966e26174800b640a4762bcd8306. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.461191 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 01ee606c22d7466bb44e0e5ee5190c6a (DEFAULT_TABLE table=default.Table_9bf9ab1fe4b248a8970c070b58fd4ae4 [id=1aed5ee520834fb09fd572a81410fdf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.461280 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee606c22d7466bb44e0e5ee5190c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.461325 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 01ee606c22d7466bb44e0e5ee5190c6a (DEFAULT_TABLE table=default.Table_9bf9ab1fe4b248a8970c070b58fd4ae4 [id=1aed5ee520834fb09fd572a81410fdf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.461382 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 5ac231c1b8e04e8788f7bc368a87acdb (table default.Table_8f7b91a3b92c401a871bfa219af7c377 [id=80af3453a1e347928cd24d36115345f2]). Expected version 1 got 0
I20250115 10:12:05.461408 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ee606c22d7466bb44e0e5ee5190c6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.461488 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 3d9f966e26174800b640a4762bcd8306 (DEFAULT_TABLE table=default.Table_efea3aa2bf48438c875eac9783634b15 [id=55ee616299564cac95888fe0cebc1a16]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.461557 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9f966e26174800b640a4762bcd8306. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.461596 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.461896 3411 raft_consensus.cc:1270] T a076172bba8e4878978c318d441577bd P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.462622 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.462709 3274 raft_consensus.cc:2463] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.462841 3485 leader_election.cc:304] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.463018 4731 consensus_queue.cc:1035] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.463140 3214 consensus_peers.cc:487] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.463135 4884 raft_consensus.cc:2798] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.463181 4884 raft_consensus.cc:491] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.463201 4884 raft_consensus.cc:3054] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.463871 3484 leader_election.cc:343] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.463963 4873 tablet.cc:1721] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.464167 4714 raft_consensus.cc:491] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.464205 4714 raft_consensus.cc:513] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.464273 4714 leader_election.cc:290] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.464949 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.465018 3280 raft_consensus.cc:2388] T ded005e366d4460f9acbcbb7b75397ef P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:05.465209 4875 consensus_queue.cc:1035] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.465682 4662 tablet.cc:1721] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.466537 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ded005e366d4460f9acbcbb7b75397ef" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.466962 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet a076172bba8e4878978c318d441577bd
I20250115 10:12:05.467123 3350 leader_election.cc:304] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.467259 4587 raft_consensus.cc:3054] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.467545 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet a076172bba8e4878978c318d441577bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.467617 4551 tablet_replica.cc:331] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.467672 4551 raft_consensus.cc:2238] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.467898 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet a076172bba8e4878978c318d441577bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.468014 4587 raft_consensus.cc:2743] T ded005e366d4460f9acbcbb7b75397ef P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.468052 4589 tablet_replica.cc:331] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.468116 4589 raft_consensus.cc:2238] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.468159 4589 raft_consensus.cc:2267] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.468482 4589 ts_tablet_manager.cc:1905] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.468712 4884 raft_consensus.cc:513] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.468818 4884 leader_election.cc:290] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.468894 4551 raft_consensus.cc:2267] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.469091 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.469152 3280 raft_consensus.cc:3054] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.469201 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77afc007fac49848786aaecd4d1e214" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.469488 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet cb353ea066dc474cac07e3adcfa6574d
W20250115 10:12:05.469720 3484 leader_election.cc:343] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.469825 4589 ts_tablet_manager.cc:1918] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.469889 4589 log.cc:1198] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/a076172bba8e4878978c318d441577bd
I20250115 10:12:05.469983 4551 ts_tablet_manager.cc:1905] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.470101 4589 ts_tablet_manager.cc:1939] T a076172bba8e4878978c318d441577bd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.469828 3280 raft_consensus.cc:2463] T c77afc007fac49848786aaecd4d1e214 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.470469 3485 leader_election.cc:304] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.470551 4884 raft_consensus.cc:2798] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.470595 4884 raft_consensus.cc:695] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.470630 4884 consensus_queue.cc:237] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.471411 4551 ts_tablet_manager.cc:1918] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.471464 4551 log.cc:1198] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/a076172bba8e4878978c318d441577bd
I20250115 10:12:05.471655 4551 ts_tablet_manager.cc:1939] T a076172bba8e4878978c318d441577bd P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.471818 3544 raft_consensus.cc:3054] T 4831e3d84c4d4f08bc5e6fa145a3c1a5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.472008 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]) successfully deleted
I20250115 10:12:05.472514 4557 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.472558 4557 ts_tablet_manager.cc:1397] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20250115 10:12:05.472620 4575 tablet_bootstrap.cc:492] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.472659 4575 ts_tablet_manager.cc:1397] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:05.472699 4557 raft_consensus.cc:357] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.472760 4557 raft_consensus.cc:383] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.472779 4557 raft_consensus.cc:738] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.472779 4575 raft_consensus.cc:357] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.472833 4575 raft_consensus.cc:383] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.472817 4557 consensus_queue.cc:260] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.472851 4575 raft_consensus.cc:738] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.472890 4575 consensus_queue.cc:260] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.472918 4557 ts_tablet_manager.cc:1428] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.472971 4557 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.472982 4575 ts_tablet_manager.cc:1428] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.473054 4575 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.473172 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet ef7f182c4bde468d919523c44fdf3ea4 (table default.Table_01cee5e7893944e280e7f3faa9b07f1c [id=6637d1f036c34aeeae9d1cc84697d2f6]). Expected version 2 got 0
I20250115 10:12:05.473119 4471 catalog_manager.cc:5526] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129). New cstate: current_term: 1 leader_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.473225 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.473243 4471 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 6fe929017262442094800c874183f5de (table default.Table_7829e841e23544828bd612b8a8f2fac7 [id=e4b456b89a024d11964fbb3c4bef3000]). Expected version 1 got 0
I20250115 10:12:05.473424 4557 tablet_bootstrap.cc:654] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.473516 4575 tablet_bootstrap.cc:654] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.474620 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet a076172bba8e4878978c318d441577bd (table default.Table_efa1540f57c4480ba745894780a97e2c [id=e6046db0b8984811a7d5bfec97d66f82]) successfully deleted
I20250115 10:12:05.474658 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet a076172bba8e4878978c318d441577bd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.474684 3530 tablet_service.cc:1467] Processing CreateTablet for tablet a426b1741f0a47899654fb296165a1de (DEFAULT_TABLE table=default.Table_d6892b2a17564d088d07c8ae8dcdd744 [id=e8024d2e7d6744bb81195c1858eafb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.474771 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a426b1741f0a47899654fb296165a1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.475000 3257 tablet_service.cc:1467] Processing CreateTablet for tablet ba5f93cfc5274d8cb9e587507c6bac08 (DEFAULT_TABLE table=default.Table_5132e5dde47e4608bbb951a93609ab7d [id=a278f2af4212459cb9d98cb8f92fa762]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.475100 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5f93cfc5274d8cb9e587507c6bac08. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.475889 4463 catalog_manager.cc:4839] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet a076172bba8e4878978c318d441577bd because the tablet was not found. No further retry: Not found: Tablet not found: a076172bba8e4878978c318d441577bd
I20250115 10:12:05.476261 3244 tablet_service.cc:1467] Processing CreateTablet for tablet a426b1741f0a47899654fb296165a1de (DEFAULT_TABLE table=default.Table_d6892b2a17564d088d07c8ae8dcdd744 [id=e8024d2e7d6744bb81195c1858eafb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.476367 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a426b1741f0a47899654fb296165a1de. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.476954 3514 tablet_service.cc:1467] Processing CreateTablet for tablet ba5f93cfc5274d8cb9e587507c6bac08 (DEFAULT_TABLE table=default.Table_5132e5dde47e4608bbb951a93609ab7d [id=a278f2af4212459cb9d98cb8f92fa762]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.477059 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5f93cfc5274d8cb9e587507c6bac08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.477761 4468 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_9b48b884243648098f6fdb2a7ec28a2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.477876 4468 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b48b884243648098f6fdb2a7ec28a2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:05.478145 5627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 10:12:05.478475 5448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 10:12:05.478770 5448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 10:12:05.479291 4472 catalog_manager.cc:5526] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f reported cstate change: term changed from 0 to 1, leader changed from <none> to 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131). New cstate: current_term: 1 leader_uuid: "89067c97cc1c45e699ee9f690cb3014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: HEALTHY } } }
I20250115 10:12:05.479405 4472 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 4f6baabd5aba4363ae13e5da601a9de8 (table default.Table_04b06145d63b4efc890eb4dd9de6ad70 [id=a40af02ec1c44e6793892c2ff586c534]). Expected version 1 got 0
W20250115 10:12:05.479640 4471 catalog_manager.cc:5359] Ignoring report from unknown tablet 575f1a39f8a54c4cb21cd17d562c0542
I20250115 10:12:05.480520 4587 raft_consensus.cc:491] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.480566 4587 raft_consensus.cc:513] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.480650 4587 leader_election.cc:290] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.483765 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.483851 3280 raft_consensus.cc:2463] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.483892 3244 tablet_service.cc:1467] Processing CreateTablet for tablet a3058e3d2d064fdca70bb3c4eb660be9 (DEFAULT_TABLE table=default.Table_9b48b884243648098f6fdb2a7ec28a2c [id=92e48834cf6b4e58a30e208565a4e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.483937 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.483996 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3058e3d2d064fdca70bb3c4eb660be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.484021 3350 leader_election.cc:304] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.484037 4587 consensus_queue.cc:1035] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.484114 4875 raft_consensus.cc:2798] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.484148 4875 raft_consensus.cc:491] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.484165 4875 raft_consensus.cc:3054] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.484301 3350 leader_election.cc:343] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.484301 3514 tablet_service.cc:1467] Processing CreateTablet for tablet a3058e3d2d064fdca70bb3c4eb660be9 (DEFAULT_TABLE table=default.Table_9b48b884243648098f6fdb2a7ec28a2c [id=92e48834cf6b4e58a30e208565a4e5d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.484381 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3058e3d2d064fdca70bb3c4eb660be9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.484843 4875 raft_consensus.cc:513] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.484963 4875 leader_election.cc:290] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.485503 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.485688 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.485759 3280 raft_consensus.cc:3054] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.485792 3350 leader_election.cc:343] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.486428 3280 raft_consensus.cc:2463] T 50d2f7ec7d44422ebc35e29797bfd456 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.486771 4472 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.488031 3350 leader_election.cc:304] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.488139 4714 raft_consensus.cc:2798] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.488195 4714 raft_consensus.cc:695] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.488227 4714 consensus_queue.cc:237] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.488654 4468 catalog_manager.cc:5618] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.489355 4468 catalog_manager.cc:5526] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130). New cstate: current_term: 1 leader_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } health_report { overall_health: UNKNOWN } } }
I20250115 10:12:05.489472 4468 catalog_manager.cc:5618] TS 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883) does not have the latest schema for tablet 50d2f7ec7d44422ebc35e29797bfd456 (table default.Table_d14cdcb7908e4c8f86daf6cd8206d8ea [id=91e9035cba7c42abb74215841786d872]). Expected version 1 got 0
I20250115 10:12:05.490173 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c616e68e0b9b48d18cd59e580a3c8b89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.490311 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c616e68e0b9b48d18cd59e580a3c8b89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.492031 4731 consensus_queue.cc:1035] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.492714 4877 consensus_queue.cc:1035] T 8600883e5a5449c59a747a6ef2121c61 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.493064 4731 raft_consensus.cc:491] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.493116 4731 raft_consensus.cc:513] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.493213 4731 leader_election.cc:290] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.494277 5448 hybrid_clock.cc:648] HybridClock initialized: now 1736935925493883 us; error 397 us; skew 500 ppm
I20250115 10:12:05.494647 4811 consensus_queue.cc:1035] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.495209 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.495282 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.495381 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a612decf0634bd588f45c8953c6b201" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.495481 3550 raft_consensus.cc:2388] T 0a612decf0634bd588f45c8953c6b201 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:05.496268 5448 webserver.cc:458] Webserver started at http://127.2.217.189:38131/ using document root <none> and password file <none>
I20250115 10:12:05.496505 5448 fs_manager.cc:362] Metadata directory not provided
I20250115 10:12:05.496554 5448 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 10:12:05.497599 4731 raft_consensus.cc:491] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.497656 4731 raft_consensus.cc:513] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.497606 3215 leader_election.cc:304] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.497746 4731 leader_election.cc:290] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.497825 5155 raft_consensus.cc:3054] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.498193 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.498569 5155 raft_consensus.cc:2743] T 0a612decf0634bd588f45c8953c6b201 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.498693 3214 leader_election.cc:343] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.499112 4472 catalog_manager.cc:5359] Ignoring report from unknown tablet 0fbb9cfc01df408eaae41b38e8c62c86
I20250115 10:12:05.499115 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.499186 3550 raft_consensus.cc:2463] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.499694 3215 leader_election.cc:304] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.499886 4731 raft_consensus.cc:2798] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.499918 4731 raft_consensus.cc:491] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.499892 3550 raft_consensus.cc:3054] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.499943 4731 raft_consensus.cc:3054] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.500623 4731 raft_consensus.cc:513] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.500725 4731 leader_election.cc:290] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.500784 4468 catalog_manager.cc:5359] Ignoring report from unknown tablet c64affc7645145069d6197ede241585e
I20250115 10:12:05.501243 3274 raft_consensus.cc:1270] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.501324 4873 tablet.cc:1721] T 3f81769b500149f7b2bf7cdf76f7ee27 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.501323 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.501384 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.501435 3547 raft_consensus.cc:3054] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.502044 3244 tablet_service.cc:1467] Processing CreateTablet for tablet aabd5a3b48f94e72b9ae4ab0dd768bad (DEFAULT_TABLE table=default.Table_c616e68e0b9b48d18cd59e580a3c8b89 [id=3d1a9f3c1eac456e89dbf60ebcaa5b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.502077 3514 tablet_service.cc:1467] Processing CreateTablet for tablet aabd5a3b48f94e72b9ae4ab0dd768bad (DEFAULT_TABLE table=default.Table_c616e68e0b9b48d18cd59e580a3c8b89 [id=3d1a9f3c1eac456e89dbf60ebcaa5b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.502151 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabd5a3b48f94e72b9ae4ab0dd768bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.502187 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aabd5a3b48f94e72b9ae4ab0dd768bad. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.502382 3484 consensus_peers.cc:487] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.502414 4472 catalog_manager.cc:5618] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457) does not have the latest schema for tablet 8600883e5a5449c59a747a6ef2121c61 (table default.Table_80740761a0fe4a649dcd9095d47fc312 [id=a4e2127fb8624f16afed55f89d949842]). Expected version 2 got 0
I20250115 10:12:05.502096 3547 raft_consensus.cc:2463] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.502732 3215 leader_election.cc:304] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.503449 3214 leader_election.cc:343] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.503463 4887 consensus_queue.cc:1035] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.503885 5155 raft_consensus.cc:2798] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.503930 5155 raft_consensus.cc:695] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.503974 5155 consensus_queue.cc:237] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.504469 5410 tablet.cc:1721] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.505676 4662 tablet.cc:1721] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.506085 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9b65c31a83d94905b61daa407d4fad12" } modify_external_catalogs: true
I20250115 10:12:05.506151 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9b65c31a83d94905b61daa407d4fad12" } modify_external_catalogs: true
I20250115 10:12:05.507936 4468 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b91694124a9c4d13bba0239c6c992767" } modify_external_catalogs: true
I20250115 10:12:05.507999 4468 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b91694124a9c4d13bba0239c6c992767" } modify_external_catalogs: true
I20250115 10:12:05.508440 5448 fs_manager.cc:714] Time spent opening directory manager: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:05.508466 4557 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.508499 4557 ts_tablet_manager.cc:1397] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.001s
I20250115 10:12:05.508682 4557 raft_consensus.cc:357] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.508736 4557 raft_consensus.cc:383] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.508752 4557 raft_consensus.cc:738] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.508787 4557 consensus_queue.cc:260] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.508903 4557 ts_tablet_manager.cc:1428] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.508970 4557 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.509295 3410 raft_consensus.cc:3054] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.509363 4557 tablet_bootstrap.cc:654] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.509545 3215 consensus_peers.cc:487] T 0fbb9cfc01df408eaae41b38e8c62c86 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fbb9cfc01df408eaae41b38e8c62c86. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.510053 3410 raft_consensus.cc:1270] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.510257 5659 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.510314 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 63b83ca446824b88978e3dc3269d43a3
I20250115 10:12:05.510421 5448 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:05.510516 4335 consensus_queue.cc:1035] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.510476 5448 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data,/tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
uuid: "efd4346420bb4a5abb9cf66799e35565"
format_stamp: "Formatted at 2025-01-15 10:11:50 on dist-test-slave-lj0b"
I20250115 10:12:05.510850 3547 raft_consensus.cc:1270] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Refusing update from remote peer 4c9ab337b4ea47d18b4208d424cf5fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.510866 5448 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 10:12:05.510917 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 63b83ca446824b88978e3dc3269d43a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.510996 4589 tablet_replica.cc:331] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.511051 4589 raft_consensus.cc:2238] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.511086 4589 raft_consensus.cc:2267] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.511138 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f1f5e83fd8f245b786be6c97dcbece10" } modify_external_catalogs: true
I20250115 10:12:05.511183 4589 ts_tablet_manager.cc:1905] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.511202 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f1f5e83fd8f245b786be6c97dcbece10" } modify_external_catalogs: true
I20250115 10:12:05.512277 4575 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.512320 4575 ts_tablet_manager.cc:1397] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.000s
I20250115 10:12:05.512440 4589 ts_tablet_manager.cc:1918] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.512481 4589 log.cc:1198] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/63b83ca446824b88978e3dc3269d43a3
I20250115 10:12:05.512455 4575 raft_consensus.cc:357] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.512521 4575 raft_consensus.cc:383] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.512539 4575 raft_consensus.cc:738] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.512571 4575 consensus_queue.cc:260] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.512624 4589 ts_tablet_manager.cc:1939] T 63b83ca446824b88978e3dc3269d43a3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.512671 4575 ts_tablet_manager.cc:1428] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.512727 4575 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.513226 4575 tablet_bootstrap.cc:654] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.514706 4569 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.514745 4569 ts_tablet_manager.cc:1397] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.001s
I20250115 10:12:05.514868 4569 raft_consensus.cc:357] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.514909 4569 raft_consensus.cc:383] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.514922 4569 raft_consensus.cc:738] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.514953 4569 consensus_queue.cc:260] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.515044 4569 ts_tablet_manager.cc:1428] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.515091 4569 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.515473 4569 tablet_bootstrap.cc:654] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.515542 4811 raft_consensus.cc:491] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.515612 4811 raft_consensus.cc:513] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.515749 4811 leader_election.cc:290] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.516279 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 63b83ca446824b88978e3dc3269d43a3 (table default.Table_9b65c31a83d94905b61daa407d4fad12 [id=cddc37a811ad4077aa90d716f64dcd5c]) successfully deleted
I20250115 10:12:05.516584 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4cbd61aec79d479d9eea8d807cd5fb0e
I20250115 10:12:05.517041 4575 tablet_bootstrap.cc:492] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.517086 4575 ts_tablet_manager.cc:1397] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:05.517138 5156 consensus_queue.cc:1035] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.517220 4575 raft_consensus.cc:357] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.517266 4575 raft_consensus.cc:383] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.517283 4575 raft_consensus.cc:738] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.517316 4575 consensus_queue.cc:260] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.517413 4575 ts_tablet_manager.cc:1428] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.517458 4575 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.517673 4662 tablet.cc:1721] T ef7f182c4bde468d919523c44fdf3ea4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.513935 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 63b83ca446824b88978e3dc3269d43a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.517877 4575 tablet_bootstrap.cc:654] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.518102 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.518187 3280 raft_consensus.cc:2388] T c68f61c8b72b4628bba5c52f8025a240 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:05.518213 3770 raft_consensus.cc:491] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.518266 3770 raft_consensus.cc:513] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.518352 3770 leader_election.cc:290] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.518455 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 63b83ca446824b88978e3dc3269d43a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 63b83ca446824b88978e3dc3269d43a3 already in progress: creating tablet
I20250115 10:12:05.518494 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cbd61aec79d479d9eea8d807cd5fb0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.519274 4551 tablet_replica.cc:331] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.519362 4551 raft_consensus.cc:2238] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.516166 4884 raft_consensus.cc:491] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.519428 4551 raft_consensus.cc:2267] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.519424 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 4cbd61aec79d479d9eea8d807cd5fb0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.519445 4884 raft_consensus.cc:513] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.519469 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3a999e14271a47049b8197ec2cf8f179
I20250115 10:12:05.519495 4589 tablet_replica.cc:331] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.519547 4589 raft_consensus.cc:2238] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.519537 4551 ts_tablet_manager.cc:1905] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.519590 4589 raft_consensus.cc:2267] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.519676 4589 ts_tablet_manager.cc:1905] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.516228 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c68f61c8b72b4628bba5c52f8025a240" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.520722 3350 leader_election.cc:304] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.520798 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.520864 3546 raft_consensus.cc:2463] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.521037 4551 ts_tablet_manager.cc:1918] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.521075 4551 log.cc:1198] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/4cbd61aec79d479d9eea8d807cd5fb0e
I20250115 10:12:05.521270 4551 ts_tablet_manager.cc:1939] T 4cbd61aec79d479d9eea8d807cd5fb0e P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.521373 4699 raft_consensus.cc:3054] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.521621 3550 raft_consensus.cc:3054] T 3402dc674ab0402f8e0bdd7b8db4b88d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.519536 4884 leader_election.cc:290] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.522035 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet eb79611319a8480da63394d0a77c1488 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.522019 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.522089 3280 raft_consensus.cc:2463] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.522109 4699 raft_consensus.cc:2743] T c68f61c8b72b4628bba5c52f8025a240 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.522418 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19fbbc203da54d48bb0b47a9a2218ae2" } modify_external_catalogs: true
I20250115 10:12:05.522492 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_19fbbc203da54d48bb0b47a9a2218ae2" } modify_external_catalogs: true
I20250115 10:12:05.516887 4557 tablet_bootstrap.cc:492] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.522740 4557 ts_tablet_manager.cc:1397] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:05.522886 4557 raft_consensus.cc:357] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.522948 4557 raft_consensus.cc:383] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.522974 4557 raft_consensus.cc:738] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.523020 4557 consensus_queue.cc:260] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.523031 3215 leader_election.cc:304] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.523036 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a999e14271a47049b8197ec2cf8f179 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.523129 4557 ts_tablet_manager.cc:1428] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.523129 5155 raft_consensus.cc:2798] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.523171 5155 raft_consensus.cc:491] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.523190 4557 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.523191 5155 raft_consensus.cc:3054] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.523391 4811 consensus_queue.cc:1035] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.523633 4557 tablet_bootstrap.cc:654] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.523669 4589 ts_tablet_manager.cc:1918] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.523733 4589 log.cc:1198] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/4cbd61aec79d479d9eea8d807cd5fb0e
I20250115 10:12:05.523953 4589 ts_tablet_manager.cc:1939] T 4cbd61aec79d479d9eea8d807cd5fb0e P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.523983 5155 raft_consensus.cc:513] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.524040 3485 leader_election.cc:304] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.524087 5155 leader_election.cc:290] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.524362 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.524408 4873 tablet.cc:1721] T ef7f182c4bde468d919523c44fdf3ea4 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.524428 3411 raft_consensus.cc:2463] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.525275 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.525648 4434 raft_consensus.cc:2798] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.525698 4434 raft_consensus.cc:491] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.525722 4434 raft_consensus.cc:3054] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.526017 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]) successfully deleted
I20250115 10:12:05.526237 3770 raft_consensus.cc:491] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.526288 3770 raft_consensus.cc:513] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.526337 4434 raft_consensus.cc:513] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.526386 3770 leader_election.cc:290] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.526433 4434 leader_election.cc:290] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.526487 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.526537 3546 raft_consensus.cc:3054] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.523129 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a999e14271a47049b8197ec2cf8f179 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.526997 3214 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.526999 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3a999e14271a47049b8197ec2cf8f179 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a999e14271a47049b8197ec2cf8f179 already in progress: creating tablet
I20250115 10:12:05.527189 3546 raft_consensus.cc:2463] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.527578 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3067eaaa090b4ffb95b2e741453113ed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.527660 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.527701 3414 raft_consensus.cc:2463] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.527721 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet eb79611319a8480da63394d0a77c1488
I20250115 10:12:05.527798 4468 catalog_manager.cc:6596] ReplaceTablet: tablet eb79611319a8480da63394d0a77c1488 deleted and replaced by tablet 9973683d920f427f927230e45fe06a8a
W20250115 10:12:05.527886 3214 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.527966 3214 leader_election.cc:304] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.528018 4699 raft_consensus.cc:491] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.528023 4335 consensus_queue.cc:1035] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.528041 5155 raft_consensus.cc:2798] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.528056 4699 raft_consensus.cc:513] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.528092 5155 raft_consensus.cc:491] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.528119 5155 raft_consensus.cc:3054] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.528147 4699 leader_election.cc:290] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.528234 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.528282 3412 raft_consensus.cc:3054] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.528450 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.528525 3546 raft_consensus.cc:2463] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.528815 5155 raft_consensus.cc:513] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.528910 5155 leader_election.cc:290] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.528949 3412 raft_consensus.cc:2463] T 4283a096b18b4be69e1f57e60c3efd3e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.529036 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4283a096b18b4be69e1f57e60c3efd3e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.529071 3280 raft_consensus.cc:1270] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.529098 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.529093 3274 raft_consensus.cc:3054] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.529209 3215 leader_election.cc:304] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.529296 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.529338 3546 raft_consensus.cc:3054] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.529402 4335 raft_consensus.cc:2798] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.529438 4335 raft_consensus.cc:695] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.529470 4335 consensus_queue.cc:237] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.529737 4338 consensus_queue.cc:1035] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.529776 3274 raft_consensus.cc:2463] T 4283a096b18b4be69e1f57e60c3efd3e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.529856 3546 raft_consensus.cc:2463] T 46b8efd1622a4efcb009f999cb915dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:05.529881 3484 consensus_peers.cc:487] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20250115 10:12:05.529901 3350 leader_election.cc:343] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.529937 3484 leader_election.cc:304] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.529991 4433 raft_consensus.cc:2798] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.530025 4433 raft_consensus.cc:695] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.530059 4433 consensus_queue.cc:237] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.530457 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet eb79611319a8480da63394d0a77c1488 with delete_type TABLET_DATA_DELETED (replaced by tablet 9973683d920f427f927230e45fe06a8a) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.530546 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet eb79611319a8480da63394d0a77c1488 with delete_type TABLET_DATA_DELETED (replaced by tablet 9973683d920f427f927230e45fe06a8a) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.530695 3215 leader_election.cc:304] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.530738 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.530831 3280 raft_consensus.cc:2463] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.530870 3770 raft_consensus.cc:2798] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.530912 3770 raft_consensus.cc:695] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.530948 3770 consensus_queue.cc:237] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.531380 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46b8efd1622a4efcb009f999cb915dfc" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.531414 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet eb79611319a8480da63394d0a77c1488 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb79611319a8480da63394d0a77c1488 already in progress: creating tablet
I20250115 10:12:05.531455 3414 raft_consensus.cc:3054] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.531984 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_79b67e4487a144728cdd614905baf575" } new_table_name: "default.Table_5b8eb78b10be4d029426017a849db377" modify_external_catalogs: true
I20250115 10:12:05.532284 3414 raft_consensus.cc:2463] T 46b8efd1622a4efcb009f999cb915dfc P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.532528 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3067eaaa090b4ffb95b2e741453113ed
I20250115 10:12:05.534474 3350 leader_election.cc:304] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.534514 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 3067eaaa090b4ffb95b2e741453113ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.534839 4811 raft_consensus.cc:2798] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.534879 4811 raft_consensus.cc:491] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.534897 4811 raft_consensus.cc:3054] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.535499 4811 raft_consensus.cc:513] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.535604 4811 leader_election.cc:290] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.536145 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
W20250115 10:12:05.536551 4468 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b07efa65ed754b75abfbe4869593ab78 consensus state has no leader
I20250115 10:12:05.536947 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 3067eaaa090b4ffb95b2e741453113ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.537083 4589 tablet_replica.cc:331] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.537144 4589 raft_consensus.cc:2238] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.537187 4589 pending_rounds.cc:62] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:05.537202 4589 pending_rounds.cc:69] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489550967058432 op_type: NO_OP noop_request { }
I20250115 10:12:05.537232 4589 raft_consensus.cc:2883] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:05.537250 4589 raft_consensus.cc:2267] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.538185 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 4f463f01967047228f944c907a162056 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.538211 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 9973683d920f427f927230e45fe06a8a (DEFAULT_TABLE table=default.Table_87743a88b9cd4bbc816cf305d189bf4c [id=e36695cdb085421a99f6424f42b347ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.538307 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9973683d920f427f927230e45fe06a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.539064 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 9973683d920f427f927230e45fe06a8a (DEFAULT_TABLE table=default.Table_87743a88b9cd4bbc816cf305d189bf4c [id=e36695cdb085421a99f6424f42b347ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.539165 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9973683d920f427f927230e45fe06a8a. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.539166 3350 leader_election.cc:343] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.539224 3350 consensus_peers.cc:487] T fc6b5ec8e472414789f9619ae958fa34 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc6b5ec8e472414789f9619ae958fa34. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.539696 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.539908 3280 raft_consensus.cc:3054] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.540032 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet edab5a12fb714e689abee39bcbadb86b from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.540572 3280 raft_consensus.cc:2463] T f682c7942a454d86a5df19eeac533361 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.541617 4551 tablet_replica.cc:331] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.541666 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 4f463f01967047228f944c907a162056
I20250115 10:12:05.541700 4551 raft_consensus.cc:2238] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.541731 4551 raft_consensus.cc:2267] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.541767 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 4f463f01967047228f944c907a162056 deleted and replaced by tablet 70c0c9d83cb24aa4ba2579479126a849
I20250115 10:12:05.541826 4551 ts_tablet_manager.cc:1905] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.542761 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 4cbd61aec79d479d9eea8d807cd5fb0e (table default.Table_b91694124a9c4d13bba0239c6c992767 [id=4d3a10d579954f9099286160f2a3006d]) successfully deleted
W20250115 10:12:05.542831 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3a999e14271a47049b8197ec2cf8f179 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a999e14271a47049b8197ec2cf8f179 already in progress: creating tablet
W20250115 10:12:05.542884 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet eb79611319a8480da63394d0a77c1488 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb79611319a8480da63394d0a77c1488 already in progress: creating tablet
I20250115 10:12:05.543131 4551 ts_tablet_manager.cc:1918] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.543174 4551 log.cc:1198] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/3067eaaa090b4ffb95b2e741453113ed
I20250115 10:12:05.543366 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f463f01967047228f944c907a162056 with delete_type TABLET_DATA_DELETED (replaced by tablet 70c0c9d83cb24aa4ba2579479126a849) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.543495 3350 leader_election.cc:304] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.543569 4811 raft_consensus.cc:2798] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.543614 4811 raft_consensus.cc:695] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.543655 4811 consensus_queue.cc:237] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.544024 3215 consensus_peers.cc:487] T 0d5cf0e380d348f1ae2f05db1a010a19 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.544116 4551 ts_tablet_manager.cc:1939] T 3067eaaa090b4ffb95b2e741453113ed P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.544590 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f463f01967047228f944c907a162056 with delete_type TABLET_DATA_DELETED (replaced by tablet 70c0c9d83cb24aa4ba2579479126a849) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.545161 4699 consensus_queue.cc:1035] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.545431 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]) successfully deleted
W20250115 10:12:05.545529 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 4f463f01967047228f944c907a162056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f463f01967047228f944c907a162056 already in progress: creating tablet
I20250115 10:12:05.545997 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet edab5a12fb714e689abee39bcbadb86b
I20250115 10:12:05.546072 4472 catalog_manager.cc:6596] ReplaceTablet: tablet edab5a12fb714e689abee39bcbadb86b deleted and replaced by tablet c24d934d52984da29e1ddbaf569c4354
I20250115 10:12:05.547428 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet edab5a12fb714e689abee39bcbadb86b with delete_type TABLET_DATA_DELETED (replaced by tablet c24d934d52984da29e1ddbaf569c4354) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.547526 3214 consensus_peers.cc:487] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.547559 4434 consensus_queue.cc:1035] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.547869 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet edab5a12fb714e689abee39bcbadb86b with delete_type TABLET_DATA_DELETED (replaced by tablet c24d934d52984da29e1ddbaf569c4354) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:05.549551 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet edab5a12fb714e689abee39bcbadb86b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edab5a12fb714e689abee39bcbadb86b already in progress: creating tablet
W20250115 10:12:05.550217 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 12082ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
W20250115 10:12:05.550555 3350 consensus_peers.cc:487] T 166e6390660c485c99b2e115fd1b272f P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 166e6390660c485c99b2e115fd1b272f. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.550650 4699 consensus_queue.cc:1035] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.552074 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 70c0c9d83cb24aa4ba2579479126a849 (DEFAULT_TABLE table=default.Table_30b3e0325fa54d5281f683f1b664c721 [id=1e1ac1a58e574da5bdd1d23d45b98717]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.552178 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c0c9d83cb24aa4ba2579479126a849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.552557 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 70c0c9d83cb24aa4ba2579479126a849 (DEFAULT_TABLE table=default.Table_30b3e0325fa54d5281f683f1b664c721 [id=1e1ac1a58e574da5bdd1d23d45b98717]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.552677 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70c0c9d83cb24aa4ba2579479126a849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.554373 5156 consensus_queue.cc:1035] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.554719 4338 consensus_queue.cc:1035] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.554805 4434 consensus_queue.cc:1035] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.556661 4908 consensus_queue.cc:1035] T 98993cb75de34c0babb894a5d17d6d12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.556756 3530 tablet_service.cc:1467] Processing CreateTablet for tablet c24d934d52984da29e1ddbaf569c4354 (DEFAULT_TABLE table=default.Table_9eec2d8d491247178912089523c4f45a [id=dd70b028eac1438daa6f74ef6c1efd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.556867 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24d934d52984da29e1ddbaf569c4354. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.558202 5670 consensus_queue.cc:1159] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
W20250115 10:12:05.558435 3484 consensus_peers.cc:487] T aef601e6f3ef4ba387164c239c1139b0 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.558658 4589 ts_tablet_manager.cc:1905] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.559396 3244 tablet_service.cc:1467] Processing CreateTablet for tablet c24d934d52984da29e1ddbaf569c4354 (DEFAULT_TABLE table=default.Table_9eec2d8d491247178912089523c4f45a [id=dd70b028eac1438daa6f74ef6c1efd76]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.559495 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24d934d52984da29e1ddbaf569c4354. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.559993 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_ea54e14fe9b8407eaea2930768da997b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.560109 4884 consensus_queue.cc:1035] T c68f61c8b72b4628bba5c52f8025a240 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.560144 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea54e14fe9b8407eaea2930768da997b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.560701 4884 raft_consensus.cc:491] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.560751 4884 raft_consensus.cc:513] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.560843 4884 leader_election.cc:290] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.561141 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.561220 3412 raft_consensus.cc:2388] T bf882dcd84be4b38af533b64dfb4fd95 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.561342 4589 ts_tablet_manager.cc:1918] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.561396 4589 log.cc:1198] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/3067eaaa090b4ffb95b2e741453113ed
I20250115 10:12:05.561609 4589 ts_tablet_manager.cc:1939] T 3067eaaa090b4ffb95b2e741453113ed P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.561856 3412 raft_consensus.cc:1270] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.561861 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 2254763251ed40099e200580b750badc from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.562077 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bf882dcd84be4b38af533b64dfb4fd95" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.562183 4884 consensus_queue.cc:1035] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.562228 3275 raft_consensus.cc:1270] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.562357 4884 raft_consensus.cc:491] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.562403 4884 raft_consensus.cc:513] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.562419 3485 leader_election.cc:304] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.562494 4884 leader_election.cc:290] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.562534 4884 raft_consensus.cc:3054] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.562624 4433 consensus_queue.cc:1035] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.562779 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.562845 3277 raft_consensus.cc:2463] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.563041 3485 leader_election.cc:304] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.563275 4884 raft_consensus.cc:2743] T bf882dcd84be4b38af533b64dfb4fd95 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.563325 4434 raft_consensus.cc:2798] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.563375 4434 raft_consensus.cc:491] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.563396 4434 raft_consensus.cc:3054] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.563761 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_db89e915c0324473bf6dfc46c3a3dbe2" } new_table_name: "default.Table_99b3a875aba84e8a9017edfb2cea8ffc" modify_external_catalogs: true
I20250115 10:12:05.564158 4434 raft_consensus.cc:513] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.564282 4434 leader_election.cc:290] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.564318 4434 raft_consensus.cc:491] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.564350 4434 raft_consensus.cc:513] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.564397 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.564412 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.564460 3277 raft_consensus.cc:3054] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.564464 4434 leader_election.cc:290] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.564471 3414 raft_consensus.cc:2463] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:05.564653 3484 consensus_peers.cc:487] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.565214 3277 raft_consensus.cc:2463] T 14a9663596174aa1b72ce71e49183a2b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.565384 3485 leader_election.cc:304] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.565423 4468 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 2254763251ed40099e200580b750badc
I20250115 10:12:05.565479 4468 catalog_manager.cc:6596] ReplaceTablet: tablet 2254763251ed40099e200580b750badc deleted and replaced by tablet cdd7b2e3ac2c46b3863d33f2d5cc4493
I20250115 10:12:05.565465 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.565565 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14a9663596174aa1b72ce71e49183a2b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.565604 3414 raft_consensus.cc:3054] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.566056 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0496864e655e40dfac38619adbf4fd87" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.566272 3414 raft_consensus.cc:2463] T 14a9663596174aa1b72ce71e49183a2b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.566368 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 2254763251ed40099e200580b750badc with delete_type TABLET_DATA_DELETED (replaced by tablet cdd7b2e3ac2c46b3863d33f2d5cc4493) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.566495 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 2254763251ed40099e200580b750badc with delete_type TABLET_DATA_DELETED (replaced by tablet cdd7b2e3ac2c46b3863d33f2d5cc4493) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.566664 4338 raft_consensus.cc:2798] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.566735 4338 raft_consensus.cc:695] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.566792 4338 consensus_queue.cc:237] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.566931 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 2254763251ed40099e200580b750badc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2254763251ed40099e200580b750badc already in progress: creating tablet
I20250115 10:12:05.567760 4873 tablet.cc:1721] T 8dde69ff2f574d838d81bea5a53700f5 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.567878 3485 leader_election.cc:304] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.567950 4433 raft_consensus.cc:2743] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.568153 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet c64affc7645145069d6197ede241585e from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.569833 4662 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.569962 4890 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.570269 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 3067eaaa090b4ffb95b2e741453113ed (table default.Table_19fbbc203da54d48bb0b47a9a2218ae2 [id=b91eeff9fcae44c1b1f223167ae810d3]) successfully deleted
W20250115 10:12:05.570336 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 4f463f01967047228f944c907a162056 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f463f01967047228f944c907a162056 already in progress: creating tablet
W20250115 10:12:05.570370 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet edab5a12fb714e689abee39bcbadb86b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet edab5a12fb714e689abee39bcbadb86b already in progress: creating tablet
W20250115 10:12:05.570415 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 2254763251ed40099e200580b750badc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2254763251ed40099e200580b750badc already in progress: creating tablet
I20250115 10:12:05.570930 4811 consensus_queue.cc:1035] T 06c5994686054f51802fb9125beb85c4 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.570991 4890 tablet.cc:1721] T 8dde69ff2f574d838d81bea5a53700f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.571290 4873 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.573199 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 9b411b205211442ab38d261b22c97d07 (DEFAULT_TABLE table=default.Table_ea54e14fe9b8407eaea2930768da997b [id=847e7acd366b4b808ce172b75b9a482a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.573297 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b411b205211442ab38d261b22c97d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.573344 3530 tablet_service.cc:1467] Processing CreateTablet for tablet cdd7b2e3ac2c46b3863d33f2d5cc4493 (DEFAULT_TABLE table=default.Table_a59b4ec5ddf041bfbd28831ba2e64618 [id=c34227d535d94e638570be645381622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.573441 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd7b2e3ac2c46b3863d33f2d5cc4493. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.574388 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 9b411b205211442ab38d261b22c97d07 (DEFAULT_TABLE table=default.Table_ea54e14fe9b8407eaea2930768da997b [id=847e7acd366b4b808ce172b75b9a482a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.574482 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b411b205211442ab38d261b22c97d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.574762 4811 raft_consensus.cc:491] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.574806 4811 raft_consensus.cc:513] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.574904 4811 leader_election.cc:290] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.575053 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.575268 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1b423922cbb4a42bbdb4de025227118" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:05.575448 3350 consensus_peers.cc:487] T 12379200d11e4ed3800f609d34a54ea7 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.575644 3350 leader_election.cc:304] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.575739 4811 raft_consensus.cc:2743] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.576131 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_45596fab1ea44ddbae9052372afb76f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.576254 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45596fab1ea44ddbae9052372afb76f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.576748 3244 tablet_service.cc:1467] Processing CreateTablet for tablet cdd7b2e3ac2c46b3863d33f2d5cc4493 (DEFAULT_TABLE table=default.Table_a59b4ec5ddf041bfbd28831ba2e64618 [id=c34227d535d94e638570be645381622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.577140 4887 consensus_queue.cc:1035] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.577339 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd7b2e3ac2c46b3863d33f2d5cc4493. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.577754 4662 tablet.cc:1721] T 8dde69ff2f574d838d81bea5a53700f5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.580293 3514 tablet_service.cc:1467] Processing CreateTablet for tablet e36b0225f1314ffa913f6b7e420ce73b (DEFAULT_TABLE table=default.Table_45596fab1ea44ddbae9052372afb76f5 [id=d75ff64018314feeb4023bfaed039d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.580386 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36b0225f1314ffa913f6b7e420ce73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.580241 3244 tablet_service.cc:1467] Processing CreateTablet for tablet e36b0225f1314ffa913f6b7e420ce73b (DEFAULT_TABLE table=default.Table_45596fab1ea44ddbae9052372afb76f5 [id=d75ff64018314feeb4023bfaed039d0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.582082 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e36b0225f1314ffa913f6b7e420ce73b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.583184 4887 consensus_queue.cc:1035] T ded005e366d4460f9acbcbb7b75397ef P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.585304 3214 consensus_peers.cc:487] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.588917 4557 tablet_bootstrap.cc:492] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.588966 4557 ts_tablet_manager.cc:1397] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.000s
I20250115 10:12:05.588963 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_99b3a875aba84e8a9017edfb2cea8ffc" } new_table_name: "default.Table_fe9b5fda06784775819de22f499d741f" modify_external_catalogs: true
I20250115 10:12:05.589021 4662 tablet.cc:1721] T 8a357badf1cd43e384d2de92e3413898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.589138 4557 raft_consensus.cc:357] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.589200 4557 raft_consensus.cc:383] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.589221 4557 raft_consensus.cc:738] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.589265 4557 consensus_queue.cc:260] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.589371 4557 ts_tablet_manager.cc:1428] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.589442 4557 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.589874 4557 tablet_bootstrap.cc:654] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.590255 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2a85e863471b4a48b3b2c9df1bdd0341" } new_table_name: "default.Table_ef7b5e473cbe4eba9a3831538a2bb6c0" modify_external_catalogs: true
I20250115 10:12:05.590657 4873 tablet.cc:1721] T 8a357badf1cd43e384d2de92e3413898 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.591018 4731 consensus_queue.cc:1035] T c85d63cc502f418b91aec39245c707b9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.591307 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a5286ad1767e4f4b87c5e7b7452eaa67"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.591444 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5286ad1767e4f4b87c5e7b7452eaa67 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.593936 4662 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20250115 10:12:05.594424 3214 consensus_peers.cc:487] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.594564 4890 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:05.594564 5410 tablet.cc:1721] T 8decec5964f14766b997192fbf4f7051 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:05.598433 4569 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.598491 4569 ts_tablet_manager.cc:1397] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.083s user 0.000s sys 0.001s
I20250115 10:12:05.598616 4569 raft_consensus.cc:357] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.598672 4569 raft_consensus.cc:383] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.598696 4569 raft_consensus.cc:738] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.598737 4569 consensus_queue.cc:260] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.598845 4569 ts_tablet_manager.cc:1428] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.598906 4569 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.599234 4569 tablet_bootstrap.cc:654] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.599606 3514 tablet_service.cc:1467] Processing CreateTablet for tablet d01037655dde4de9abe0c7cbf8d3a448 (DEFAULT_TABLE table=default.Table_a5286ad1767e4f4b87c5e7b7452eaa67 [id=698f74830f834a46ba2775f304ca5f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.599970 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01037655dde4de9abe0c7cbf8d3a448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.601399 3244 tablet_service.cc:1467] Processing CreateTablet for tablet d01037655dde4de9abe0c7cbf8d3a448 (DEFAULT_TABLE table=default.Table_a5286ad1767e4f4b87c5e7b7452eaa67 [id=698f74830f834a46ba2775f304ca5f22]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.601506 4575 tablet_bootstrap.cc:492] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.601521 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d01037655dde4de9abe0c7cbf8d3a448. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.601555 4575 ts_tablet_manager.cc:1397] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.084s user 0.000s sys 0.000s
I20250115 10:12:05.601680 4575 raft_consensus.cc:357] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.601734 4575 raft_consensus.cc:383] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.601750 4575 raft_consensus.cc:738] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.601789 4575 consensus_queue.cc:260] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.601876 4575 ts_tablet_manager.cc:1428] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.601922 4575 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.602348 4575 tablet_bootstrap.cc:654] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.603156 4575 tablet_bootstrap.cc:492] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.603201 4575 ts_tablet_manager.cc:1397] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.603343 4575 raft_consensus.cc:357] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.603406 4575 raft_consensus.cc:383] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.603425 4575 raft_consensus.cc:738] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.603464 4575 consensus_queue.cc:260] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.603569 4575 ts_tablet_manager.cc:1428] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.603643 4575 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.604074 4575 tablet_bootstrap.cc:654] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.605057 4873 tablet.cc:1721] T bfe0522e3e664012a00ec78a09c2816c P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.605116 4890 tablet.cc:1721] T 8a357badf1cd43e384d2de92e3413898 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.605258 5407 mvcc.cc:204] Tried to move back new op lower bound from 7114489550959980544 to 7114489549442310144. Current Snapshot: MvccSnapshot[applied={T|T < 7114489550959980544}]
I20250115 10:12:05.606384 4662 tablet.cc:1721] T bfe0522e3e664012a00ec78a09c2816c P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.608662 5702 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.608820 5448 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 10:12:05.608844 4873 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.609139 5448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 10:12:05.609249 5448 kserver.cc:163] Server-wide thread pool size limit: 3276
W20250115 10:12:05.613372 3214 consensus_peers.cc:487] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.615012 5448 rpc_server.cc:307] RPC server started. Bound to: 127.2.217.189:36717
I20250115 10:12:05.615038 5750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.217.189:36717 every 8 connection(s)
I20250115 10:12:05.615427 5448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/master-1/data/info.pb
I20250115 10:12:05.616293 5690 tablet.cc:1721] T 8093f8487b9844718707e2fcdd3ae833 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.617771 5751 sys_catalog.cc:263] Verifying existing consensus state
I20250115 10:12:05.618909 5751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap starting.
I20250115 10:12:05.619439 4731 raft_consensus.cc:491] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.619495 4731 raft_consensus.cc:513] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.619616 4731 leader_election.cc:290] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.619781 4569 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.619827 4569 ts_tablet_manager.cc:1397] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.000s
I20250115 10:12:05.619936 4569 raft_consensus.cc:357] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.620003 4569 raft_consensus.cc:383] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.619935 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_35bd55938db44bccb4e062aaa30b8c29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.620021 4569 raft_consensus.cc:738] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
W20250115 10:12:05.620069 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35bd55938db44bccb4e062aaa30b8c29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.620060 4569 consensus_queue.cc:260] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.620158 4569 ts_tablet_manager.cc:1428] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.620215 4569 tablet_bootstrap.cc:492] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.620481 4569 tablet_bootstrap.cc:654] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.621133 4557 tablet_bootstrap.cc:492] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.621189 4557 ts_tablet_manager.cc:1397] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20250115 10:12:05.621351 4557 raft_consensus.cc:357] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.621418 4557 raft_consensus.cc:383] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.621438 4557 raft_consensus.cc:738] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.621486 4557 consensus_queue.cc:260] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.621506 3215 leader_election.cc:343] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: cb353ea066dc474cac07e3adcfa6574d
I20250115 10:12:05.621598 4557 ts_tablet_manager.cc:1428] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.621601 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb353ea066dc474cac07e3adcfa6574d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.621675 3415 raft_consensus.cc:2463] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.621686 4557 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.621814 3214 leader_election.cc:304] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.621953 5156 raft_consensus.cc:2798] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.621987 5156 raft_consensus.cc:491] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.622011 5156 raft_consensus.cc:3054] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.622231 4557 tablet_bootstrap.cc:654] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.622341 4877 raft_consensus.cc:491] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.622395 4877 raft_consensus.cc:513] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.622526 4877 leader_election.cc:290] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.622833 5156 raft_consensus.cc:513] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.622956 5156 leader_election.cc:290] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.623353 2918 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskjHaIeY/build/release/bin/kudu as pid 5448
I20250115 10:12:05.623927 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.624037 3544 raft_consensus.cc:2388] T 424956b90563455d8140a49fcaa05206 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.624049 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "424956b90563455d8140a49fcaa05206" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.624126 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb353ea066dc474cac07e3adcfa6574d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.624190 3415 raft_consensus.cc:3054] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.624958 3215 leader_election.cc:343] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: cb353ea066dc474cac07e3adcfa6574d
I20250115 10:12:05.624958 3350 leader_election.cc:304] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.625044 4877 raft_consensus.cc:3054] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.625226 3415 raft_consensus.cc:2463] T cb353ea066dc474cac07e3adcfa6574d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.625288 4575 tablet_bootstrap.cc:492] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.625344 4575 ts_tablet_manager.cc:1397] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20250115 10:12:05.625480 4575 raft_consensus.cc:357] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.625531 4575 raft_consensus.cc:383] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.625548 4575 raft_consensus.cc:738] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.625586 4575 consensus_queue.cc:260] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.625711 4575 ts_tablet_manager.cc:1428] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.625772 4575 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.625823 3214 leader_election.cc:304] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.625831 4877 raft_consensus.cc:2743] T 424956b90563455d8140a49fcaa05206 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.625931 4731 raft_consensus.cc:2798] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.625982 4731 raft_consensus.cc:695] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.626034 4731 consensus_queue.cc:237] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.626406 4575 tablet_bootstrap.cc:654] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.626729 4433 raft_consensus.cc:491] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.626772 4433 raft_consensus.cc:513] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.626873 4433 leader_election.cc:290] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.627112 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.627179 3274 raft_consensus.cc:2388] T a577ace8245744d1a42938ddd99ce89b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:05.627542 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a577ace8245744d1a42938ddd99ce89b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.627817 3484 leader_election.cc:304] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.627929 4433 raft_consensus.cc:3054] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.628700 4433 raft_consensus.cc:2743] T a577ace8245744d1a42938ddd99ce89b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.629093 4877 consensus_queue.cc:1035] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.629304 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8a67b19c364a089b7ac0cdf9ab803f (DEFAULT_TABLE table=default.Table_35bd55938db44bccb4e062aaa30b8c29 [id=0def808bb65649fab78afd7024c88f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.629424 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8a67b19c364a089b7ac0cdf9ab803f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.630237 4569 tablet_bootstrap.cc:492] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.630272 4557 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.630295 4569 ts_tablet_manager.cc:1397] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.630316 4557 ts_tablet_manager.cc:1397] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:05.630398 4569 raft_consensus.cc:357] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.630472 4569 raft_consensus.cc:383] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.630448 4557 raft_consensus.cc:357] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.630496 4569 raft_consensus.cc:738] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.630502 4557 raft_consensus.cc:383] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.630527 4557 raft_consensus.cc:738] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.630532 4569 consensus_queue.cc:260] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.630569 4557 consensus_queue.cc:260] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.630628 4569 ts_tablet_manager.cc:1428] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.630662 4557 ts_tablet_manager.cc:1428] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.630689 4569 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.630743 4557 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.630851 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 1b8a67b19c364a089b7ac0cdf9ab803f (DEFAULT_TABLE table=default.Table_35bd55938db44bccb4e062aaa30b8c29 [id=0def808bb65649fab78afd7024c88f79]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.630950 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8a67b19c364a089b7ac0cdf9ab803f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.631125 4557 tablet_bootstrap.cc:654] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.631179 4569 tablet_bootstrap.cc:654] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.631750 3415 raft_consensus.cc:3054] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.632885 4890 tablet.cc:1721] T b1b423922cbb4a42bbdb4de025227118 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.632949 4575 tablet_bootstrap.cc:492] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.632989 4575 ts_tablet_manager.cc:1397] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:05.633111 4575 raft_consensus.cc:357] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.633157 4575 raft_consensus.cc:383] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.633193 4575 raft_consensus.cc:738] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.633244 4575 consensus_queue.cc:260] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.633350 4575 ts_tablet_manager.cc:1428] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.633400 4575 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.633878 4575 tablet_bootstrap.cc:654] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.634698 4433 consensus_queue.cc:1035] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.635030 4714 consensus_queue.cc:1035] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.635457 4575 tablet_bootstrap.cc:492] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.635506 4575 ts_tablet_manager.cc:1397] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.635640 4575 raft_consensus.cc:357] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.635737 4575 raft_consensus.cc:383] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.635774 4575 raft_consensus.cc:738] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.635813 4575 consensus_queue.cc:260] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.635921 4575 ts_tablet_manager.cc:1428] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.635978 4575 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.636628 4575 tablet_bootstrap.cc:654] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.638383 4575 tablet_bootstrap.cc:492] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.638427 4575 ts_tablet_manager.cc:1397] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:05.638581 4575 raft_consensus.cc:357] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.638643 4575 raft_consensus.cc:383] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.638664 4575 raft_consensus.cc:738] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.638702 4575 consensus_queue.cc:260] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.638808 4575 ts_tablet_manager.cc:1428] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.638864 4575 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.639303 4575 tablet_bootstrap.cc:654] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.639849 4731 consensus_queue.cc:1035] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.642083 4731 consensus_queue.cc:1035] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.644680 3770 consensus_queue.cc:1035] T bf882dcd84be4b38af533b64dfb4fd95 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.647260 4575 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.647305 4575 ts_tablet_manager.cc:1397] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:05.647449 4575 raft_consensus.cc:357] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.647500 4575 raft_consensus.cc:383] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.647516 4575 raft_consensus.cc:738] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.647557 4575 consensus_queue.cc:260] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.647663 4575 ts_tablet_manager.cc:1428] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.647797 4575 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.648248 4575 tablet_bootstrap.cc:654] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.650568 3484 consensus_peers.cc:487] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.650852 4699 consensus_queue.cc:1035] T ce8455d282d34bbe9822a00a28d4c3ec P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.651590 4557 tablet_bootstrap.cc:492] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.651638 4557 ts_tablet_manager.cc:1397] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.000s
I20250115 10:12:05.651800 4557 raft_consensus.cc:357] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.651857 4557 raft_consensus.cc:383] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.651875 4557 raft_consensus.cc:738] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.652240 4557 consensus_queue.cc:260] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.652487 4557 ts_tablet_manager.cc:1428] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.652633 4557 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.653124 4557 tablet_bootstrap.cc:654] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.654299 3547 raft_consensus.cc:3054] T a7e2086241df4b4fac5e481c5e8295a9 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.655501 4587 consensus_queue.cc:1035] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.655452 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_92698ddfb91341c69388814347cdd43c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.655608 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92698ddfb91341c69388814347cdd43c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.655478 4468 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_dbaca6558a074caa8671547657908e94" } new_table_name: "default.Table_ea63b4249350460fb54a84dee14ea5cc" modify_external_catalogs: true
I20250115 10:12:05.655452 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_e16915fc159b45849f04fc052cf9c6b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.656319 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e16915fc159b45849f04fc052cf9c6b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.656528 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_5a25db32c3844bb2b388ae501e0156c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.656634 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a25db32c3844bb2b388ae501e0156c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.657622 3544 raft_consensus.cc:3054] T 359eb3a976bd409b8e2d4b72f0b2348c P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.664359 4569 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.664532 4569 ts_tablet_manager.cc:1397] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.000s
I20250115 10:12:05.665213 4569 raft_consensus.cc:357] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.665563 4569 raft_consensus.cc:383] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.665668 4569 raft_consensus.cc:738] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.666098 5156 raft_consensus.cc:491] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.666178 5156 raft_consensus.cc:513] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.666339 5156 leader_election.cc:290] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.666581 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab498e7789d4ae18a9f62be2fa2514a" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.665926 4569 consensus_queue.cc:260] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:05.666855 3214 leader_election.cc:343] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.667063 4569 ts_tablet_manager.cc:1428] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:05.667254 4569 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.667976 4557 tablet_bootstrap.cc:492] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.668057 4557 ts_tablet_manager.cc:1397] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250115 10:12:05.668130 4569 tablet_bootstrap.cc:654] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.668244 4557 raft_consensus.cc:357] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.668268 4908 raft_consensus.cc:491] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.668300 4557 raft_consensus.cc:383] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.668321 4557 raft_consensus.cc:738] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.668308 4908 raft_consensus.cc:513] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.668363 4557 consensus_queue.cc:260] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.668412 4908 leader_election.cc:290] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.668465 4557 ts_tablet_manager.cc:1428] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.668534 4557 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.668623 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_41b06bece84c44ad8a28fe84291ce058"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.668738 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41b06bece84c44ad8a28fe84291ce058 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.668889 3770 raft_consensus.cc:491] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.668931 4557 tablet_bootstrap.cc:654] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.668931 3770 raft_consensus.cc:513] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.669027 3770 leader_election.cc:290] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.669059 3770 consensus_queue.cc:1035] T 359eb3a976bd409b8e2d4b72f0b2348c P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.669195 4587 consensus_queue.cc:1035] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.669317 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.669371 3545 raft_consensus.cc:2463] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.669471 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.669773 3215 leader_election.cc:304] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.669852 3215 leader_election.cc:343] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.669888 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.669941 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.670042 3770 raft_consensus.cc:2798] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.670073 3770 raft_consensus.cc:491] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.670094 3770 raft_consensus.cc:3054] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.670753 3770 raft_consensus.cc:513] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.670853 3770 leader_election.cc:290] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.671043 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.671093 3545 raft_consensus.cc:3054] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.671101 4575 tablet_bootstrap.cc:492] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.671162 4575 ts_tablet_manager.cc:1397] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.001s
I20250115 10:12:05.671155 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8e5f943ff241348c6c4b99ae146eb3 (DEFAULT_TABLE table=default.Table_e16915fc159b45849f04fc052cf9c6b7 [id=17ef3ca551de47d08ac4ef202a102658]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.671250 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8e5f943ff241348c6c4b99ae146eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.671272 4575 raft_consensus.cc:357] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.671335 4575 raft_consensus.cc:383] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.671358 4575 raft_consensus.cc:738] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.671391 4575 consensus_queue.cc:260] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.671499 4575 ts_tablet_manager.cc:1428] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.671562 4575 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.671787 3545 raft_consensus.cc:2463] T 17837499b096462394d993f39efce677 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.672268 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17837499b096462394d993f39efce677" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.672376 3214 leader_election.cc:343] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.672412 3214 leader_election.cc:304] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.672470 4575 tablet_bootstrap.cc:654] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.672508 3214 leader_election.cc:343] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.672564 5156 raft_consensus.cc:2743] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.672705 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 3a8e5f943ff241348c6c4b99ae146eb3 (DEFAULT_TABLE table=default.Table_e16915fc159b45849f04fc052cf9c6b7 [id=17ef3ca551de47d08ac4ef202a102658]), partition=RANGE (key) PARTITION UNBOUNDED
W20250115 10:12:05.672792 3214 leader_election.cc:343] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.672821 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a8e5f943ff241348c6c4b99ae146eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.675215 4569 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.675261 4569 ts_tablet_manager.cc:1397] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:05.675441 4569 raft_consensus.cc:357] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.675494 4569 raft_consensus.cc:383] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.675513 4569 raft_consensus.cc:738] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.675539 4569 consensus_queue.cc:260] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.675624 4569 ts_tablet_manager.cc:1428] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.675673 4569 tablet_bootstrap.cc:492] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.675984 3215 leader_election.cc:304] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.676057 5155 raft_consensus.cc:2798] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
W20250115 10:12:05.676086 3215 leader_election.cc:343] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4ab498e7789d4ae18a9f62be2fa2514a
I20250115 10:12:05.676110 5155 raft_consensus.cc:695] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.676119 3215 leader_election.cc:304] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.676160 5155 consensus_queue.cc:237] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.676179 3770 raft_consensus.cc:2743] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.676120 4569 tablet_bootstrap.cc:654] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.677583 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.677807 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0262547e72d84b698d58d7a57f8cccb3" } modify_external_catalogs: true
I20250115 10:12:05.677872 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0262547e72d84b698d58d7a57f8cccb3" } modify_external_catalogs: true
I20250115 10:12:05.677994 4433 raft_consensus.cc:491] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.678344 4433 raft_consensus.cc:513] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.678483 4433 leader_election.cc:290] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.678681 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.678745 3415 raft_consensus.cc:2463] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.678953 3484 leader_election.cc:304] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.679111 4884 raft_consensus.cc:2798] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.679139 4884 raft_consensus.cc:491] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.679158 4884 raft_consensus.cc:3054] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.679965 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.679996 4884 raft_consensus.cc:513] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.680039 3276 raft_consensus.cc:2463] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.680109 4884 leader_election.cc:290] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.680763 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.680819 3274 raft_consensus.cc:3054] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.681001 4587 consensus_queue.cc:1035] T 616166bc9d5d4651999b1d2e0a1851bb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.681416 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_5b8b6d4b8def4ce7a9c6fed91284c9fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.681540 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b8b6d4b8def4ce7a9c6fed91284c9fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.681787 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8114f64577245c2b3ce70e4399de0c8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.681798 3412 raft_consensus.cc:3054] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.681859 3415 raft_consensus.cc:3054] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.682518 3415 raft_consensus.cc:2463] T f8114f64577245c2b3ce70e4399de0c8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.682704 3412 raft_consensus.cc:1270] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.683013 3484 leader_election.cc:304] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.683154 4433 raft_consensus.cc:2798] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.683199 4433 raft_consensus.cc:695] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.683249 4433 consensus_queue.cc:237] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.683468 4433 consensus_queue.cc:1035] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.683945 3274 raft_consensus.cc:2463] T f8114f64577245c2b3ce70e4399de0c8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.686110 4884 raft_consensus.cc:491] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.686185 4884 raft_consensus.cc:513] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.686220 4557 tablet_bootstrap.cc:492] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.686257 4557 ts_tablet_manager.cc:1397] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20250115 10:12:05.686297 4884 leader_election.cc:290] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.686411 4557 raft_consensus.cc:357] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.686482 4557 raft_consensus.cc:383] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.686502 4557 raft_consensus.cc:738] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.686542 4557 consensus_queue.cc:260] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.686668 4557 ts_tablet_manager.cc:1428] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.686748 4557 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.686848 3275 raft_consensus.cc:1270] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Refusing update from remote peer 89067c97cc1c45e699ee9f690cb3014f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 10:12:05.686903 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.686971 3274 raft_consensus.cc:2463] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.687296 4557 tablet_bootstrap.cc:654] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.687336 3485 leader_election.cc:304] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.687391 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 76a9400af70a4393b9f7bce9da92ee76 (DEFAULT_TABLE table=default.Table_5a25db32c3844bb2b388ae501e0156c1 [id=4dbb4bfbd9f246abb0d9ff157e6f9883]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.687503 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a9400af70a4393b9f7bce9da92ee76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.687743 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 86b3eda1364f4746862f1880c2a0383d (DEFAULT_TABLE table=default.Table_92698ddfb91341c69388814347cdd43c [id=8d5f77ab233344c4809331c497f66018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.687855 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b3eda1364f4746862f1880c2a0383d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.688880 4887 raft_consensus.cc:2798] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.688923 4887 raft_consensus.cc:491] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.688946 4887 raft_consensus.cc:3054] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.689185 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 76a9400af70a4393b9f7bce9da92ee76 (DEFAULT_TABLE table=default.Table_5a25db32c3844bb2b388ae501e0156c1 [id=4dbb4bfbd9f246abb0d9ff157e6f9883]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.689276 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a9400af70a4393b9f7bce9da92ee76. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.687343 4338 consensus_queue.cc:1035] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250115 10:12:05.690122 4887 raft_consensus.cc:513] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.690254 4887 leader_election.cc:290] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.690299 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.690382 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.690443 3274 raft_consensus.cc:3054] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.690528 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 86b3eda1364f4746862f1880c2a0383d (DEFAULT_TABLE table=default.Table_92698ddfb91341c69388814347cdd43c [id=8d5f77ab233344c4809331c497f66018]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.690605 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b3eda1364f4746862f1880c2a0383d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.691040 3274 raft_consensus.cc:2463] T 4f6baabd5aba4363ae13e5da601a9de8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.691380 3485 leader_election.cc:304] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.692052 4433 raft_consensus.cc:2798] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.692103 4433 raft_consensus.cc:695] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.692148 4575 tablet_bootstrap.cc:492] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.692143 4433 consensus_queue.cc:237] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.692190 4575 ts_tablet_manager.cc:1397] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:05.692308 4575 raft_consensus.cc:357] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.692351 4575 raft_consensus.cc:383] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.692365 4575 raft_consensus.cc:738] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.692399 4575 consensus_queue.cc:260] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.692489 4575 ts_tablet_manager.cc:1428] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.692536 4575 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.692912 4575 tablet_bootstrap.cc:654] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.693440 4587 consensus_queue.cc:1035] T 6435fd1953d440c8b4d9745a5dcd15f6 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.694177 4908 raft_consensus.cc:491] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.694237 4908 raft_consensus.cc:513] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.694305 4557 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.694335 4908 leader_election.cc:290] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.694345 4557 ts_tablet_manager.cc:1397] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:05.694502 4557 raft_consensus.cc:357] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.694566 4557 raft_consensus.cc:383] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.694604 4557 raft_consensus.cc:738] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.694648 4557 consensus_queue.cc:260] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.694674 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.694746 4557 ts_tablet_manager.cc:1428] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.694795 4557 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.694782 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f6baabd5aba4363ae13e5da601a9de8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.695171 4557 tablet_bootstrap.cc:654] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.695416 3484 leader_election.cc:343] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.695533 3484 leader_election.cc:343] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.695616 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.695705 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.695926 3214 leader_election.cc:343] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.696125 4875 consensus_queue.cc:1035] T a7e2086241df4b4fac5e481c5e8295a9 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.696162 4699 consensus_queue.cc:1035] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.696168 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2aa47389a00a4869be6516724cb4c6e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.696276 3215 leader_election.cc:343] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.696290 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2aa47389a00a4869be6516724cb4c6e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.696316 3215 leader_election.cc:304] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.696429 4908 raft_consensus.cc:2743] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.698149 4575 tablet_bootstrap.cc:492] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.698196 4575 ts_tablet_manager.cc:1397] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:05.698326 4575 raft_consensus.cc:357] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.698379 4575 raft_consensus.cc:383] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.698400 4575 raft_consensus.cc:738] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.698433 4575 consensus_queue.cc:260] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.698495 4873 tablet.cc:1721] T 347621ded3fd4380b1502d1a8c5b0c4a P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.698537 4575 ts_tablet_manager.cc:1428] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.698590 4575 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.698596 4662 tablet.cc:1721] T 347621ded3fd4380b1502d1a8c5b0c4a P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.699012 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 340a2105fde74a7094958a7201d9632b (DEFAULT_TABLE table=default.Table_41b06bece84c44ad8a28fe84291ce058 [id=ca418e0ef5f7481fbf420bbb33addaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.699079 4575 tablet_bootstrap.cc:654] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.699093 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340a2105fde74a7094958a7201d9632b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.699909 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 340a2105fde74a7094958a7201d9632b (DEFAULT_TABLE table=default.Table_41b06bece84c44ad8a28fe84291ce058 [id=ca418e0ef5f7481fbf420bbb33addaf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.700037 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 340a2105fde74a7094958a7201d9632b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.700296 4557 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.700332 4557 ts_tablet_manager.cc:1397] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.000s
I20250115 10:12:05.700453 4557 raft_consensus.cc:357] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.700518 4557 raft_consensus.cc:383] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.700539 4557 raft_consensus.cc:738] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.700573 4557 consensus_queue.cc:260] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.700663 4557 ts_tablet_manager.cc:1428] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.701336 4557 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.701702 4557 tablet_bootstrap.cc:654] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.702323 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 215b4c36fa94423dae6a301ec5809fae (DEFAULT_TABLE table=default.Table_2aa47389a00a4869be6516724cb4c6e0 [id=0ec3ee8ccc6f4cdfb9e1d5839bf87f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.702343 3513 tablet_service.cc:1467] Processing CreateTablet for tablet b8595ab9debf4c21a13697834d7897a2 (DEFAULT_TABLE table=default.Table_5b8b6d4b8def4ce7a9c6fed91284c9fd [id=3a2414522a134322848b0c71fe32a61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.702407 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215b4c36fa94423dae6a301ec5809fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.702405 3242 tablet_service.cc:1467] Processing CreateTablet for tablet b8595ab9debf4c21a13697834d7897a2 (DEFAULT_TABLE table=default.Table_5b8b6d4b8def4ce7a9c6fed91284c9fd [id=3a2414522a134322848b0c71fe32a61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.702512 3242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8595ab9debf4c21a13697834d7897a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.702617 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8595ab9debf4c21a13697834d7897a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.704155 3485 consensus_peers.cc:487] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc7e96ba921d4fbb96afbbf8c5f354f2. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.704241 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 215b4c36fa94423dae6a301ec5809fae (DEFAULT_TABLE table=default.Table_2aa47389a00a4869be6516724cb4c6e0 [id=0ec3ee8ccc6f4cdfb9e1d5839bf87f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.704331 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215b4c36fa94423dae6a301ec5809fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.704525 4575 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.704566 4575 ts_tablet_manager.cc:1397] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:05.704691 4575 raft_consensus.cc:357] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.704749 4575 raft_consensus.cc:383] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.704764 4575 raft_consensus.cc:738] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.704799 4575 consensus_queue.cc:260] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.704893 4575 ts_tablet_manager.cc:1428] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.704942 4575 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.705302 4811 raft_consensus.cc:491] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.705356 4811 raft_consensus.cc:513] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.705489 4811 leader_election.cc:290] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.705318 4575 tablet_bootstrap.cc:654] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.705605 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.705731 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc395ae76a494a8eb682b7ef34dcb169" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.705786 3545 raft_consensus.cc:2388] T cc395ae76a494a8eb682b7ef34dcb169 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
W20250115 10:12:05.705948 3484 consensus_peers.cc:487] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.706061 3350 leader_election.cc:304] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.706166 4811 raft_consensus.cc:3054] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.706568 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 595f8aa14ea643e38fc594e9ae504815
I20250115 10:12:05.706877 4811 raft_consensus.cc:2743] T cc395ae76a494a8eb682b7ef34dcb169 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.706919 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 595f8aa14ea643e38fc594e9ae504815 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.707132 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 595f8aa14ea643e38fc594e9ae504815 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 595f8aa14ea643e38fc594e9ae504815 already in progress: creating tablet
I20250115 10:12:05.707542 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 595f8aa14ea643e38fc594e9ae504815 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:05.707959 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 595f8aa14ea643e38fc594e9ae504815 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 595f8aa14ea643e38fc594e9ae504815 already in progress: creating tablet
I20250115 10:12:05.711053 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a9096cacdd92437d98da0c463a8782eb" } modify_external_catalogs: true
I20250115 10:12:05.711158 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a9096cacdd92437d98da0c463a8782eb" } modify_external_catalogs: true
I20250115 10:12:05.711423 4908 raft_consensus.cc:491] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.711481 4908 raft_consensus.cc:513] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.711589 4908 leader_election.cc:290] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.711762 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.711827 3548 raft_consensus.cc:2463] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.711875 4908 raft_consensus.cc:491] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.711915 4908 raft_consensus.cc:513] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.712018 4908 leader_election.cc:290] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.712121 3215 leader_election.cc:304] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.712180 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.712240 3545 raft_consensus.cc:2463] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.712298 5155 raft_consensus.cc:2798] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.712333 5155 raft_consensus.cc:491] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.712352 5155 raft_consensus.cc:3054] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.712436 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.712517 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet d3a716a282fa4445864baec3e8a16780
I20250115 10:12:05.712965 5155 raft_consensus.cc:513] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.713066 5155 leader_election.cc:290] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.713122 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.713303 3215 leader_election.cc:304] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.713341 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.713393 3545 raft_consensus.cc:3054] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.713526 4908 raft_consensus.cc:2798] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.713554 4908 raft_consensus.cc:491] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.713569 4908 raft_consensus.cc:3054] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.714083 3545 raft_consensus.cc:2463] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.714151 4908 raft_consensus.cc:513] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.714247 3215 leader_election.cc:304] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.714335 5155 raft_consensus.cc:2798] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.714409 5155 raft_consensus.cc:695] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.714458 5155 consensus_queue.cc:237] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.714560 3214 leader_election.cc:343] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.714550 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.714634 3214 leader_election.cc:343] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.714710 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.714860 3214 leader_election.cc:343] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.714916 3214 leader_election.cc:343] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.714931 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1650bac5bd96467fb3d586b23ebd77be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.714995 3545 raft_consensus.cc:3054] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.715131 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet d3a716a282fa4445864baec3e8a16780 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.715456 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet d3a716a282fa4445864baec3e8a16780 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.715624 3545 raft_consensus.cc:2463] T 1650bac5bd96467fb3d586b23ebd77be P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:05.715669 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet d3a716a282fa4445864baec3e8a16780 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3a716a282fa4445864baec3e8a16780 already in progress: creating tablet
W20250115 10:12:05.715772 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet d3a716a282fa4445864baec3e8a16780 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3a716a282fa4445864baec3e8a16780 already in progress: creating tablet
I20250115 10:12:05.714258 4908 leader_election.cc:290] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.715920 3215 leader_election.cc:304] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.715961 4587 raft_consensus.cc:491] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.716018 4587 raft_consensus.cc:513] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.716167 4587 leader_election.cc:290] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.716216 4569 tablet_bootstrap.cc:492] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.716266 4569 ts_tablet_manager.cc:1397] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.000s
I20250115 10:12:05.716357 4908 raft_consensus.cc:2798] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.716414 4908 raft_consensus.cc:695] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.716447 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.716460 4908 consensus_queue.cc:237] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.716503 3550 raft_consensus.cc:2388] T 3552b8e936ad4aeba0eadc95577f5414 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.716413 4569 raft_consensus.cc:357] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.716639 4569 raft_consensus.cc:383] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.716657 4569 raft_consensus.cc:738] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.716693 4569 consensus_queue.cc:260] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.716794 4569 ts_tablet_manager.cc:1428] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.716853 4569 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.717140 4884 raft_consensus.cc:491] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.717201 4884 raft_consensus.cc:513] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.717242 4569 tablet_bootstrap.cc:654] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.717315 4884 leader_election.cc:290] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.717758 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.717818 3276 raft_consensus.cc:2463] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.716660 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3552b8e936ad4aeba0eadc95577f5414" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.717965 3485 leader_election.cc:304] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.718034 4884 raft_consensus.cc:2798] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.718060 4884 raft_consensus.cc:491] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.718079 4884 raft_consensus.cc:3054] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.718094 4731 raft_consensus.cc:491] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:05.718127 4731 raft_consensus.cc:513] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.718212 4731 leader_election.cc:290] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.718461 3350 leader_election.cc:304] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:05.718495 3214 leader_election.cc:343] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: f889cc1201404c8691bf01256750e244
I20250115 10:12:05.718734 4884 raft_consensus.cc:513] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.718863 4884 leader_election.cc:290] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.718922 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.719098 4587 raft_consensus.cc:3054] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.719854 4587 raft_consensus.cc:2743] T 3552b8e936ad4aeba0eadc95577f5414 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:05.720016 3484 leader_election.cc:343] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.720364 4557 tablet_bootstrap.cc:492] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.720407 4557 ts_tablet_manager.cc:1397] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.000s
I20250115 10:12:05.720551 4557 raft_consensus.cc:357] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.720604 4557 raft_consensus.cc:383] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.720624 4557 raft_consensus.cc:738] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.720674 4557 consensus_queue.cc:260] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.720789 4557 ts_tablet_manager.cc:1428] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.720814 4575 tablet_bootstrap.cc:492] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.720853 4575 ts_tablet_manager.cc:1397] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20250115 10:12:05.720866 4557 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.721000 4575 raft_consensus.cc:357] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.721060 4575 raft_consensus.cc:383] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.721081 4575 raft_consensus.cc:738] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.721136 4575 consensus_queue.cc:260] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.721215 3215 leader_election.cc:343] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f889cc1201404c8691bf01256750e244
I20250115 10:12:05.721241 4575 ts_tablet_manager.cc:1428] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.721256 3215 leader_election.cc:304] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.721305 4557 tablet_bootstrap.cc:654] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.721311 4575 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.721707 4575 tablet_bootstrap.cc:654] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.721962 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.722018 3280 raft_consensus.cc:3054] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.722049 4908 raft_consensus.cc:2743] T f889cc1201404c8691bf01256750e244 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:05.722360 4714 consensus_queue.cc:1035] T 4c49b39058164387990c4f6dc170785e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.722718 3280 raft_consensus.cc:2463] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.722961 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_90ef46426add4005851c5eff0f43e3af" } modify_external_catalogs: true
I20250115 10:12:05.723028 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_90ef46426add4005851c5eff0f43e3af" } modify_external_catalogs: true
I20250115 10:12:05.723006 5751 log.cc:826] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Log is configured to *not* fsync() on all Append() calls
I20250115 10:12:05.723500 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_96a7c9ee93f04da192e8a162fc08a294" } modify_external_catalogs: true
I20250115 10:12:05.723523 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d16a22c6f2be4f8c83c3ef073ee6ff7e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.723562 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_96a7c9ee93f04da192e8a162fc08a294" } modify_external_catalogs: true
I20250115 10:12:05.724047 3485 leader_election.cc:304] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.724315 4338 raft_consensus.cc:2798] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.724359 4338 raft_consensus.cc:695] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.724395 4338 consensus_queue.cc:237] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.725788 4731 consensus_queue.cc:1035] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.725908 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9305b7ac82cd4393b28017831a0687ff
W20250115 10:12:05.726132 3484 leader_election.cc:343] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.726179 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 9305b7ac82cd4393b28017831a0687ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.726256 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 9305b7ac82cd4393b28017831a0687ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.726327 4589 tablet_replica.cc:331] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.726387 4589 raft_consensus.cc:2238] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.726428 4589 raft_consensus.cc:2267] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.726414 3415 raft_consensus.cc:3054] T 5fac40fff8de4004858af6e2ae986d46 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.726497 4551 tablet_replica.cc:331] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.726564 4551 raft_consensus.cc:2238] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.726644 4551 raft_consensus.cc:2267] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.726917 4551 ts_tablet_manager.cc:1905] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.727077 4589 ts_tablet_manager.cc:1905] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.727205 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6f611ee9e87048ca8bddaa6525bbd054
I20250115 10:12:05.727211 4890 tablet.cc:1721] T 347621ded3fd4380b1502d1a8c5b0c4a P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.728335 4551 ts_tablet_manager.cc:1918] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.728379 4551 log.cc:1198] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/9305b7ac82cd4393b28017831a0687ff
I20250115 10:12:05.728502 4589 ts_tablet_manager.cc:1918] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.728543 4589 log.cc:1198] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/9305b7ac82cd4393b28017831a0687ff
I20250115 10:12:05.728574 4551 ts_tablet_manager.cc:1939] T 9305b7ac82cd4393b28017831a0687ff P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.728696 5031 mvcc.cc:204] Tried to move back new op lower bound from 7114489551589650432 to 7114489550272339968. Current Snapshot: MvccSnapshot[applied={T|T < 7114489551589650432}]
I20250115 10:12:05.728719 4589 ts_tablet_manager.cc:1939] T 9305b7ac82cd4393b28017831a0687ff P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.728780 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f611ee9e87048ca8bddaa6525bbd054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.728924 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f611ee9e87048ca8bddaa6525bbd054 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.729028 4731 consensus_queue.cc:1035] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.729579 4551 tablet_replica.cc:331] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.729646 4551 raft_consensus.cc:2238] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.729647 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_90ef46426add4005851c5eff0f43e3af [id=3078581f1b544badaeded5f2ab32f05e]) successfully deleted
I20250115 10:12:05.729683 4551 raft_consensus.cc:2267] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.729969 4589 tablet_replica.cc:331] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.730031 4589 raft_consensus.cc:2238] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.730027 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 9305b7ac82cd4393b28017831a0687ff (table default.Table_90ef46426add4005851c5eff0f43e3af [id=3078581f1b544badaeded5f2ab32f05e]) successfully deleted
I20250115 10:12:05.730105 4589 raft_consensus.cc:2267] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.730357 4589 ts_tablet_manager.cc:1905] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.730559 4551 ts_tablet_manager.cc:1905] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.731818 4551 ts_tablet_manager.cc:1918] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.731866 4551 log.cc:1198] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6f611ee9e87048ca8bddaa6525bbd054
I20250115 10:12:05.732021 4551 ts_tablet_manager.cc:1939] T 6f611ee9e87048ca8bddaa6525bbd054 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.732628 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]) successfully deleted
W20250115 10:12:05.735037 3350 consensus_peers.cc:487] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.735092 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.735390 4589 ts_tablet_manager.cc:1918] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.735527 4589 log.cc:1198] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6f611ee9e87048ca8bddaa6525bbd054
I20250115 10:12:05.735993 4589 ts_tablet_manager.cc:1939] T 6f611ee9e87048ca8bddaa6525bbd054 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
W20250115 10:12:05.736532 3214 consensus_peers.cc:487] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.736570 4587 raft_consensus.cc:491] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.736644 4587 raft_consensus.cc:513] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.736764 4587 leader_election.cc:290] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.736780 5155 raft_consensus.cc:491] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:05.736835 5155 raft_consensus.cc:513] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.736949 5155 leader_election.cc:290] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.737111 4569 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.737165 4569 ts_tablet_manager.cc:1397] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
W20250115 10:12:05.737325 3215 leader_election.cc:343] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70
I20250115 10:12:05.737326 4569 raft_consensus.cc:357] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.737442 4569 raft_consensus.cc:383] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.737464 4569 raft_consensus.cc:738] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.737502 4569 consensus_queue.cc:260] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.737605 4569 ts_tablet_manager.cc:1428] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.737663 4569 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.737996 4557 tablet_bootstrap.cc:492] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.738052 4557 ts_tablet_manager.cc:1397] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.000s
I20250115 10:12:05.738050 4569 tablet_bootstrap.cc:654] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.738220 4557 raft_consensus.cc:357] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.738299 4557 raft_consensus.cc:383] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.738322 4557 raft_consensus.cc:738] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.738350 4557 consensus_queue.cc:260] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.738456 4557 ts_tablet_manager.cc:1428] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:05.738487 3214 leader_election.cc:343] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 5779ec7816cd499ebe46962e29092a70
I20250115 10:12:05.738520 4557 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.738528 3214 leader_election.cc:304] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.738592 5155 raft_consensus.cc:2743] T 5779ec7816cd499ebe46962e29092a70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:05.738776 4557 tablet_bootstrap.cc:654] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.738837 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6f611ee9e87048ca8bddaa6525bbd054 (table default.Table_96a7c9ee93f04da192e8a162fc08a294 [id=23c29981f55c4cdf8139331d20636ea9]) successfully deleted
I20250115 10:12:05.738966 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 424956b90563455d8140a49fcaa05206 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.739042 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f3ecaa29866d4eecba0b28723277579c" } modify_external_catalogs: true
I20250115 10:12:05.739084 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f3ecaa29866d4eecba0b28723277579c" } modify_external_catalogs: true
W20250115 10:12:05.739254 3214 consensus_peers.cc:487] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.739466 4731 raft_consensus.cc:491] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.739517 4731 raft_consensus.cc:513] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.739609 4731 leader_election.cc:290] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.739465 5155 raft_consensus.cc:491] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.739817 5155 raft_consensus.cc:513] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.739792 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.739909 5155 leader_election.cc:290] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.740069 3214 leader_election.cc:343] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.740092 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.740187 4575 tablet_bootstrap.cc:492] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.740226 4575 ts_tablet_manager.cc:1397] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.000s
W20250115 10:12:05.740253 3214 leader_election.cc:343] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.740370 4575 raft_consensus.cc:357] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.740422 4575 raft_consensus.cc:383] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.740442 4575 raft_consensus.cc:738] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.740466 4575 consensus_queue.cc:260] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.740566 4575 ts_tablet_manager.cc:1428] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.740569 4569 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.740603 4569 ts_tablet_manager.cc:1397] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:05.740614 4575 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.740751 4569 raft_consensus.cc:357] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.740799 4569 raft_consensus.cc:383] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.740816 4569 raft_consensus.cc:738] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.740851 4569 consensus_queue.cc:260] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.740926 4569 ts_tablet_manager.cc:1428] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.740980 4569 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.741014 4575 tablet_bootstrap.cc:654] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.741320 4569 tablet_bootstrap.cc:654] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.741535 4575 tablet_bootstrap.cc:492] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.741571 4575 ts_tablet_manager.cc:1397] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:05.741729 4575 raft_consensus.cc:357] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.741794 4575 raft_consensus.cc:383] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.741811 4575 raft_consensus.cc:738] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.741839 4575 consensus_queue.cc:260] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.741930 4575 ts_tablet_manager.cc:1428] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.741977 4575 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.742100 4731 raft_consensus.cc:491] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.742146 4731 raft_consensus.cc:513] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.742218 4731 leader_election.cc:290] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.742336 4575 tablet_bootstrap.cc:654] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.742386 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.742439 3547 raft_consensus.cc:2463] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.742781 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.742826 4587 raft_consensus.cc:491] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.742858 3545 raft_consensus.cc:2463] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.742878 4587 raft_consensus.cc:513] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.742790 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.742933 3544 raft_consensus.cc:2463] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.742965 4587 leader_election.cc:290] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.743160 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.743214 3412 raft_consensus.cc:2463] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.743372 3214 leader_election.cc:304] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.743476 5155 raft_consensus.cc:2798] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.743513 5155 raft_consensus.cc:491] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.743530 5155 raft_consensus.cc:3054] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.743592 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.743593 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5b8eb78b10be4d029426017a849db377" } new_table_name: "default.Table_2e6df8fc89364e8bb300a6b01f5614dd" modify_external_catalogs: true
I20250115 10:12:05.743647 3280 raft_consensus.cc:2463] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.743901 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.743952 3544 raft_consensus.cc:2463] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.743382 3215 leader_election.cc:304] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.744355 3215 leader_election.cc:304] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.744503 4731 raft_consensus.cc:2798] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.744549 4731 raft_consensus.cc:491] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.744567 4731 raft_consensus.cc:3054] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.744613 4908 raft_consensus.cc:2798] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.744649 4908 raft_consensus.cc:491] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.744668 4908 raft_consensus.cc:3054] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.744858 3770 consensus_queue.cc:1035] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.745234 4731 raft_consensus.cc:513] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.745332 4731 leader_election.cc:290] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.745370 3598 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.745401 4908 raft_consensus.cc:513] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.745536 4908 leader_election.cc:290] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.746429 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.746626 3214 leader_election.cc:343] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.746847 3350 leader_election.cc:304] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.746995 4714 raft_consensus.cc:2798] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.747031 4714 raft_consensus.cc:491] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.747058 4714 raft_consensus.cc:3054] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.747148 4587 consensus_queue.cc:1035] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.747792 4714 raft_consensus.cc:513] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.747906 4557 tablet_bootstrap.cc:492] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.747913 4714 leader_election.cc:290] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.747946 4557 ts_tablet_manager.cc:1397] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:05.748085 4557 raft_consensus.cc:357] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.748133 4557 raft_consensus.cc:383] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.748149 4557 raft_consensus.cc:738] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.748179 4557 consensus_queue.cc:260] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.748277 4557 ts_tablet_manager.cc:1428] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.748343 4557 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.748721 4557 tablet_bootstrap.cc:654] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.750103 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 280a20f9803943bca7847e95877be34a
I20250115 10:12:05.750092 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.750151 3545 raft_consensus.cc:2463] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.750149 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.744329 5155 raft_consensus.cc:513] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.750341 5155 leader_election.cc:290] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.750474 4569 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.750517 4569 ts_tablet_manager.cc:1397] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:05.750689 4569 raft_consensus.cc:357] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.750747 4569 raft_consensus.cc:383] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.750768 4569 raft_consensus.cc:738] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.750797 4884 raft_consensus.cc:491] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.750810 4569 consensus_queue.cc:260] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.750836 4884 raft_consensus.cc:513] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.750927 4569 ts_tablet_manager.cc:1428] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.750936 4884 leader_election.cc:290] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.751014 4569 tablet_bootstrap.cc:492] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:05.751176 3214 leader_election.cc:343] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.751164 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.751308 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e23a070a8454f3b8bd1620ac4535a12" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.751384 4575 tablet_bootstrap.cc:492] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.751427 4575 ts_tablet_manager.cc:1397] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:05.751570 4575 raft_consensus.cc:357] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.751628 4575 raft_consensus.cc:383] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.751626 3485 leader_election.cc:304] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.751652 4575 raft_consensus.cc:738] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.751704 4884 raft_consensus.cc:2743] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.751763 4434 consensus_queue.cc:1035] T dc7e96ba921d4fbb96afbbf8c5f354f2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.751701 4575 consensus_queue.cc:260] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.751863 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 280a20f9803943bca7847e95877be34a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.751966 4575 ts_tablet_manager.cc:1428] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.752034 4575 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.752061 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.752116 3412 raft_consensus.cc:3054] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.752337 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 280a20f9803943bca7847e95877be34a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 280a20f9803943bca7847e95877be34a already in progress: creating tablet
I20250115 10:12:05.752624 4557 tablet_bootstrap.cc:492] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.752671 4557 ts_tablet_manager.cc:1397] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:05.752707 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.752768 3547 raft_consensus.cc:3054] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.752808 3412 raft_consensus.cc:2463] T e178610c1a394217b152082dfd6bb8d0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.752817 4557 raft_consensus.cc:357] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.752871 4557 raft_consensus.cc:383] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.752887 4557 raft_consensus.cc:738] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.752929 4557 consensus_queue.cc:260] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.752890 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 280a20f9803943bca7847e95877be34a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.753039 4557 ts_tablet_manager.cc:1428] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.753111 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.753165 3280 raft_consensus.cc:2463] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.753433 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e178610c1a394217b152082dfd6bb8d0" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.753502 3548 raft_consensus.cc:3054] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.753592 3214 leader_election.cc:304] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.753666 4908 raft_consensus.cc:491] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.753695 4908 raft_consensus.cc:513] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.753789 4908 leader_election.cc:290] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:05.753814 4908 raft_consensus.cc:491] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.753834 4908 raft_consensus.cc:513] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.753901 4908 leader_election.cc:290] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.753933 4908 raft_consensus.cc:2798] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.753965 4908 raft_consensus.cc:695] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.754000 4908 consensus_queue.cc:237] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.754086 4569 tablet_bootstrap.cc:654] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.754135 3548 raft_consensus.cc:2463] T e178610c1a394217b152082dfd6bb8d0 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.753417 3547 raft_consensus.cc:2463] T 5778f29ace314ea18b42afd0b7c1642b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.753424 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.754375 3544 raft_consensus.cc:3054] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.755000 3544 raft_consensus.cc:2463] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.755381 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.755839 3350 leader_election.cc:304] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.755986 3214 leader_election.cc:343] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.756083 4714 raft_consensus.cc:2798] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.756109 4714 raft_consensus.cc:491] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.756127 4714 raft_consensus.cc:3054] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.756721 4714 raft_consensus.cc:513] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.756830 4714 leader_election.cc:290] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.757254 3548 raft_consensus.cc:3054] T 0e23a070a8454f3b8bd1620ac4535a12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.757339 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 280a20f9803943bca7847e95877be34a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 280a20f9803943bca7847e95877be34a already in progress: creating tablet
W20250115 10:12:05.757637 4472 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b07efa65ed754b75abfbe4869593ab78 consensus state has no leader
I20250115 10:12:05.758685 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.758766 3280 raft_consensus.cc:3054] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.758822 3215 leader_election.cc:304] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.758888 3215 leader_election.cc:304] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.758988 4908 consensus_queue.cc:1035] T cc395ae76a494a8eb682b7ef34dcb169 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.759020 5156 raft_consensus.cc:2798] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.759054 4908 raft_consensus.cc:2798] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.759084 4908 raft_consensus.cc:695] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.759115 4908 consensus_queue.cc:237] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.759063 5156 raft_consensus.cc:695] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.759316 5156 consensus_queue.cc:237] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.759423 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a285009787f4acb810a1829ca37a845" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.759493 3280 raft_consensus.cc:2463] T ee6597804e5c41618870133c9d4ad1b3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.758766 3770 consensus_queue.cc:1035] T 5fac40fff8de4004858af6e2ae986d46 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250115 10:12:05.757269 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee6597804e5c41618870133c9d4ad1b3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.759618 3547 raft_consensus.cc:3054] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.759805 3214 leader_election.cc:343] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.760247 3547 raft_consensus.cc:2463] T ee6597804e5c41618870133c9d4ad1b3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.760322 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a285009787f4acb810a1829ca37a845" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.760387 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 353b2e8e545e44768ec77f0cd0caa6e6 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.760396 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.760910 4434 raft_consensus.cc:491] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.760955 4434 raft_consensus.cc:513] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.761042 4434 leader_election.cc:290] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.761210 4557 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.761456 4714 raft_consensus.cc:491] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.761494 4714 raft_consensus.cc:513] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.761510 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.761564 3280 raft_consensus.cc:2463] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.761581 4714 leader_election.cc:290] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.761652 4557 tablet_bootstrap.cc:654] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.761674 3485 leader_election.cc:304] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.761816 3350 leader_election.cc:304] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
W20250115 10:12:05.761991 3215 leader_election.cc:343] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.762033 3215 leader_election.cc:304] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.762019 3543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.762113 3215 leader_election.cc:343] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.762115 3543 raft_consensus.cc:2463] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.762136 3215 leader_election.cc:304] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.762173 4884 raft_consensus.cc:2798] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.762200 4884 raft_consensus.cc:491] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.762239 4884 raft_consensus.cc:3054] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.762445 4877 raft_consensus.cc:2798] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.762488 4877 raft_consensus.cc:695] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.762523 4877 consensus_queue.cc:237] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.763005 4884 raft_consensus.cc:513] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.763118 4884 leader_election.cc:290] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.763180 3770 raft_consensus.cc:2743] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.763206 4731 raft_consensus.cc:2743] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.763320 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 353b2e8e545e44768ec77f0cd0caa6e6
I20250115 10:12:05.763317 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.763396 4472 catalog_manager.cc:6596] ReplaceTablet: tablet 353b2e8e545e44768ec77f0cd0caa6e6 deleted and replaced by tablet 05b10c65bd70428aa016715d359de03f
I20250115 10:12:05.763442 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.763473 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.763552 3280 raft_consensus.cc:3054] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.763583 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7144ec81e9244eb49715450aeda5f82f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.763500 3274 raft_consensus.cc:3054] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.763736 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd8c55fd071d42b880becb81e6f70f27" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.763810 3547 raft_consensus.cc:3054] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.764384 3547 raft_consensus.cc:2463] T cd8c55fd071d42b880becb81e6f70f27 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.764386 3274 raft_consensus.cc:2463] T 7144ec81e9244eb49715450aeda5f82f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.764447 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 353b2e8e545e44768ec77f0cd0caa6e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 05b10c65bd70428aa016715d359de03f) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.764521 4589 tablet_replica.cc:331] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
W20250115 10:12:05.764518 3484 leader_election.cc:343] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.764580 4589 raft_consensus.cc:2238] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
W20250115 10:12:05.764600 3484 leader_election.cc:343] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.764628 4589 pending_rounds.cc:62] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Trying to abort 1 pending ops.
I20250115 10:12:05.764649 3485 leader_election.cc:304] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.764644 4589 pending_rounds.cc:69] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489550598197248 op_type: NO_OP noop_request { }
I20250115 10:12:05.764678 4589 raft_consensus.cc:2883] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:05.764674 4714 raft_consensus.cc:491] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.764698 4589 raft_consensus.cc:2267] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.764714 4714 raft_consensus.cc:513] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.764799 4884 raft_consensus.cc:2798] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.764835 4884 raft_consensus.cc:695] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.764817 4714 leader_election.cc:290] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.764871 4884 consensus_queue.cc:237] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.764899 4589 ts_tablet_manager.cc:1905] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.765599 3280 raft_consensus.cc:2463] T cd8c55fd071d42b880becb81e6f70f27 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.766122 3350 leader_election.cc:304] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.766250 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.766286 4589 ts_tablet_manager.cc:1918] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.766310 3275 raft_consensus.cc:2463] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.766341 4589 log.cc:1198] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/353b2e8e545e44768ec77f0cd0caa6e6
I20250115 10:12:05.766558 4589 ts_tablet_manager.cc:1939] T 353b2e8e545e44768ec77f0cd0caa6e6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.766623 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet 353b2e8e545e44768ec77f0cd0caa6e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 05b10c65bd70428aa016715d359de03f) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.766700 4551 tablet_replica.cc:331] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.766662 4877 raft_consensus.cc:2798] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.766743 4877 raft_consensus.cc:491] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.766765 4551 raft_consensus.cc:2238] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.766772 4877 raft_consensus.cc:3054] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.766804 4551 raft_consensus.cc:2267] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.766930 4551 ts_tablet_manager.cc:1905] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.767336 4575 tablet_bootstrap.cc:654] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.767580 4877 raft_consensus.cc:513] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.767690 4877 leader_election.cc:290] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.767951 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]) successfully deleted
I20250115 10:12:05.768043 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d71025830d794356b3160e61da8ecc96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.768175 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d71025830d794356b3160e61da8ecc96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.768493 4551 ts_tablet_manager.cc:1918] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:05.768513 3350 leader_election.cc:304] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.768553 4551 log.cc:1198] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/353b2e8e545e44768ec77f0cd0caa6e6
I20250115 10:12:05.768710 4551 ts_tablet_manager.cc:1939] T 353b2e8e545e44768ec77f0cd0caa6e6 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.768708 4587 raft_consensus.cc:2798] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.768760 4587 raft_consensus.cc:695] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.768795 4587 consensus_queue.cc:237] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.769415 4875 consensus_queue.cc:1035] T d02e33022c3840c28623200adb56e3bc P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.769920 3547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.770284 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.770345 3550 raft_consensus.cc:3054] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.770998 3550 raft_consensus.cc:2463] T 7a9d422fdac347ff85eca778c29858e8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.772612 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 353b2e8e545e44768ec77f0cd0caa6e6 (table default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]) successfully deleted
I20250115 10:12:05.772599 4434 consensus_queue.cc:1035] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.772782 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet 10c5cf464dcd484191838d56253ded0b from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.772871 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 05b10c65bd70428aa016715d359de03f (DEFAULT_TABLE table=default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.772974 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b10c65bd70428aa016715d359de03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.772979 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_f1f5edc3a940475c9c4190d008aa7eff" } new_table_name: "default.Table_7a58b1da744c4342865174f24b12bc0d" modify_external_catalogs: true
I20250115 10:12:05.773661 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 05b10c65bd70428aa016715d359de03f (DEFAULT_TABLE table=default.Table_792eee547bd24cc8aa8ad66532ec52b9 [id=59ace488897c42a3a28b6118667f6403]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.773761 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b10c65bd70428aa016715d359de03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.774705 4569 tablet_bootstrap.cc:492] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.774747 4569 ts_tablet_manager.cc:1397] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20250115 10:12:05.774894 4569 raft_consensus.cc:357] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.774961 4569 raft_consensus.cc:383] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.774992 4569 raft_consensus.cc:738] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.775033 4569 consensus_queue.cc:260] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.775141 4569 ts_tablet_manager.cc:1428] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:05.775206 4569 tablet_bootstrap.cc:492] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.775390 3550 raft_consensus.cc:3054] T 0496864e655e40dfac38619adbf4fd87 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.775650 4569 tablet_bootstrap.cc:654] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.775954 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4732608c02834f5891a70d4ec91b9e4b consensus state has no leader
I20250115 10:12:05.776067 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a9d422fdac347ff85eca778c29858e8" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.776118 3274 raft_consensus.cc:3054] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.776717 3274 raft_consensus.cc:2463] T 7a9d422fdac347ff85eca778c29858e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.776886 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.776930 3280 raft_consensus.cc:2463] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:05.777325 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 1bdd3fc0ade542899b44fb73203b886c (DEFAULT_TABLE table=default.Table_d71025830d794356b3160e61da8ecc96 [id=aee5dea422a64ca1a4f09db8efe6e118]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.777424 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdd3fc0ade542899b44fb73203b886c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.777529 5156 raft_consensus.cc:491] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.777576 5156 raft_consensus.cc:513] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.777671 5156 leader_election.cc:290] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.777698 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 1bdd3fc0ade542899b44fb73203b886c (DEFAULT_TABLE table=default.Table_d71025830d794356b3160e61da8ecc96 [id=aee5dea422a64ca1a4f09db8efe6e118]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.777705 5156 consensus_queue.cc:1035] T 367694b5edf143ef81e99e348543659a P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.777794 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdd3fc0ade542899b44fb73203b886c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.778537 3770 consensus_queue.cc:1035] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.778801 4731 consensus_queue.cc:1035] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.778950 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "698b856949484ae092d198e64e00634b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.778947 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2ea0b25b8a29445d8dedaaa0b48b7b3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.779047 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ea0b25b8a29445d8dedaaa0b48b7b3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:05.779397 3214 leader_election.cc:343] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.779912 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "698b856949484ae092d198e64e00634b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.780546 3215 leader_election.cc:343] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.780596 3215 leader_election.cc:304] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.780966 3350 leader_election.cc:304] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.781108 4875 raft_consensus.cc:2798] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.781147 4875 raft_consensus.cc:695] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.781180 4875 consensus_queue.cc:237] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.781426 3350 leader_election.cc:304] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.781487 4877 raft_consensus.cc:2798] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.781525 4877 raft_consensus.cc:491] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.781543 4877 raft_consensus.cc:3054] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.782192 4877 raft_consensus.cc:513] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.782272 4877 leader_election.cc:290] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.784612 3350 leader_election.cc:343] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.784785 4587 consensus_queue.cc:1035] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.786659 4575 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.786671 3545 raft_consensus.cc:3054] T 5ac231c1b8e04e8788f7bc368a87acdb P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.786703 4575 ts_tablet_manager.cc:1397] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.001s
I20250115 10:12:05.786804 4575 raft_consensus.cc:357] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.786845 4575 raft_consensus.cc:383] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.786860 4575 raft_consensus.cc:738] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.786895 4575 consensus_queue.cc:260] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.786973 4575 ts_tablet_manager.cc:1428] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.787025 4575 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.787102 3770 raft_consensus.cc:2743] T 698b856949484ae092d198e64e00634b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.787297 4575 tablet_bootstrap.cc:654] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.787433 3544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.787814 3278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.787881 3278 raft_consensus.cc:3054] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.788324 4699 consensus_queue.cc:1035] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.788478 3350 leader_election.cc:343] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.788530 3278 raft_consensus.cc:2463] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:05.789511 4434 consensus_queue.cc:1035] T 6de4d57d53c648b491f66f257414394d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.790392 4434 raft_consensus.cc:491] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.790444 4434 raft_consensus.cc:513] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.790551 4434 leader_election.cc:290] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:05.790771 3485 leader_election.cc:343] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 0922008e726c4e53b00b287261a2f0a3
I20250115 10:12:05.790787 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet bc3658cad19e46969abecacf490f43f1 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.791107 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 2d29401631a74e7eb3ae1bd44a8202aa (DEFAULT_TABLE table=default.Table_2ea0b25b8a29445d8dedaaa0b48b7b3f [id=4bb7ede4c44b49e6b2b668036bb37c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.791217 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d29401631a74e7eb3ae1bd44a8202aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.791440 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0922008e726c4e53b00b287261a2f0a3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.791512 3412 raft_consensus.cc:2388] T 0922008e726c4e53b00b287261a2f0a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.791658 4877 raft_consensus.cc:491] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.791719 4877 raft_consensus.cc:513] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.791803 4877 leader_election.cc:290] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.792223 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet bc3658cad19e46969abecacf490f43f1
I20250115 10:12:05.792291 4475 catalog_manager.cc:6596] ReplaceTablet: tablet bc3658cad19e46969abecacf490f43f1 deleted and replaced by tablet 6bea4b18a1824c9d98f8f5ae5163f2e6
I20250115 10:12:05.792500 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3658cad19e46969abecacf490f43f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bea4b18a1824c9d98f8f5ae5163f2e6) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.792934 4877 consensus_queue.cc:1035] T a577ace8245744d1a42938ddd99ce89b P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.793044 3514 tablet_service.cc:1467] Processing CreateTablet for tablet 2d29401631a74e7eb3ae1bd44a8202aa (DEFAULT_TABLE table=default.Table_2ea0b25b8a29445d8dedaaa0b48b7b3f [id=4bb7ede4c44b49e6b2b668036bb37c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.793136 3350 leader_election.cc:304] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.793205 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b854510e625043a7b89fa31b5d30acfb" } new_table_name: "default.Table_a4470ca42fef43cd9b6c046d568a524c" modify_external_catalogs: true
I20250115 10:12:05.793267 3548 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b83ca446824b88978e3dc3269d43a3" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.793311 4811 raft_consensus.cc:2798] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.793349 4811 raft_consensus.cc:695] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:05.793385 4811 consensus_queue.cc:237] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.793637 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet bc3658cad19e46969abecacf490f43f1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6bea4b18a1824c9d98f8f5ae5163f2e6) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.793754 4589 tablet_replica.cc:331] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.793833 4589 raft_consensus.cc:2238] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.793879 4589 raft_consensus.cc:2267] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.793993 4589 ts_tablet_manager.cc:1905] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.793980 3484 leader_election.cc:304] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.794098 4434 raft_consensus.cc:3054] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.794816 4434 raft_consensus.cc:2743] T 0922008e726c4e53b00b287261a2f0a3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.795171 4589 ts_tablet_manager.cc:1918] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.795207 4589 log.cc:1198] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/bc3658cad19e46969abecacf490f43f1
I20250115 10:12:05.795377 4589 ts_tablet_manager.cc:1939] T bc3658cad19e46969abecacf490f43f1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.796802 4714 raft_consensus.cc:491] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.796872 4714 raft_consensus.cc:513] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.796948 4714 leader_election.cc:290] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.797225 4551 tablet_replica.cc:331] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.797262 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]) successfully deleted
I20250115 10:12:05.797297 4551 raft_consensus.cc:2238] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.797336 4551 raft_consensus.cc:2267] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.797385 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_41f0a0e35e4742a08280c7dba0d31f45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.797438 4551 ts_tablet_manager.cc:1905] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:05.797497 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41f0a0e35e4742a08280c7dba0d31f45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.797833 4575 tablet_bootstrap.cc:492] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.797873 4575 ts_tablet_manager.cc:1397] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.000s
I20250115 10:12:05.797974 4575 raft_consensus.cc:357] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.798038 4575 raft_consensus.cc:383] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.798058 4575 raft_consensus.cc:738] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.798099 4575 consensus_queue.cc:260] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.798213 4575 ts_tablet_manager.cc:1428] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.798272 4575 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.798694 4575 tablet_bootstrap.cc:654] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.798866 4551 ts_tablet_manager.cc:1918] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:05.798905 4551 log.cc:1198] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/bc3658cad19e46969abecacf490f43f1
I20250115 10:12:05.799093 4551 ts_tablet_manager.cc:1939] T bc3658cad19e46969abecacf490f43f1 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.799304 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_7c4a2c54e77f4b99aafa437a104a0a58" } new_table_name: "default.Table_6a3d89b055284572b6f730115eb59e6d" modify_external_catalogs: true
W20250115 10:12:05.799397 3214 consensus_peers.cc:487] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.800369 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]) successfully deleted
I20250115 10:12:05.800665 4908 consensus_queue.cc:1035] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.801786 3514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d29401631a74e7eb3ae1bd44a8202aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.802304 3350 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.802935 3350 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 63b83ca446824b88978e3dc3269d43a3
I20250115 10:12:05.802974 3350 leader_election.cc:304] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.803220 4587 raft_consensus.cc:2743] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.803498 4587 consensus_queue.cc:1035] T 5ac231c1b8e04e8788f7bc368a87acdb P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.803680 4575 tablet_bootstrap.cc:492] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.803737 4575 ts_tablet_manager.cc:1397] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.803896 4575 raft_consensus.cc:357] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.803938 4575 raft_consensus.cc:383] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.803953 4575 raft_consensus.cc:738] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.803985 4575 consensus_queue.cc:260] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.804073 4575 ts_tablet_manager.cc:1428] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.804118 4575 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:05.804180 3350 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 3067eaaa090b4ffb95b2e741453113ed
I20250115 10:12:05.804447 4575 tablet_bootstrap.cc:654] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.804687 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.805347 4575 tablet_bootstrap.cc:492] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.805394 4575 ts_tablet_manager.cc:1397] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:05.805507 4575 raft_consensus.cc:357] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.805560 4575 raft_consensus.cc:383] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.805577 4575 raft_consensus.cc:738] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.805621 4575 consensus_queue.cc:260] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.805709 4575 ts_tablet_manager.cc:1428] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.805848 4575 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.806146 4575 tablet_bootstrap.cc:654] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.807440 5155 consensus_queue.cc:1035] T cb9629071de44cf69621ae3b2fd4e762 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.807984 3414 raft_consensus.cc:3054] T 368df29ba175447ba4c009c7eb15a49d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.810307 4714 consensus_queue.cc:1035] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.810328 3350 leader_election.cc:343] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 3067eaaa090b4ffb95b2e741453113ed
I20250115 10:12:05.810390 3350 leader_election.cc:304] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.810496 4699 raft_consensus.cc:2743] T 3067eaaa090b4ffb95b2e741453113ed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.810721 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet f4cee0b04c6e4eb39dd22668aacb2801 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.812750 4575 tablet_bootstrap.cc:492] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.812800 4575 ts_tablet_manager.cc:1397] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:05.812927 4575 raft_consensus.cc:357] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.812985 4575 raft_consensus.cc:383] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.813019 4575 raft_consensus.cc:738] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.813050 4575 consensus_queue.cc:260] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.813136 4575 ts_tablet_manager.cc:1428] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.813189 4575 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.813591 4575 tablet_bootstrap.cc:654] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.813625 4699 consensus_queue.cc:1035] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.814630 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f4cee0b04c6e4eb39dd22668aacb2801
I20250115 10:12:05.814707 4471 catalog_manager.cc:6596] ReplaceTablet: tablet f4cee0b04c6e4eb39dd22668aacb2801 deleted and replaced by tablet 63cf4c75dcfb4439afdd326ec8f76d3c
I20250115 10:12:05.816601 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet f4cee0b04c6e4eb39dd22668aacb2801 with delete_type TABLET_DATA_DELETED (replaced by tablet 63cf4c75dcfb4439afdd326ec8f76d3c) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.816692 4589 tablet_replica.cc:331] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.816926 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 64be03bdf0ce4522b38ce1943da5e799 (DEFAULT_TABLE table=default.Table_41f0a0e35e4742a08280c7dba0d31f45 [id=a543c69c2e3c4308b8e1abf925f3c35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.817055 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64be03bdf0ce4522b38ce1943da5e799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.817109 4589 raft_consensus.cc:2238] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.817159 4589 raft_consensus.cc:2267] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.817842 4908 raft_consensus.cc:491] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.817890 4908 raft_consensus.cc:513] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.817997 4908 leader_election.cc:290] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.818140 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203486455372404aa0a735cd219934be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.818307 3214 leader_election.cc:343] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.818646 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 6bea4b18a1824c9d98f8f5ae5163f2e6 (DEFAULT_TABLE table=default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.818750 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bea4b18a1824c9d98f8f5ae5163f2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.819916 3514 tablet_service.cc:1514] Processing DeleteTablet for tablet f4cee0b04c6e4eb39dd22668aacb2801 with delete_type TABLET_DATA_DELETED (replaced by tablet 63cf4c75dcfb4439afdd326ec8f76d3c) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.819972 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 64be03bdf0ce4522b38ce1943da5e799 (DEFAULT_TABLE table=default.Table_41f0a0e35e4742a08280c7dba0d31f45 [id=a543c69c2e3c4308b8e1abf925f3c35c]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.820024 4551 tablet_replica.cc:331] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.820060 4589 ts_tablet_manager.cc:1905] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.820078 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64be03bdf0ce4522b38ce1943da5e799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.820084 4551 raft_consensus.cc:2238] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.820188 4551 raft_consensus.cc:2267] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.820381 4575 tablet_bootstrap.cc:492] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.820416 4575 ts_tablet_manager.cc:1397] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:05.820416 4551 ts_tablet_manager.cc:1905] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.820547 4575 raft_consensus.cc:357] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.820591 4575 raft_consensus.cc:383] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.820605 4575 raft_consensus.cc:738] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.820647 4575 consensus_queue.cc:260] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.820721 4575 ts_tablet_manager.cc:1428] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.820770 4575 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.821161 4575 tablet_bootstrap.cc:654] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.821307 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 6bea4b18a1824c9d98f8f5ae5163f2e6 (DEFAULT_TABLE table=default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.821389 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bea4b18a1824c9d98f8f5ae5163f2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.821507 4589 ts_tablet_manager.cc:1918] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.821543 4589 log.cc:1198] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f4cee0b04c6e4eb39dd22668aacb2801
I20250115 10:12:05.821740 4589 ts_tablet_manager.cc:1939] T f4cee0b04c6e4eb39dd22668aacb2801 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.821858 4551 ts_tablet_manager.cc:1918] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.821905 4551 log.cc:1198] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f4cee0b04c6e4eb39dd22668aacb2801
I20250115 10:12:05.822098 4551 ts_tablet_manager.cc:1939] T f4cee0b04c6e4eb39dd22668aacb2801 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.822391 4662 tablet.cc:1721] T 75ab349b64b745ed97c3dae843b059aa P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.822614 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "203486455372404aa0a735cd219934be" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.824059 4873 tablet.cc:1721] T 75ab349b64b745ed97c3dae843b059aa P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:05.824144 3215 leader_election.cc:343] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.824180 3215 leader_election.cc:304] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.824234 4335 raft_consensus.cc:2743] T 203486455372404aa0a735cd219934be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.824998 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f4cee0b04c6e4eb39dd22668aacb2801 (table default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]) successfully deleted
I20250115 10:12:05.825163 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f4cee0b04c6e4eb39dd22668aacb2801 (table default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]) successfully deleted
I20250115 10:12:05.825894 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_67f6bdb00c9444329c707dc17cd672ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.826017 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67f6bdb00c9444329c707dc17cd672ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:05.826697 3484 consensus_peers.cc:487] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.827867 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 63cf4c75dcfb4439afdd326ec8f76d3c (DEFAULT_TABLE table=default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.827988 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63cf4c75dcfb4439afdd326ec8f76d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.828941 4335 raft_consensus.cc:491] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.828986 4335 raft_consensus.cc:513] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.829090 4335 leader_election.cc:290] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.829224 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.829298 3413 raft_consensus.cc:2463] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.829347 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.829420 3214 leader_election.cc:304] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.829494 4335 raft_consensus.cc:2798] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.829526 4335 raft_consensus.cc:491] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.829545 4335 raft_consensus.cc:3054] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.829571 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 63cf4c75dcfb4439afdd326ec8f76d3c (DEFAULT_TABLE table=default.Table_c97db29d95d248cebdd023d1400d4dab [id=5a96ffc3fc6443e3b0ee0413b8024853]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.829646 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63cf4c75dcfb4439afdd326ec8f76d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.830123 4335 raft_consensus.cc:513] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.830224 4335 leader_election.cc:290] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.830456 3215 leader_election.cc:343] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.830476 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.830549 3413 raft_consensus.cc:3054] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.830647 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.831245 3413 raft_consensus.cc:2463] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.831404 3214 leader_election.cc:304] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:05.831532 4335 raft_consensus.cc:2798] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.831569 4335 raft_consensus.cc:695] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.831604 4335 consensus_queue.cc:237] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:05.832134 3215 leader_election.cc:343] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.832134 4908 raft_consensus.cc:491] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.832347 4908 raft_consensus.cc:513] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.832506 4908 leader_election.cc:290] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.832691 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.832749 3541 raft_consensus.cc:2463] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.832779 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.832852 3215 leader_election.cc:304] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:05.833091 3214 leader_election.cc:343] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.833518 4908 raft_consensus.cc:2798] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.833575 4908 raft_consensus.cc:491] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.833592 4908 raft_consensus.cc:3054] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.834129 4908 raft_consensus.cc:513] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.834280 4908 leader_election.cc:290] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.834450 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:05.834602 3214 leader_election.cc:343] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.836369 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 19058e5705ee47c38088434f0adbee18 (DEFAULT_TABLE table=default.Table_67f6bdb00c9444329c707dc17cd672ed [id=b813e38d5680417a934094968e0c2b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.836457 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d31f180a3fc499fbd505c986593a7f5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:05.836529 3541 raft_consensus.cc:3054] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.836535 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 19058e5705ee47c38088434f0adbee18 (DEFAULT_TABLE table=default.Table_67f6bdb00c9444329c707dc17cd672ed [id=b813e38d5680417a934094968e0c2b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.836753 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19058e5705ee47c38088434f0adbee18. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.836921 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19058e5705ee47c38088434f0adbee18. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.837160 3541 raft_consensus.cc:2463] T 4d31f180a3fc499fbd505c986593a7f5 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.837299 3215 leader_election.cc:304] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.838306 4908 raft_consensus.cc:2798] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.838472 4908 raft_consensus.cc:695] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.838626 4908 consensus_queue.cc:237] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.846716 4575 tablet_bootstrap.cc:492] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.846778 4575 ts_tablet_manager.cc:1397] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.000s
I20250115 10:12:05.846942 4575 raft_consensus.cc:357] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.846998 4575 raft_consensus.cc:383] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.847018 4575 raft_consensus.cc:738] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.847059 4575 consensus_queue.cc:260] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.847162 4575 ts_tablet_manager.cc:1428] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.847226 4575 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.847602 4569 tablet_bootstrap.cc:492] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.847646 4569 ts_tablet_manager.cc:1397] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.072s user 0.001s sys 0.000s
I20250115 10:12:05.847826 4575 tablet_bootstrap.cc:654] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.847869 4557 tablet_bootstrap.cc:492] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.847848 4569 raft_consensus.cc:357] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.847913 4569 raft_consensus.cc:383] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.847921 4557 ts_tablet_manager.cc:1397] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.087s user 0.000s sys 0.000s
I20250115 10:12:05.847939 4569 raft_consensus.cc:738] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.847991 4569 consensus_queue.cc:260] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.848047 4557 raft_consensus.cc:357] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.848096 4569 ts_tablet_manager.cc:1428] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.848112 4557 raft_consensus.cc:383] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.848135 4557 raft_consensus.cc:738] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.848155 4569 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.848179 4557 consensus_queue.cc:260] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.848285 4557 ts_tablet_manager.cc:1428] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.848349 4557 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.848568 4569 tablet_bootstrap.cc:654] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.848639 4557 tablet_bootstrap.cc:654] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.849542 4338 raft_consensus.cc:491] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.849594 4338 raft_consensus.cc:513] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.849689 4338 leader_election.cc:290] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:05.849999 3485 leader_election.cc:343] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 65a0bd78c1e7409bb41392fd8f9a0862
W20250115 10:12:05.850251 3484 leader_election.cc:343] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 65a0bd78c1e7409bb41392fd8f9a0862
I20250115 10:12:05.850287 3484 leader_election.cc:304] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.850350 4338 raft_consensus.cc:2743] T 65a0bd78c1e7409bb41392fd8f9a0862 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.851691 4569 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.851764 4569 ts_tablet_manager.cc:1397] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20250115 10:12:05.852037 4569 raft_consensus.cc:357] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.852102 4569 raft_consensus.cc:383] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.852123 4569 raft_consensus.cc:738] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.852161 4569 consensus_queue.cc:260] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.852272 4569 ts_tablet_manager.cc:1428] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.852324 4569 tablet_bootstrap.cc:492] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.852764 4569 tablet_bootstrap.cc:654] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.852953 4557 tablet_bootstrap.cc:492] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.852995 4557 ts_tablet_manager.cc:1397] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.853128 4557 raft_consensus.cc:357] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.853174 4557 raft_consensus.cc:383] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.853191 4557 raft_consensus.cc:738] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.853225 4557 consensus_queue.cc:260] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.853307 4557 ts_tablet_manager.cc:1428] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.853317 4433 consensus_queue.cc:1035] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.853358 4557 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.853638 4557 tablet_bootstrap.cc:654] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.854126 4557 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.854171 4557 ts_tablet_manager.cc:1397] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.854267 4557 raft_consensus.cc:357] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.854323 4557 raft_consensus.cc:383] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.854346 4557 raft_consensus.cc:738] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.854383 4557 consensus_queue.cc:260] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.854472 4557 ts_tablet_manager.cc:1428] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.854533 4557 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.854823 4557 tablet_bootstrap.cc:654] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.855417 4338 consensus_queue.cc:1035] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.855947 4587 consensus_queue.cc:1035] T 0a612decf0634bd588f45c8953c6b201 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.856195 3328 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.858098 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a07cb910095f454d98b97363e9407cc8" } new_table_name: "default.Table_959972442aa0476cbfd88a3203fee356" modify_external_catalogs: true
I20250115 10:12:05.858822 4587 raft_consensus.cc:491] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.858876 4587 raft_consensus.cc:513] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.858974 4587 leader_election.cc:290] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.859143 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.859161 3277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd76846bc164480d9b77aa3d096260cb" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.859217 3550 raft_consensus.cc:2388] T fd76846bc164480d9b77aa3d096260cb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:05.859465 3350 leader_election.cc:304] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:05.859513 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21e2a71f1a0145309b037e34f1b398d6 consensus state has no leader
I20250115 10:12:05.859642 4587 raft_consensus.cc:3054] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.860396 4587 raft_consensus.cc:2743] T fd76846bc164480d9b77aa3d096260cb P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.860591 4662 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.861004 4890 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.861605 4569 tablet_bootstrap.cc:492] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.861655 4569 ts_tablet_manager.cc:1397] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20250115 10:12:05.861819 4569 raft_consensus.cc:357] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.861868 4569 raft_consensus.cc:383] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.861889 4569 raft_consensus.cc:738] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.861923 4569 consensus_queue.cc:260] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.862025 4569 ts_tablet_manager.cc:1428] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.862084 4569 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.862469 4569 tablet_bootstrap.cc:654] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.862545 3086 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet bc3658cad19e46969abecacf490f43f1 (table default.Table_267cadbaca5042b591ea75c7a6273863 [id=39c8477873484f1c9d9b6f684e33768f], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet bc3658cad19e46969abecacf490f43f1 has no consensus state
W20250115 10:12:05.862663 3214 consensus_peers.cc:487] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:05.862715 4890 tablet.cc:1721] T 75ab349b64b745ed97c3dae843b059aa P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.863971 4873 tablet.cc:1721] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:05.864279 4338 consensus_queue.cc:1035] T 14cea13b41bd47faafe774471c4163dc P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.868650 4575 tablet_bootstrap.cc:492] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.868702 4575 ts_tablet_manager.cc:1397] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:05.868856 4575 raft_consensus.cc:357] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.868933 4575 raft_consensus.cc:383] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.868957 4575 raft_consensus.cc:738] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.869000 4575 consensus_queue.cc:260] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.869104 4575 ts_tablet_manager.cc:1428] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.869168 4575 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.869607 4575 tablet_bootstrap.cc:654] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.871138 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_059f1d262ac843ba9c8607534829d23f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.871266 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_059f1d262ac843ba9c8607534829d23f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.871322 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_e77ffae7190c4775adb17bafffa4730e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.871380 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e77ffae7190c4775adb17bafffa4730e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.872419 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_434d338e81b3483abc4c479d6e073eb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.872537 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_434d338e81b3483abc4c479d6e073eb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.873483 4575 tablet_bootstrap.cc:492] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.873533 4575 ts_tablet_manager.cc:1397] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:05.873658 4575 raft_consensus.cc:357] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.873711 4575 raft_consensus.cc:383] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.873728 4575 raft_consensus.cc:738] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.873762 4575 consensus_queue.cc:260] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.873878 4575 ts_tablet_manager.cc:1428] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.873956 4575 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.874444 4575 tablet_bootstrap.cc:654] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.876320 4463 catalog_manager.cc:4670] Async tablet task AlterTable RPC for tablet 4732608c02834f5891a70d4ec91b9e4b (table default.Table_7a58b1da744c4342865174f24b12bc0d [id=64f5a62875674affa79349385d6db17f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4732608c02834f5891a70d4ec91b9e4b consensus state has no leader
I20250115 10:12:05.877699 5156 consensus_queue.cc:1035] T f2230f6de9a54e98aa83435d37f68807 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.883028 3770 consensus_queue.cc:1035] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.883184 4587 raft_consensus.cc:491] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.883242 4587 raft_consensus.cc:513] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.883375 4587 leader_election.cc:290] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.883580 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 0117b8780ede4af38109cb418d63eb9f (DEFAULT_TABLE table=default.Table_059f1d262ac843ba9c8607534829d23f [id=9f9a363fb1434a1082455833fece1a0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.883673 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.883751 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0117b8780ede4af38109cb418d63eb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.883682 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 337e0a069fb249b4a51417e9169b9e0d (DEFAULT_TABLE table=default.Table_434d338e81b3483abc4c479d6e073eb1 [id=6b574714d74c4c54b526fa6c681ec963]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.883795 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_0b220c82e11a4ae296b9541bb11c4df0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:05.883911 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337e0a069fb249b4a51417e9169b9e0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250115 10:12:05.883913 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b220c82e11a4ae296b9541bb11c4df0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.885083 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 337e0a069fb249b4a51417e9169b9e0d (DEFAULT_TABLE table=default.Table_434d338e81b3483abc4c479d6e073eb1 [id=6b574714d74c4c54b526fa6c681ec963]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.885172 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 337e0a069fb249b4a51417e9169b9e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.885592 4587 consensus_queue.cc:1035] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.886408 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 0117b8780ede4af38109cb418d63eb9f (DEFAULT_TABLE table=default.Table_059f1d262ac843ba9c8607534829d23f [id=9f9a363fb1434a1082455833fece1a0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.886510 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0117b8780ede4af38109cb418d63eb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.886902 4884 consensus_queue.cc:1035] T 54d9aaaa37d540cab41de4a083b36917 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.883577 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c85d63cc502f418b91aec39245c707b9" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.888386 3350 leader_election.cc:304] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.888548 4699 raft_consensus.cc:2743] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.888701 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 78e52f05d17d482699003ae3761823d8 (DEFAULT_TABLE table=default.Table_e77ffae7190c4775adb17bafffa4730e [id=18c095d5c2a74095bf4f15baa8f7aae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.888813 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e52f05d17d482699003ae3761823d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.888816 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 78e52f05d17d482699003ae3761823d8 (DEFAULT_TABLE table=default.Table_e77ffae7190c4775adb17bafffa4730e [id=18c095d5c2a74095bf4f15baa8f7aae9]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.888927 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e52f05d17d482699003ae3761823d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.889952 4557 tablet_bootstrap.cc:492] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.889994 4557 ts_tablet_manager.cc:1397] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.035s user 0.000s sys 0.001s
I20250115 10:12:05.890138 4557 raft_consensus.cc:357] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.890213 4557 raft_consensus.cc:383] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.890237 4557 raft_consensus.cc:738] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.890271 4557 consensus_queue.cc:260] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.890369 4557 ts_tablet_manager.cc:1428] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.890429 4557 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.890853 4557 tablet_bootstrap.cc:654] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.891677 4731 consensus_queue.cc:1035] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.892669 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 0f9d3a0bf6224e0d9625ea33fbccd229 (DEFAULT_TABLE table=default.Table_0b220c82e11a4ae296b9541bb11c4df0 [id=f77fb060ece0478186748caf3701ee59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.892786 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9d3a0bf6224e0d9625ea33fbccd229. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.893158 3410 raft_consensus.cc:3054] T 00e78a8b61e142199ba7bf73e3879b98 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.893244 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 0f9d3a0bf6224e0d9625ea33fbccd229 (DEFAULT_TABLE table=default.Table_0b220c82e11a4ae296b9541bb11c4df0 [id=f77fb060ece0478186748caf3701ee59]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.894172 4731 raft_consensus.cc:491] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.894224 4731 raft_consensus.cc:513] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.894335 4731 leader_election.cc:290] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.894577 3215 leader_election.cc:343] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 575f1a39f8a54c4cb21cd17d562c0542
I20250115 10:12:05.895359 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9d3a0bf6224e0d9625ea33fbccd229. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.895538 4338 consensus_queue.cc:1035] T 00e78a8b61e142199ba7bf73e3879b98 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.895632 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f1a39f8a54c4cb21cd17d562c0542" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.895699 3410 raft_consensus.cc:2463] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:05.896268 3214 leader_election.cc:304] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.896389 4731 raft_consensus.cc:2798] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.896420 4731 raft_consensus.cc:491] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.896442 4731 raft_consensus.cc:3054] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.897445 3276 raft_consensus.cc:1212] T d35847dc829b4b3d94c0fb68ec6c2b31 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20250115 10:12:05.897616 4731 raft_consensus.cc:513] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.897734 4731 leader_election.cc:290] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.898002 3215 leader_election.cc:343] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 575f1a39f8a54c4cb21cd17d562c0542
I20250115 10:12:05.898118 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f1a39f8a54c4cb21cd17d562c0542" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.898195 3411 raft_consensus.cc:3054] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.898191 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_8b44d5a241b741edbf3c2e5c8fcb4cb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.898316 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8b44d5a241b741edbf3c2e5c8fcb4cb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.898931 3411 raft_consensus.cc:2463] T 575f1a39f8a54c4cb21cd17d562c0542 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:05.898947 4557 tablet_bootstrap.cc:492] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.899006 4557 ts_tablet_manager.cc:1397] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:05.899152 4557 raft_consensus.cc:357] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.899212 4557 raft_consensus.cc:383] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.899230 4557 raft_consensus.cc:738] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.899276 4557 consensus_queue.cc:260] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.899257 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_92353e1e77764d8ea55b49240079fe25"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.899348 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_92353e1e77764d8ea55b49240079fe25 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.899367 4557 ts_tablet_manager.cc:1428] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.899418 4557 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.899392 4699 consensus_queue.cc:1035] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.899747 3214 leader_election.cc:304] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.899859 5156 raft_consensus.cc:2798] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.899899 5156 raft_consensus.cc:695] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:05.899956 4557 tablet_bootstrap.cc:654] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.899935 5156 consensus_queue.cc:237] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.903159 5156 consensus_queue.cc:1035] T 3552b8e936ad4aeba0eadc95577f5414 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.905185 4875 consensus_queue.cc:1035] T fa36e39d9f1c4cecbd0f6679b0397e3c P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.905532 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 761b51d08b2b4ec99a2d4ef760c442b1 (DEFAULT_TABLE table=default.Table_8b44d5a241b741edbf3c2e5c8fcb4cb3 [id=b277ac58c8844ff1ab474253cfee060e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.905647 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761b51d08b2b4ec99a2d4ef760c442b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.905969 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 761b51d08b2b4ec99a2d4ef760c442b1 (DEFAULT_TABLE table=default.Table_8b44d5a241b741edbf3c2e5c8fcb4cb3 [id=b277ac58c8844ff1ab474253cfee060e]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.906081 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 761b51d08b2b4ec99a2d4ef760c442b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.907152 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_36020db3fd0f4775babdeb0f2449300a" } modify_external_catalogs: true
I20250115 10:12:05.907225 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_36020db3fd0f4775babdeb0f2449300a" } modify_external_catalogs: true
I20250115 10:12:05.908691 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 8eeccaf56fe14fae848bdd4ea19eee9c (DEFAULT_TABLE table=default.Table_92353e1e77764d8ea55b49240079fe25 [id=afd485739bb6482da2945d811d70b306]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.908833 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eeccaf56fe14fae848bdd4ea19eee9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.908834 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet eb659a11e3ed4f23ac90bfa8ee108c9b
I20250115 10:12:05.909716 3244 tablet_service.cc:1467] Processing CreateTablet for tablet 8eeccaf56fe14fae848bdd4ea19eee9c (DEFAULT_TABLE table=default.Table_92353e1e77764d8ea55b49240079fe25 [id=afd485739bb6482da2945d811d70b306]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.909819 3244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eeccaf56fe14fae848bdd4ea19eee9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.910023 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet eb659a11e3ed4f23ac90bfa8ee108c9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:05.910302 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet eb659a11e3ed4f23ac90bfa8ee108c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb659a11e3ed4f23ac90bfa8ee108c9b already in progress: creating tablet
I20250115 10:12:05.910492 3463 heartbeater.cc:346] Connected to a master server at 127.2.217.189:36717
I20250115 10:12:05.911410 4887 consensus_queue.cc:1035] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.911945 5156 raft_consensus.cc:491] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:05.912021 5156 raft_consensus.cc:513] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.912122 5156 leader_election.cc:290] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:05.912386 3214 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
W20250115 10:12:05.912773 3215 leader_election.cc:343] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d667834206fe4410a22b4944b3494462
I20250115 10:12:05.912818 3215 leader_election.cc:304] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.912892 5156 raft_consensus.cc:2743] T d667834206fe4410a22b4944b3494462 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250115 10:12:05.913486 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a0216b717e5a4a1baf7405dba7971710" } modify_external_catalogs: true
I20250115 10:12:05.913548 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a0216b717e5a4a1baf7405dba7971710" } modify_external_catalogs: true
I20250115 10:12:05.913784 4557 tablet_bootstrap.cc:492] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.913827 4557 ts_tablet_manager.cc:1397] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:05.914013 4557 raft_consensus.cc:357] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.914080 4557 raft_consensus.cc:383] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.914101 4557 raft_consensus.cc:738] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.914135 4557 consensus_queue.cc:260] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.914232 4557 ts_tablet_manager.cc:1428] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:05.914283 4557 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.914685 4557 tablet_bootstrap.cc:654] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.915545 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0a6610d76f1e4d62a37a4da9a89c7dfc
I20250115 10:12:05.915959 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.916051 4551 tablet_replica.cc:331] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.916131 4551 raft_consensus.cc:2238] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.916199 4551 raft_consensus.cc:2267] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.916265 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a6610d76f1e4d62a37a4da9a89c7dfc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.916306 4551 ts_tablet_manager.cc:1905] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.916343 4589 tablet_replica.cc:331] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.916406 4589 raft_consensus.cc:2238] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.916461 4589 raft_consensus.cc:2267] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.916569 4589 ts_tablet_manager.cc:1905] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.918037 4589 ts_tablet_manager.cc:1918] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.918098 4589 log.cc:1198] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/0a6610d76f1e4d62a37a4da9a89c7dfc
I20250115 10:12:05.918104 4551 ts_tablet_manager.cc:1918] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.918147 4551 log.cc:1198] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/0a6610d76f1e4d62a37a4da9a89c7dfc
I20250115 10:12:05.918334 4589 ts_tablet_manager.cc:1939] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.918351 4551 ts_tablet_manager.cc:1939] T 0a6610d76f1e4d62a37a4da9a89c7dfc P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.918871 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (table default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]) successfully deleted
I20250115 10:12:05.919534 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet eb659a11e3ed4f23ac90bfa8ee108c9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.919878 4569 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.919924 4569 ts_tablet_manager.cc:1397] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.000s
I20250115 10:12:05.920071 4569 raft_consensus.cc:357] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.920127 4569 raft_consensus.cc:383] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.920145 4569 raft_consensus.cc:738] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.920185 4569 consensus_queue.cc:260] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.920287 4569 ts_tablet_manager.cc:1428] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.920810 4557 tablet_bootstrap.cc:492] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.920856 4557 ts_tablet_manager.cc:1397] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:05.920998 4557 raft_consensus.cc:357] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.921048 4557 raft_consensus.cc:383] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.921066 4557 raft_consensus.cc:738] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.921108 4557 consensus_queue.cc:260] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.921226 4557 ts_tablet_manager.cc:1428] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.921290 4557 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.921679 4557 tablet_bootstrap.cc:654] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.922952 4569 tablet_bootstrap.cc:492] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.923441 4569 tablet_bootstrap.cc:654] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.923830 4557 tablet_bootstrap.cc:492] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:05.923872 4557 ts_tablet_manager.cc:1397] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:05.923993 4557 raft_consensus.cc:357] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.924041 4557 raft_consensus.cc:383] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.924060 4557 raft_consensus.cc:738] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.924046 3410 raft_consensus.cc:3054] T c77afc007fac49848786aaecd4d1e214 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.924111 4557 consensus_queue.cc:260] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.924196 4557 ts_tablet_manager.cc:1428] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.924247 4557 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:05.924710 4557 tablet_bootstrap.cc:654] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.924916 3415 raft_consensus.cc:3054] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.926033 4890 tablet.cc:1721] T bfe0522e3e664012a00ec78a09c2816c P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:05.926180 4875 raft_consensus.cc:491] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.926223 4875 raft_consensus.cc:513] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.926332 4875 leader_election.cc:290] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.926373 4884 consensus_queue.cc:1035] T c77afc007fac49848786aaecd4d1e214 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.926591 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 0a6610d76f1e4d62a37a4da9a89c7dfc (table default.Table_a0216b717e5a4a1baf7405dba7971710 [id=f09ac68779554ab3aa014d55526dd30f]) successfully deleted
W20250115 10:12:05.926666 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet eb659a11e3ed4f23ac90bfa8ee108c9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb659a11e3ed4f23ac90bfa8ee108c9b already in progress: creating tablet
I20250115 10:12:05.926734 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a18829801a1a425db66f31c40f95401b" } modify_external_catalogs: true
I20250115 10:12:05.926805 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a18829801a1a425db66f31c40f95401b" } modify_external_catalogs: true
W20250115 10:12:05.927423 3350 leader_election.cc:343] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 2d30f49da63241a2a794a7a18e026473
W20250115 10:12:05.927489 3350 leader_election.cc:343] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 2d30f49da63241a2a794a7a18e026473
I20250115 10:12:05.927515 3350 leader_election.cc:304] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.927582 4875 raft_consensus.cc:2743] T 2d30f49da63241a2a794a7a18e026473 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.928654 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f82d295124504a7d811c628fca65f439
I20250115 10:12:05.928937 4884 consensus_queue.cc:1035] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.929266 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet f82d295124504a7d811c628fca65f439 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:05.929613 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f82d295124504a7d811c628fca65f439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f82d295124504a7d811c628fca65f439 already in progress: creating tablet
I20250115 10:12:05.929812 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3" } modify_external_catalogs: true
I20250115 10:12:05.929874 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3" } modify_external_catalogs: true
I20250115 10:12:05.930379 4569 tablet_bootstrap.cc:492] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.930426 4569 ts_tablet_manager.cc:1397] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:05.930567 4569 raft_consensus.cc:357] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.930648 4569 raft_consensus.cc:383] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.930670 4569 raft_consensus.cc:738] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.930697 4569 consensus_queue.cc:260] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.930790 4569 ts_tablet_manager.cc:1428] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.930853 4569 tablet_bootstrap.cc:492] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.931368 4569 tablet_bootstrap.cc:654] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.932211 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f560f9e7e84d47faa147b33495e85055
I20250115 10:12:05.932570 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet f560f9e7e84d47faa147b33495e85055 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.932718 4551 tablet_replica.cc:331] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.932729 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet f560f9e7e84d47faa147b33495e85055 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.932790 4551 raft_consensus.cc:2238] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.932826 4551 raft_consensus.cc:2267] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.932859 4589 tablet_replica.cc:331] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.932919 4589 raft_consensus.cc:2238] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.932925 4551 ts_tablet_manager.cc:1905] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.932996 4589 raft_consensus.cc:2267] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.933099 4589 ts_tablet_manager.cc:1905] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.933362 4884 raft_consensus.cc:491] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.933429 4884 raft_consensus.cc:513] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.933533 4884 leader_election.cc:290] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.933719 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.934288 4551 ts_tablet_manager.cc:1918] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.934335 4551 log.cc:1198] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/f560f9e7e84d47faa147b33495e85055
I20250115 10:12:05.934533 4551 ts_tablet_manager.cc:1939] T f560f9e7e84d47faa147b33495e85055 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.934631 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50d2f7ec7d44422ebc35e29797bfd456" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.934742 4589 ts_tablet_manager.cc:1918] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.934810 4589 log.cc:1198] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/f560f9e7e84d47faa147b33495e85055
I20250115 10:12:05.935024 4589 ts_tablet_manager.cc:1939] T f560f9e7e84d47faa147b33495e85055 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.935387 3484 leader_election.cc:304] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.935572 4884 raft_consensus.cc:2743] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.935669 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet f560f9e7e84d47faa147b33495e85055 (table default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]) successfully deleted
I20250115 10:12:05.935684 5156 consensus_queue.cc:1035] T 5403eb7ca3b74d6e8110f97c17e1aa67 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.935775 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet f560f9e7e84d47faa147b33495e85055 (table default.Table_88f0a9f2565c4957aaf19a4a60e8a2c3 [id=4e99055e0fea4d4d921d7ac4bf9b1a99]) successfully deleted
I20250115 10:12:05.930558 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet f82d295124504a7d811c628fca65f439 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.936928 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f82d295124504a7d811c628fca65f439 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f82d295124504a7d811c628fca65f439 already in progress: creating tablet
I20250115 10:12:05.940451 4884 raft_consensus.cc:491] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.940505 4884 raft_consensus.cc:513] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.940587 4884 leader_election.cc:290] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.940804 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.940979 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.941054 3280 raft_consensus.cc:2463] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:05.941205 3485 leader_election.cc:304] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:05.941335 4884 raft_consensus.cc:2798] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:05.941367 4884 raft_consensus.cc:491] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:05.941401 4884 raft_consensus.cc:3054] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.941682 3484 leader_election.cc:343] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.942096 4884 raft_consensus.cc:513] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.942216 4884 leader_election.cc:290] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.942432 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:05.942552 4569 tablet_bootstrap.cc:492] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.942620 4569 ts_tablet_manager.cc:1397] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
W20250115 10:12:05.942718 3484 leader_election.cc:343] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.942823 4569 raft_consensus.cc:357] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.942885 4569 raft_consensus.cc:383] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.942865 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:05.942905 4569 raft_consensus.cc:738] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.942929 3274 raft_consensus.cc:3054] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.942946 4569 consensus_queue.cc:260] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.943058 4569 ts_tablet_manager.cc:1428] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.943112 4569 tablet_bootstrap.cc:492] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.943608 4569 tablet_bootstrap.cc:654] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.943620 3274 raft_consensus.cc:2463] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:05.945812 3485 leader_election.cc:304] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:05.945909 4434 raft_consensus.cc:2798] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:05.945956 4434 raft_consensus.cc:695] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:05.945996 4434 consensus_queue.cc:237] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.946240 4569 tablet_bootstrap.cc:492] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.946285 4569 ts_tablet_manager.cc:1397] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:05.946382 4569 raft_consensus.cc:357] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.946429 4569 raft_consensus.cc:383] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.946447 4569 raft_consensus.cc:738] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.946482 4569 consensus_queue.cc:260] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.946563 4569 ts_tablet_manager.cc:1428] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.946552 4338 consensus_queue.cc:1035] T 4283a096b18b4be69e1f57e60c3efd3e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.946607 4569 tablet_bootstrap.cc:492] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.947036 4569 tablet_bootstrap.cc:654] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.951584 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet cb8da7533f8041768533184ef0a33d3f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.952237 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ea54e14fe9b8407eaea2930768da997b" } modify_external_catalogs: true
I20250115 10:12:05.952308 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_ea54e14fe9b8407eaea2930768da997b" } modify_external_catalogs: true
I20250115 10:12:05.952886 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet cb8da7533f8041768533184ef0a33d3f
I20250115 10:12:05.952961 4472 catalog_manager.cc:6596] ReplaceTablet: tablet cb8da7533f8041768533184ef0a33d3f deleted and replaced by tablet 179586765f9f4356b3f8686e1f017830
I20250115 10:12:05.953120 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet cb8da7533f8041768533184ef0a33d3f with delete_type TABLET_DATA_DELETED (replaced by tablet 179586765f9f4356b3f8686e1f017830) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:05.953310 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet cb8da7533f8041768533184ef0a33d3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8da7533f8041768533184ef0a33d3f already in progress: creating tablet
I20250115 10:12:05.953763 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet cb8da7533f8041768533184ef0a33d3f with delete_type TABLET_DATA_DELETED (replaced by tablet 179586765f9f4356b3f8686e1f017830) from {username='slave'} at 127.0.0.1:43854
W20250115 10:12:05.953927 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet cb8da7533f8041768533184ef0a33d3f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8da7533f8041768533184ef0a33d3f already in progress: creating tablet
I20250115 10:12:05.954090 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 9b411b205211442ab38d261b22c97d07
I20250115 10:12:05.954072 4714 raft_consensus.cc:491] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.954128 4714 raft_consensus.cc:513] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.954229 4714 leader_election.cc:290] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.954277 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b411b205211442ab38d261b22c97d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.954315 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b411b205211442ab38d261b22c97d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:05 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.954419 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:05.954727 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 9b411b205211442ab38d261b22c97d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b411b205211442ab38d261b22c97d07 already in progress: creating tablet
I20250115 10:12:05.954716 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec19ae50a374ef3a5e7b00cfcadeee2" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.954792 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 9b411b205211442ab38d261b22c97d07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9b411b205211442ab38d261b22c97d07 already in progress: creating tablet
I20250115 10:12:05.955231 3350 leader_election.cc:304] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.955323 4714 raft_consensus.cc:2743] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.955524 4569 tablet_bootstrap.cc:492] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.955569 4569 ts_tablet_manager.cc:1397] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20250115 10:12:05.955713 4569 raft_consensus.cc:357] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.955782 4569 raft_consensus.cc:383] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.955801 4569 raft_consensus.cc:738] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.955838 4569 consensus_queue.cc:260] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.955933 4569 ts_tablet_manager.cc:1428] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.955996 4569 tablet_bootstrap.cc:492] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.956393 4569 tablet_bootstrap.cc:654] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.957273 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 179586765f9f4356b3f8686e1f017830 (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.957378 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179586765f9f4356b3f8686e1f017830. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.957747 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 179586765f9f4356b3f8686e1f017830 (DEFAULT_TABLE table=default.Table_6ed41c92835e4b20bc0d79a5a7573355 [id=4741be8a0aff471eb3f46332753cc9b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.957834 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 179586765f9f4356b3f8686e1f017830. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.960601 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_5c001d1a075b4563ad22475f486ee7a2" } new_table_name: "default.Table_2b417d6ebaef46a7a43d40e00887e113" modify_external_catalogs: true
W20250115 10:12:05.961544 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d16a22c6f2be4f8c83c3ef073ee6ff7e consensus state has no leader
I20250115 10:12:05.961874 5751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap replayed 1/1 log segments. Stats: ops{read=1688 overwritten=0 applied=1687 ignored=0} inserts{seen=1184 ignored=0} mutations{seen=2133 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20250115 10:12:05.962301 5751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: Bootstrap complete.
W20250115 10:12:05.964203 3214 consensus_peers.cc:487] T 13abbfea00154474b1082cf8ccd14899 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13abbfea00154474b1082cf8ccd14899. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:05.964236 5751 raft_consensus.cc:357] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:05.964812 4877 raft_consensus.cc:491] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.964871 4877 raft_consensus.cc:513] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.964959 4877 leader_election.cc:290] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.964948 5751 raft_consensus.cc:738] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: efd4346420bb4a5abb9cf66799e35565, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.965066 5751 consensus_queue.cc:260] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1687, Last appended: 3.1688, Last appended by leader: 1688, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } }
I20250115 10:12:05.965330 4569 tablet_bootstrap.cc:492] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.965375 4569 ts_tablet_manager.cc:1397] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.000s
I20250115 10:12:05.965369 5751 sys_catalog.cc:564] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: configured and running, proceeding with master startup.
I20250115 10:12:05.965543 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.965543 4569 raft_consensus.cc:357] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.965706 4569 raft_consensus.cc:383] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.965730 4569 raft_consensus.cc:738] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.965757 4569 consensus_queue.cc:260] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.965862 4569 ts_tablet_manager.cc:1428] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.965934 4569 tablet_bootstrap.cc:492] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.966445 4569 tablet_bootstrap.cc:654] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.967087 4569 tablet_bootstrap.cc:492] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.967132 4569 ts_tablet_manager.cc:1397] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:05.967270 4569 raft_consensus.cc:357] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.967332 4569 raft_consensus.cc:383] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.967350 4569 raft_consensus.cc:738] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.967379 4569 consensus_queue.cc:260] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.967454 4569 ts_tablet_manager.cc:1428] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.967525 4569 tablet_bootstrap.cc:492] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.967963 4569 tablet_bootstrap.cc:654] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.968358 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7f182c4bde468d919523c44fdf3ea4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.969355 5715 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" instance_seqno: 1736935911435877) as {username='slave'} at 127.2.217.129:49709; Asking this server to re-register.
I20250115 10:12:05.969769 3328 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:05.969890 3350 leader_election.cc:304] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.970723 4699 raft_consensus.cc:2743] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.972030 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet c35ca809b19541479146f385e1d3cebe from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.966949 5904 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:05.973486 5904 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:05.973811 4569 tablet_bootstrap.cc:492] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.973855 4569 ts_tablet_manager.cc:1397] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:05.974014 4569 raft_consensus.cc:357] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.974073 4569 raft_consensus.cc:383] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.974093 4569 raft_consensus.cc:738] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.974133 4569 consensus_queue.cc:260] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.974224 4569 ts_tablet_manager.cc:1428] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.974274 4569 tablet_bootstrap.cc:492] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.974301 4731 raft_consensus.cc:491] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.974346 4731 raft_consensus.cc:513] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.974434 4731 leader_election.cc:290] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.974593 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.974690 4569 tablet_bootstrap.cc:654] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:05.974754 3215 leader_election.cc:343] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.975138 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:05.975288 3214 leader_election.cc:343] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.975342 3214 leader_election.cc:304] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.975411 4731 raft_consensus.cc:2743] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.976004 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet c35ca809b19541479146f385e1d3cebe
I20250115 10:12:05.976100 4475 catalog_manager.cc:6596] ReplaceTablet: tablet c35ca809b19541479146f385e1d3cebe deleted and replaced by tablet 804b1488a29c4ace8767bc2ce7f303e8
I20250115 10:12:05.975724 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_be913d6216e9485c8aa9ac7a5ac0e801"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.976183 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be913d6216e9485c8aa9ac7a5ac0e801 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.976323 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet c35ca809b19541479146f385e1d3cebe with delete_type TABLET_DATA_DELETED (replaced by tablet 804b1488a29c4ace8767bc2ce7f303e8) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:05.976395 4551 tablet_replica.cc:331] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:05.976456 4551 raft_consensus.cc:2238] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:05.976500 4551 raft_consensus.cc:2267] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.976488 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet c35ca809b19541479146f385e1d3cebe with delete_type TABLET_DATA_DELETED (replaced by tablet 804b1488a29c4ace8767bc2ce7f303e8) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:05.976557 4589 tablet_replica.cc:331] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:05.976603 4589 raft_consensus.cc:2238] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:05.976611 4551 ts_tablet_manager.cc:1905] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.976680 4589 raft_consensus.cc:2267] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:05.976790 4589 ts_tablet_manager.cc:1905] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:05.977195 4434 raft_consensus.cc:491] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.977247 4434 raft_consensus.cc:513] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.977345 4434 leader_election.cc:290] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:05.977521 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.977540 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_678ef7dde9ff47eb8784ba89b357b3e1" } new_table_name: "default.Table_87a56815ad4d4166be6b74869dcbeaf8" modify_external_catalogs: true
I20250115 10:12:05.977715 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77b422773c3346199383ca64330719c6" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.977874 3485 leader_election.cc:304] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:05.977939 4434 raft_consensus.cc:2743] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.978178 4551 ts_tablet_manager.cc:1918] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.978211 4589 ts_tablet_manager.cc:1918] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:05.978230 4551 log.cc:1198] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/c35ca809b19541479146f385e1d3cebe
I20250115 10:12:05.978251 4589 log.cc:1198] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/c35ca809b19541479146f385e1d3cebe
I20250115 10:12:05.978457 4551 ts_tablet_manager.cc:1939] T c35ca809b19541479146f385e1d3cebe P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:05.978459 4589 ts_tablet_manager.cc:1939] T c35ca809b19541479146f385e1d3cebe P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:05.979434 4569 tablet_bootstrap.cc:492] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.979471 4569 ts_tablet_manager.cc:1397] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:05.979600 4569 raft_consensus.cc:357] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.979640 4569 raft_consensus.cc:383] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.979653 4569 raft_consensus.cc:738] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.979694 4569 consensus_queue.cc:260] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.980917 5713 ts_manager.cc:194] Registered new tserver with Master: 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:05.981472 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e21235d57f084015accfee0e31f36918 consensus state has no leader
I20250115 10:12:05.982872 4569 ts_tablet_manager.cc:1428] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:05.982950 4569 tablet_bootstrap.cc:492] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.983120 5713 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" instance_seqno: 1736935911647047) as {username='slave'} at 127.2.217.131:57997; Asking this server to re-register.
W20250115 10:12:05.983152 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 12648ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:05.983428 4569 tablet_bootstrap.cc:654] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.983462 4699 raft_consensus.cc:491] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.983510 4699 raft_consensus.cc:513] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.983656 4699 leader_election.cc:290] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.983767 4699 raft_consensus.cc:491] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.983801 4699 raft_consensus.cc:513] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.983846 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.983889 4699 leader_election.cc:290] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.983980 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cff85958d3c46069b1dd9bf5cb75ca4" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.984210 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:05.984211 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b114b291fd734797bd6622d89e309925" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:05.984470 3350 leader_election.cc:304] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.984473 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet c35ca809b19541479146f385e1d3cebe (table default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]) successfully deleted
I20250115 10:12:05.984541 4699 raft_consensus.cc:2743] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.984549 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 804b1488a29c4ace8767bc2ce7f303e8 (DEFAULT_TABLE table=default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.984561 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet c35ca809b19541479146f385e1d3cebe (table default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]) successfully deleted
I20250115 10:12:05.984563 3350 leader_election.cc:304] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.984609 4714 raft_consensus.cc:2743] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.984633 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804b1488a29c4ace8767bc2ce7f303e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.984701 3530 tablet_service.cc:1467] Processing CreateTablet for tablet 804b1488a29c4ace8767bc2ce7f303e8 (DEFAULT_TABLE table=default.Table_b185d0f89c564115aaaf3d37e2757442 [id=d80b05250b564bc1a22cb6c5caa50177]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.984798 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804b1488a29c4ace8767bc2ce7f303e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.985179 3598 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:05.985219 5920 sys_catalog.cc:455] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f5e7c003a641128acc22b394ab62c7. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:05.985417 5920 sys_catalog.cc:458] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565 [sys.catalog]: This master's current role is: FOLLOWER
I20250115 10:12:05.986066 5715 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" instance_seqno: 1736935911544757) as {username='slave'} at 127.2.217.130:39055; Asking this server to re-register.
I20250115 10:12:05.986196 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 8cc5552447d348e58205a130d74eb808 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:05.986666 3463 heartbeater.cc:463] Registering TS with master...
I20250115 10:12:05.987385 5715 ts_manager.cc:194] Registered new tserver with Master: 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.987725 3257 tablet_service.cc:1467] Processing CreateTablet for tablet cfe3baa5e6db489292635a5fc59ddb32 (DEFAULT_TABLE table=default.Table_be913d6216e9485c8aa9ac7a5ac0e801 [id=65bbd58a6013474eb95c1d5935a6a7ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.987821 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3baa5e6db489292635a5fc59ddb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.988106 4731 raft_consensus.cc:491] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.988147 4731 raft_consensus.cc:513] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.988237 4731 leader_election.cc:290] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.988379 5715 ts_manager.cc:194] Registered new tserver with Master: 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:05.988457 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7d25c542714a6ea0b75591aea35b9e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.988867 3215 leader_election.cc:343] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.988929 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef7d25c542714a6ea0b75591aea35b9e" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.989019 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_396fbb78b7124b1b9d356d5b936e701a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:05.989114 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_396fbb78b7124b1b9d356d5b936e701a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:05.989243 3550 raft_consensus.cc:3054] T 50d2f7ec7d44422ebc35e29797bfd456 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:05.989318 3214 leader_election.cc:343] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.989352 3214 leader_election.cc:304] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.989563 3770 raft_consensus.cc:2743] T ef7d25c542714a6ea0b75591aea35b9e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.990123 4587 consensus_queue.cc:1035] T 50d2f7ec7d44422ebc35e29797bfd456 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.991814 3530 tablet_service.cc:1467] Processing CreateTablet for tablet cfe3baa5e6db489292635a5fc59ddb32 (DEFAULT_TABLE table=default.Table_be913d6216e9485c8aa9ac7a5ac0e801 [id=65bbd58a6013474eb95c1d5935a6a7ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.991914 3530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe3baa5e6db489292635a5fc59ddb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.992225 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 1251ff5d00bd4fac85ff0339f41f08aa (DEFAULT_TABLE table=default.Table_396fbb78b7124b1b9d356d5b936e701a [id=513831b454534ccea44eb200f8b40be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.992307 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1251ff5d00bd4fac85ff0339f41f08aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.992961 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 1251ff5d00bd4fac85ff0339f41f08aa (DEFAULT_TABLE table=default.Table_396fbb78b7124b1b9d356d5b936e701a [id=513831b454534ccea44eb200f8b40be0]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:05.993038 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1251ff5d00bd4fac85ff0339f41f08aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:05.994230 3413 raft_consensus.cc:3054] T 6fe929017262442094800c874183f5de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:05.994506 4575 tablet_bootstrap.cc:492] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:05.994515 4569 tablet_bootstrap.cc:492] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:05.994547 4575 ts_tablet_manager.cc:1397] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.121s user 0.000s sys 0.001s
I20250115 10:12:05.994553 4569 ts_tablet_manager.cc:1397] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20250115 10:12:05.994675 4575 raft_consensus.cc:357] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.994691 4569 raft_consensus.cc:357] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.994727 4575 raft_consensus.cc:383] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.994740 4569 raft_consensus.cc:383] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:05.994746 4575 raft_consensus.cc:738] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.994757 4569 raft_consensus.cc:738] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:05.994793 4569 consensus_queue.cc:260] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:05.994786 4575 consensus_queue.cc:260] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:05.994910 4569 ts_tablet_manager.cc:1428] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.994930 4575 ts_tablet_manager.cc:1428] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:05.994961 4569 tablet_bootstrap.cc:492] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:05.995023 4575 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:05.995483 4575 tablet_bootstrap.cc:654] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.995502 4569 tablet_bootstrap.cc:654] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:05.996062 4731 consensus_queue.cc:1035] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:05.996919 3214 consensus_peers.cc:487] T d92890d082e242ccae8ad4e40d056c74 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d92890d082e242ccae8ad4e40d056c74. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:05.997248 4731 raft_consensus.cc:491] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:05.997292 4731 raft_consensus.cc:513] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:05.997376 4731 leader_election.cc:290] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:05.997557 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c5cf464dcd484191838d56253ded0b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:05.997602 3543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10c5cf464dcd484191838d56253ded0b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:05.997766 3214 leader_election.cc:343] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:05.997824 3215 leader_election.cc:343] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:05.997844 3215 leader_election.cc:304] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:05.997901 5156 raft_consensus.cc:2743] T 10c5cf464dcd484191838d56253ded0b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:05.999086 4434 consensus_queue.cc:1035] T b110fe6c13204cf295abb29839f3380b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:05.999122 4714 consensus_queue.cc:1035] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.000670 4731 consensus_queue.cc:1035] T 6fe929017262442094800c874183f5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.000701 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_2b417d6ebaef46a7a43d40e00887e113" } new_table_name: "default.Table_55c6b8b41e0b4150833c165e26b0316c" modify_external_catalogs: true
I20250115 10:12:06.001163 5916 catalog_manager.cc:1260] Loaded cluster ID: 72fb2a380886400d967c322bff40072d
I20250115 10:12:06.001318 5916 catalog_manager.cc:1553] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: loading cluster ID for follower catalog manager: success
W20250115 10:12:06.001667 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d16a22c6f2be4f8c83c3ef073ee6ff7e consensus state has no leader
I20250115 10:12:06.001924 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_a7df757061d4469b91a5d673d8797a65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.002048 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7df757061d4469b91a5d673d8797a65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.003368 5206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "88f5e7c003a641128acc22b394ab62c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88f5e7c003a641128acc22b394ab62c7" member_type: VOTER last_known_addr { host: "127.2.217.190" port: 46859 } } peers { permanent_uuid: "efd4346420bb4a5abb9cf66799e35565" member_type: VOTER last_known_addr { host: "127.2.217.189" port: 36717 } } peers { permanent_uuid: "cdb1ea5a27ca44baa3b0fe127143df0b" member_type: VOTER last_known_addr { host: "127.2.217.188" port: 38283 } } }
I20250115 10:12:06.003448 5206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7 [sys.catalog]: This master's current role is: LEADER
I20250115 10:12:06.005609 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 2e55b7e2b95b4eb895da942829c4556f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.007366 3513 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee4aac608a24ab7839b788543228d23 (DEFAULT_TABLE table=default.Table_a7df757061d4469b91a5d673d8797a65 [id=11ecb11a21f4417d9535e996495688b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:06.007485 3513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee4aac608a24ab7839b788543228d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:06.007776 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 2e55b7e2b95b4eb895da942829c4556f
I20250115 10:12:06.007843 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 2e55b7e2b95b4eb895da942829c4556f deleted and replaced by tablet 5834f5157b2a497387d7f0fc979a3550
I20250115 10:12:06.007891 4884 raft_consensus.cc:491] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.007939 4884 raft_consensus.cc:513] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.008052 4884 leader_election.cc:290] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.008153 3257 tablet_service.cc:1467] Processing CreateTablet for tablet 4ee4aac608a24ab7839b788543228d23 (DEFAULT_TABLE table=default.Table_a7df757061d4469b91a5d673d8797a65 [id=11ecb11a21f4417d9535e996495688b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20250115 10:12:06.008204 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.008249 3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee4aac608a24ab7839b788543228d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 10:12:06.008239 4714 consensus_queue.cc:1035] T 5f37b29ba1cb4a0289268ba1241527b8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:06.008395 3484 leader_election.cc:343] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.008885 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e55b7e2b95b4eb895da942829c4556f with delete_type TABLET_DATA_DELETED (replaced by tablet 5834f5157b2a497387d7f0fc979a3550) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.009461 4433 raft_consensus.cc:491] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.009524 4433 raft_consensus.cc:513] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.009584 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e55b7e2b95b4eb895da942829c4556f with delete_type TABLET_DATA_DELETED (replaced by tablet 5834f5157b2a497387d7f0fc979a3550) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.009636 4433 leader_election.cc:290] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.009704 4551 tablet_replica.cc:331] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.009763 4551 raft_consensus.cc:2238] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.009797 4551 raft_consensus.cc:2267] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.009878 4589 tablet_replica.cc:331] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.009943 4589 raft_consensus.cc:2238] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.009912 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.009977 4589 raft_consensus.cc:2267] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.010031 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "707f0e47915e4a8998a97a8680394e5d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.010259 3484 leader_election.cc:304] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.010319 4551 ts_tablet_manager.cc:1905] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.010375 4434 raft_consensus.cc:2743] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.010867 5916 catalog_manager.cc:1575] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: acquiring CA information for follower catalog manager: success
I20250115 10:12:06.011870 4589 ts_tablet_manager.cc:1905] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:06.012039 3350 consensus_peers.cc:487] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc3658cad19e46969abecacf490f43f1. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.013202 4589 ts_tablet_manager.cc:1918] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.013252 4589 log.cc:1198] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/2e55b7e2b95b4eb895da942829c4556f
I20250115 10:12:06.013469 4589 ts_tablet_manager.cc:1939] T 2e55b7e2b95b4eb895da942829c4556f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.013717 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.013772 3274 raft_consensus.cc:2463] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.013899 3485 leader_election.cc:304] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.013968 4884 raft_consensus.cc:2798] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.013952 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_e9976480454c45ae8f5c492466ad9d9d" } new_table_name: "default.Table_164a2664413f4f32aa92c72089b8251a" modify_external_catalogs: true
I20250115 10:12:06.013999 4884 raft_consensus.cc:491] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.014027 4884 raft_consensus.cc:3054] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.014020 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 2e55b7e2b95b4eb895da942829c4556f (table default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]) successfully deleted
I20250115 10:12:06.014439 4551 ts_tablet_manager.cc:1918] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.014492 4551 log.cc:1198] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/2e55b7e2b95b4eb895da942829c4556f
I20250115 10:12:06.014618 4884 raft_consensus.cc:513] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.014693 4551 ts_tablet_manager.cc:1939] T 2e55b7e2b95b4eb895da942829c4556f P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.014757 4884 leader_election.cc:290] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.015033 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.015089 3274 raft_consensus.cc:3054] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.015271 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.015440 3484 leader_election.cc:343] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.015594 4557 tablet_bootstrap.cc:492] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.015653 4557 ts_tablet_manager.cc:1397] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.091s user 0.000s sys 0.001s
I20250115 10:12:06.015678 5916 catalog_manager.cc:1603] T 00000000000000000000000000000000 P efd4346420bb4a5abb9cf66799e35565: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20250115 10:12:06.015769 3274 raft_consensus.cc:2463] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.015857 4557 raft_consensus.cc:357] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.015908 3485 leader_election.cc:304] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.015920 4557 raft_consensus.cc:383] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.016024 4557 raft_consensus.cc:738] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.016067 4557 consensus_queue.cc:260] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.016202 4557 ts_tablet_manager.cc:1428] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.016294 4557 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.016323 4908 raft_consensus.cc:491] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.016362 4908 raft_consensus.cc:513] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.016471 4908 leader_election.cc:290] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.016710 4557 tablet_bootstrap.cc:654] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.016844 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e356bc69b8f3414f99d7a6f804310da8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.016968 4338 raft_consensus.cc:2798] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.017009 4338 raft_consensus.cc:695] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.017048 4338 consensus_queue.cc:237] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:06.017486 3214 leader_election.cc:343] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.017635 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 2e55b7e2b95b4eb895da942829c4556f (table default.Table_fbed7009a1334a329055734d536afc3b [id=adc63c439c8b4dfabce113b40a0cf3b2]) successfully deleted
I20250115 10:12:06.017949 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e356bc69b8f3414f99d7a6f804310da8" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.018656 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 29d9a01abd314d0e9f60df4f6736985b consensus state has no leader
W20250115 10:12:06.018906 3215 leader_election.cc:343] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.018946 3215 leader_election.cc:304] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.019022 5155 raft_consensus.cc:2743] T e356bc69b8f3414f99d7a6f804310da8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.019423 4557 tablet_bootstrap.cc:492] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.019462 4557 ts_tablet_manager.cc:1397] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:06.019606 4557 raft_consensus.cc:357] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.019599 4587 consensus_queue.cc:1035] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.019657 4557 raft_consensus.cc:383] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.019675 4557 raft_consensus.cc:738] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.019707 4557 consensus_queue.cc:260] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.020203 4557 ts_tablet_manager.cc:1428] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.020259 4557 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.020664 4557 tablet_bootstrap.cc:654] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.021796 5155 consensus_queue.cc:1035] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.022621 5155 consensus_queue.cc:1035] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.024788 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 96506d095fe74ea8941b760814e393f2 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.026108 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 96506d095fe74ea8941b760814e393f2
I20250115 10:12:06.026177 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 96506d095fe74ea8941b760814e393f2 deleted and replaced by tablet 3b1fac89a4ee4e92a93fe42588efe5c0
I20250115 10:12:06.027077 4587 consensus_queue.cc:1035] T c94cb50778e44890bd8c4bdc868673e3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.027647 5155 raft_consensus.cc:491] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.027690 5155 raft_consensus.cc:513] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.027805 5155 leader_election.cc:290] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.027933 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.028100 3214 leader_election.cc:343] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.028127 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 96506d095fe74ea8941b760814e393f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b1fac89a4ee4e92a93fe42588efe5c0) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.028249 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 96506d095fe74ea8941b760814e393f2 with delete_type TABLET_DATA_DELETED (replaced by tablet 3b1fac89a4ee4e92a93fe42588efe5c0) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.028360 5155 consensus_queue.cc:1035] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:06.028826 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 96506d095fe74ea8941b760814e393f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96506d095fe74ea8941b760814e393f2 already in progress: creating tablet
W20250115 10:12:06.028961 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 96506d095fe74ea8941b760814e393f2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96506d095fe74ea8941b760814e393f2 already in progress: creating tablet
I20250115 10:12:06.029456 4884 raft_consensus.cc:491] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.029503 4884 raft_consensus.cc:513] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.029592 4884 leader_election.cc:290] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.029764 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.029765 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d5cf0e380d348f1ae2f05db1a010a19" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.030073 3484 leader_election.cc:304] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.030172 4884 raft_consensus.cc:2743] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.030556 3549 raft_consensus.cc:3054] T 12379200d11e4ed3800f609d34a54ea7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.030792 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.030926 3215 leader_election.cc:343] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.030961 3215 leader_election.cc:304] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.031060 5155 raft_consensus.cc:2743] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.032362 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_735f827cfa094c009f9632a95268e34e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.032491 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_735f827cfa094c009f9632a95268e34e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.036031 5155 consensus_queue.cc:1035] T 424956b90563455d8140a49fcaa05206 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.036247 4433 raft_consensus.cc:491] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.036302 4433 raft_consensus.cc:513] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.036412 4433 leader_election.cc:290] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.036561 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.036646 3274 raft_consensus.cc:2388] T afebbabd8d914cd0804a0c64830ef84e P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in this term.
I20250115 10:12:06.036644 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afebbabd8d914cd0804a0c64830ef84e" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.036847 3484 leader_election.cc:304] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.036952 4433 raft_consensus.cc:3054] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.037716 4433 raft_consensus.cc:2743] T afebbabd8d914cd0804a0c64830ef84e P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.038784 3414 raft_consensus.cc:3054] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.039691 4890 tablet.cc:1721] T b114b291fd734797bd6622d89e309925 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:06.041062 4575 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.041107 4575 ts_tablet_manager.cc:1397] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20250115 10:12:06.041251 4575 raft_consensus.cc:357] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.041308 4575 raft_consensus.cc:383] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.041327 4575 raft_consensus.cc:738] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.041371 4575 consensus_queue.cc:260] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.041474 4575 ts_tablet_manager.cc:1428] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.041535 4575 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.041954 4575 tablet_bootstrap.cc:654] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.044214 5155 raft_consensus.cc:491] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.044265 5155 raft_consensus.cc:513] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.044389 5155 leader_election.cc:290] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.044596 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.044787 3214 leader_election.cc:343] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.045264 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.045964 3215 leader_election.cc:343] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.046030 3215 leader_election.cc:304] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.046123 5155 raft_consensus.cc:2743] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.047883 4569 tablet_bootstrap.cc:492] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.047924 4569 ts_tablet_manager.cc:1397] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.000s
I20250115 10:12:06.048080 4569 raft_consensus.cc:357] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.048135 4569 raft_consensus.cc:383] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.048156 4569 raft_consensus.cc:738] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.048192 4569 consensus_queue.cc:260] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.048278 4569 ts_tablet_manager.cc:1428] T cc37ef40aab243c4ab4057ef2ff657e7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.048323 4569 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.048753 4569 tablet_bootstrap.cc:654] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.050765 4569 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.050813 4569 ts_tablet_manager.cc:1397] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.050967 4569 raft_consensus.cc:357] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.051035 4569 raft_consensus.cc:383] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.051056 4569 raft_consensus.cc:738] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.051087 4569 consensus_queue.cc:260] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.051187 4569 ts_tablet_manager.cc:1428] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.051245 4569 tablet_bootstrap.cc:492] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.051626 4569 tablet_bootstrap.cc:654] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.052378 3215 consensus_peers.cc:487] T cb353ea066dc474cac07e3adcfa6574d P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb353ea066dc474cac07e3adcfa6574d. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.052609 5156 raft_consensus.cc:491] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.052649 5156 raft_consensus.cc:513] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.052738 5156 leader_election.cc:290] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.053395 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80e2361a4e7040feae312bda88851e77" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.053931 3214 leader_election.cc:343] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.054219 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80e2361a4e7040feae312bda88851e77" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.054374 3215 leader_election.cc:343] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.054414 3215 leader_election.cc:304] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.055111 3770 raft_consensus.cc:2743] T 80e2361a4e7040feae312bda88851e77 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.057153 4338 raft_consensus.cc:491] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.057214 4557 tablet_bootstrap.cc:492] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.057265 4557 ts_tablet_manager.cc:1397] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.037s user 0.000s sys 0.001s
I20250115 10:12:06.057425 4557 raft_consensus.cc:357] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.057482 4557 raft_consensus.cc:383] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.057502 4557 raft_consensus.cc:738] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.057539 4557 consensus_queue.cc:260] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.057641 4557 ts_tablet_manager.cc:1428] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.057698 4557 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.058130 4557 tablet_bootstrap.cc:654] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.058470 5156 consensus_queue.cc:1035] T 46b8efd1622a4efcb009f999cb915dfc P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.057224 4338 raft_consensus.cc:513] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.058586 4338 leader_election.cc:290] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.058705 3410 raft_consensus.cc:3054] T c85d63cc502f418b91aec39245c707b9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.058729 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.058739 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98e5519e80144b7582d76b7f9d8d6ffa" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.059989 3484 leader_election.cc:304] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.060132 5156 raft_consensus.cc:491] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.060175 5156 raft_consensus.cc:513] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.060273 5156 leader_election.cc:290] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.060284 4338 raft_consensus.cc:2743] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.060501 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3186fbc8414cb989481b59e9cae04d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.060639 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3186fbc8414cb989481b59e9cae04d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.060846 3214 leader_election.cc:343] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.060909 3215 leader_election.cc:343] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.060928 3215 leader_election.cc:304] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.060950 4569 tablet_bootstrap.cc:492] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.060992 5156 raft_consensus.cc:2743] T 2e3186fbc8414cb989481b59e9cae04d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.061005 4569 ts_tablet_manager.cc:1397] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.000s
I20250115 10:12:06.061218 4569 raft_consensus.cc:357] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.061273 4569 raft_consensus.cc:383] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.061295 4569 raft_consensus.cc:738] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.061334 4569 consensus_queue.cc:260] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.061440 4569 ts_tablet_manager.cc:1428] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:06.061503 4569 tablet_bootstrap.cc:492] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.061854 4569 tablet_bootstrap.cc:654] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.064102 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_8efe8747d11e4af0a7df52864f2a926f" } new_table_name: "default.Table_92421830679d45fd825f6d49bfb3141a" modify_external_catalogs: true
I20250115 10:12:06.066025 4575 tablet_bootstrap.cc:492] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.066072 4575 ts_tablet_manager.cc:1397] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20250115 10:12:06.066192 4575 raft_consensus.cc:357] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.066246 4575 raft_consensus.cc:383] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.066263 4575 raft_consensus.cc:738] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.066298 4575 consensus_queue.cc:260] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.066387 4575 ts_tablet_manager.cc:1428] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.068447 4662 tablet.cc:1721] T 60cc9a1b2c4348ada0d8dab958aded09 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:06.068822 4575 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.069203 4575 tablet_bootstrap.cc:654] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.069618 4875 raft_consensus.cc:491] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.069659 4875 raft_consensus.cc:513] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.069749 4875 leader_election.cc:290] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.071803 4699 consensus_queue.cc:1035] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.071967 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.072037 3541 raft_consensus.cc:2388] T f96f4c52a2124c05b0e124a89eacaa71 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:06.072518 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f96f4c52a2124c05b0e124a89eacaa71" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.072793 3350 leader_election.cc:304] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.072853 4569 tablet_bootstrap.cc:492] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.072899 4569 ts_tablet_manager.cc:1397] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:06.072921 4699 raft_consensus.cc:3054] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.073030 4569 raft_consensus.cc:357] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.073077 4569 raft_consensus.cc:383] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.073094 4569 raft_consensus.cc:738] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.073124 4569 consensus_queue.cc:260] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.073217 4569 ts_tablet_manager.cc:1428] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.073273 4569 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:06.073410 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 12648ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:06.073633 4699 raft_consensus.cc:2743] T f96f4c52a2124c05b0e124a89eacaa71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.073699 4569 tablet_bootstrap.cc:654] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.074366 4908 raft_consensus.cc:491] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.074411 4908 raft_consensus.cc:513] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.074474 4575 tablet_bootstrap.cc:492] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.074497 4908 leader_election.cc:290] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.074519 4575 ts_tablet_manager.cc:1397] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:06.074672 4575 raft_consensus.cc:357] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.074730 4575 raft_consensus.cc:383] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.074782 4575 raft_consensus.cc:738] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.074808 4575 consensus_queue.cc:260] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.074896 4575 ts_tablet_manager.cc:1428] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.074946 4575 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.075084 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.075261 3214 leader_election.cc:343] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.075354 4575 tablet_bootstrap.cc:654] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.075385 4569 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.075428 4569 ts_tablet_manager.cc:1397] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.075603 4569 raft_consensus.cc:357] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.075651 4569 raft_consensus.cc:383] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.075670 4569 raft_consensus.cc:738] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.075739 4569 consensus_queue.cc:260] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.075675 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.075834 4569 ts_tablet_manager.cc:1428] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.075886 4569 tablet_bootstrap.cc:492] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.076294 4569 tablet_bootstrap.cc:654] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.076527 3215 leader_election.cc:343] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.076570 3215 leader_election.cc:304] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.076638 4908 raft_consensus.cc:2743] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.076752 4575 tablet_bootstrap.cc:492] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.076802 4575 ts_tablet_manager.cc:1397] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:06.076936 4575 raft_consensus.cc:357] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.077001 4575 raft_consensus.cc:383] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.077023 4575 raft_consensus.cc:738] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.077057 4575 consensus_queue.cc:260] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.077132 4575 ts_tablet_manager.cc:1428] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.077152 4873 tablet.cc:1721] T 60cc9a1b2c4348ada0d8dab958aded09 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:06.077181 4575 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.077602 4575 tablet_bootstrap.cc:654] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.078140 3214 consensus_peers.cc:487] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.079027 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6ff234c7b9e448d38f96fae42cfd98d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.079167 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ff234c7b9e448d38f96fae42cfd98d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.079514 4575 tablet_bootstrap.cc:492] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.079560 4575 ts_tablet_manager.cc:1397] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:06.079027 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c3e0b04a114248a292803e74e1c596f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.079746 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3e0b04a114248a292803e74e1c596f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.079727 4575 raft_consensus.cc:357] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.079787 4575 raft_consensus.cc:383] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.079804 4575 raft_consensus.cc:738] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.079847 4575 consensus_queue.cc:260] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.079921 4575 ts_tablet_manager.cc:1428] T 9305b7ac82cd4393b28017831a0687ff P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.079963 4575 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.080265 4569 tablet_bootstrap.cc:492] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.080302 4569 ts_tablet_manager.cc:1397] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:06.080415 4575 tablet_bootstrap.cc:654] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.080415 4569 raft_consensus.cc:357] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.080467 4569 raft_consensus.cc:383] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.080488 4569 raft_consensus.cc:738] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.080528 4569 consensus_queue.cc:260] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.080621 4569 ts_tablet_manager.cc:1428] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.080667 4569 tablet_bootstrap.cc:492] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.081024 4569 tablet_bootstrap.cc:654] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.081130 3350 consensus_peers.cc:487] T f682c7942a454d86a5df19eeac533361 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.081845 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_e775370517524e3e89ea3d14d630b190"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.081936 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e775370517524e3e89ea3d14d630b190 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.083175 5155 consensus_queue.cc:1035] T 17837499b096462394d993f39efce677 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.084399 4575 tablet_bootstrap.cc:492] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.084451 4575 ts_tablet_manager.cc:1397] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:06.084578 4575 raft_consensus.cc:357] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.084630 4575 raft_consensus.cc:383] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.084645 4575 raft_consensus.cc:738] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.084676 4575 consensus_queue.cc:260] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.084784 4575 ts_tablet_manager.cc:1428] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.084846 4575 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.085220 4575 tablet_bootstrap.cc:654] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.086331 4569 tablet_bootstrap.cc:492] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.086378 4569 ts_tablet_manager.cc:1397] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:06.086513 4569 raft_consensus.cc:357] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.086563 4569 raft_consensus.cc:383] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.086580 4569 raft_consensus.cc:738] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.086624 4569 consensus_queue.cc:260] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.086737 4569 ts_tablet_manager.cc:1428] T d5490db43ba14c039847a9326a7620c4 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.086794 4569 tablet_bootstrap.cc:492] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.087244 4569 tablet_bootstrap.cc:654] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.087594 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_c29a654c4bef464eb696fdbe1b51b2cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.087687 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c29a654c4bef464eb696fdbe1b51b2cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.090812 4557 tablet_bootstrap.cc:492] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.090863 4557 ts_tablet_manager.cc:1397] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.001s
I20250115 10:12:06.091041 4557 raft_consensus.cc:357] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.091101 4557 raft_consensus.cc:383] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.091126 4557 raft_consensus.cc:738] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.091171 4557 consensus_queue.cc:260] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.091279 4557 ts_tablet_manager.cc:1428] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.091328 4557 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.091796 4557 tablet_bootstrap.cc:654] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.092443 4557 tablet_bootstrap.cc:492] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.092484 4557 ts_tablet_manager.cc:1397] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.092626 4557 raft_consensus.cc:357] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.092693 4557 raft_consensus.cc:383] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.092715 4557 raft_consensus.cc:738] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.092752 4557 consensus_queue.cc:260] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.092845 4557 ts_tablet_manager.cc:1428] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.093099 4557 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.093489 4557 tablet_bootstrap.cc:654] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.094609 4557 tablet_bootstrap.cc:492] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.094651 4557 ts_tablet_manager.cc:1397] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.094673 4575 tablet_bootstrap.cc:492] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.094715 4575 ts_tablet_manager.cc:1397] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:06.094763 4557 raft_consensus.cc:357] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.094815 4557 raft_consensus.cc:383] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.094830 4557 raft_consensus.cc:738] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.094834 4575 raft_consensus.cc:357] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.094897 4575 raft_consensus.cc:383] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.094913 4575 raft_consensus.cc:738] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.094872 4557 consensus_queue.cc:260] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.094944 4575 consensus_queue.cc:260] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.094983 4557 ts_tablet_manager.cc:1428] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.095017 4575 ts_tablet_manager.cc:1428] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.095038 4557 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.095070 4575 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.095400 4557 tablet_bootstrap.cc:654] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.095494 4575 tablet_bootstrap.cc:654] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.096318 4557 tablet_bootstrap.cc:492] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.096375 4557 ts_tablet_manager.cc:1397] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.096509 4557 raft_consensus.cc:357] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.096554 4557 raft_consensus.cc:383] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.096571 4557 raft_consensus.cc:738] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.096611 4557 consensus_queue.cc:260] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.096690 4557 ts_tablet_manager.cc:1428] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.096730 4557 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.097077 4557 tablet_bootstrap.cc:654] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.099779 4575 tablet_bootstrap.cc:492] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.099821 4575 ts_tablet_manager.cc:1397] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:06.099936 4575 raft_consensus.cc:357] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.100000 4575 raft_consensus.cc:383] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.100023 4575 raft_consensus.cc:738] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.100056 4575 consensus_queue.cc:260] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.100140 4575 ts_tablet_manager.cc:1428] T f4cee0b04c6e4eb39dd22668aacb2801 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.100196 4575 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.100677 4575 tablet_bootstrap.cc:654] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.101318 4575 tablet_bootstrap.cc:492] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.101361 4575 ts_tablet_manager.cc:1397] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.101524 4575 raft_consensus.cc:357] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.101603 4575 raft_consensus.cc:383] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.101621 4575 raft_consensus.cc:738] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.101663 4575 consensus_queue.cc:260] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.101799 4575 ts_tablet_manager.cc:1428] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.101852 4575 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.102051 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2061bd7bc05646e496748e9029be560c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.102191 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2061bd7bc05646e496748e9029be560c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.102245 4575 tablet_bootstrap.cc:654] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.102752 4569 tablet_bootstrap.cc:492] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.102804 4569 ts_tablet_manager.cc:1397] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20250115 10:12:06.102933 4569 raft_consensus.cc:357] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.103006 4569 raft_consensus.cc:383] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.103029 4569 raft_consensus.cc:738] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.103065 4569 consensus_queue.cc:260] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.103186 4569 ts_tablet_manager.cc:1428] T dacd2778d9e54877b8ef6d52529c3539 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.103261 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1f48d0ecc51145e4bb8f429b9177a2bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.103353 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1f48d0ecc51145e4bb8f429b9177a2bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.103540 4569 tablet_bootstrap.cc:492] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.103998 4569 tablet_bootstrap.cc:654] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.104692 4569 tablet_bootstrap.cc:492] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.104730 4569 ts_tablet_manager.cc:1397] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.104882 4569 raft_consensus.cc:357] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.104934 4569 raft_consensus.cc:383] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.104955 4569 raft_consensus.cc:738] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.104995 4569 consensus_queue.cc:260] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.105110 4569 ts_tablet_manager.cc:1428] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.105175 4569 tablet_bootstrap.cc:492] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.105567 4569 tablet_bootstrap.cc:654] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.105868 4884 raft_consensus.cc:491] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.105927 4884 raft_consensus.cc:513] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.106057 4884 leader_election.cc:290] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.106061 4811 raft_consensus.cc:491] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.106102 4811 raft_consensus.cc:513] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.106197 4811 leader_election.cc:290] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.106197 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.106302 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9c28bb9d70940a59449ad5afb4a6313" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.106336 3413 raft_consensus.cc:2388] T b9c28bb9d70940a59449ad5afb4a6313 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89067c97cc1c45e699ee9f690cb3014f in current term 1: Already voted for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in this term.
I20250115 10:12:06.106508 3485 leader_election.cc:304] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.106580 4884 raft_consensus.cc:3054] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.107367 4884 raft_consensus.cc:2743] T b9c28bb9d70940a59449ad5afb4a6313 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.107482 4569 tablet_bootstrap.cc:492] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.107519 4569 ts_tablet_manager.cc:1397] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.107667 4569 raft_consensus.cc:357] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.107739 4569 raft_consensus.cc:383] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.107772 4569 raft_consensus.cc:738] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
W20250115 10:12:06.107844 3350 leader_election.cc:343] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: d200e7e299214ab8aad3a42a4d513da5
W20250115 10:12:06.108193 3350 leader_election.cc:343] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: d200e7e299214ab8aad3a42a4d513da5
I20250115 10:12:06.108229 3350 leader_election.cc:304] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.108398 4587 raft_consensus.cc:2743] T d200e7e299214ab8aad3a42a4d513da5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.108863 4569 consensus_queue.cc:260] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.109122 4569 ts_tablet_manager.cc:1428] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:06.109242 4569 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.109441 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b3c3c652bb6f453ea157533b626e5dba" } modify_external_catalogs: true
I20250115 10:12:06.109500 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_b3c3c652bb6f453ea157533b626e5dba" } modify_external_catalogs: true
I20250115 10:12:06.109906 4811 raft_consensus.cc:491] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.109954 4811 raft_consensus.cc:513] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.110033 4811 leader_election.cc:290] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.110457 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.110479 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5da557a18648719980469579c3979f" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.110518 3280 raft_consensus.cc:2388] T 2d5da557a18648719980469579c3979f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:06.110611 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 97bb29eb3de04d65aa91e7ae8c652170
I20250115 10:12:06.110724 3350 leader_election.cc:304] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.110858 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 97bb29eb3de04d65aa91e7ae8c652170 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.110929 4589 tablet_replica.cc:331] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.110997 4589 raft_consensus.cc:2238] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.111025 4589 raft_consensus.cc:2267] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.111112 4589 ts_tablet_manager.cc:1905] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.111169 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 97bb29eb3de04d65aa91e7ae8c652170 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.111238 4551 tablet_replica.cc:331] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.111296 4551 raft_consensus.cc:2238] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.111330 4551 raft_consensus.cc:2267] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.111429 4551 ts_tablet_manager.cc:1905] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.112258 4714 raft_consensus.cc:3054] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.112820 4551 ts_tablet_manager.cc:1918] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.112872 4551 log.cc:1198] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/97bb29eb3de04d65aa91e7ae8c652170
I20250115 10:12:06.112967 4714 raft_consensus.cc:2743] T 2d5da557a18648719980469579c3979f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.113060 4551 ts_tablet_manager.cc:1939] T 97bb29eb3de04d65aa91e7ae8c652170 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.113095 4589 ts_tablet_manager.cc:1918] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.113144 4589 log.cc:1198] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/97bb29eb3de04d65aa91e7ae8c652170
I20250115 10:12:06.113318 4589 ts_tablet_manager.cc:1939] T 97bb29eb3de04d65aa91e7ae8c652170 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.113601 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 97bb29eb3de04d65aa91e7ae8c652170 (table default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]) successfully deleted
I20250115 10:12:06.114415 4569 tablet_bootstrap.cc:654] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.114588 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 97bb29eb3de04d65aa91e7ae8c652170 (table default.Table_b3c3c652bb6f453ea157533b626e5dba [id=a98be6f316d44b4a9d9f51a3ef572c83]) successfully deleted
I20250115 10:12:06.115366 4575 tablet_bootstrap.cc:492] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.115418 4575 ts_tablet_manager.cc:1397] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20250115 10:12:06.115424 4557 tablet_bootstrap.cc:492] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.115478 4557 ts_tablet_manager.cc:1397] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
I20250115 10:12:06.115586 4575 raft_consensus.cc:357] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.115640 4575 raft_consensus.cc:383] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.115617 4557 raft_consensus.cc:357] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.115659 4575 raft_consensus.cc:738] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.115670 4557 raft_consensus.cc:383] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.115691 4557 raft_consensus.cc:738] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.115754 4557 consensus_queue.cc:260] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.115706 4575 consensus_queue.cc:260] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.115860 4575 ts_tablet_manager.cc:1428] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.115866 4557 ts_tablet_manager.cc:1428] T 497adb74fac84c1cb438ea6ba4adf211 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:06.115929 4557 tablet_bootstrap.cc:492] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.116142 4575 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.116384 4557 tablet_bootstrap.cc:654] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.116569 4575 tablet_bootstrap.cc:654] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.116586 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1f48d0ecc51145e4bb8f429b9177a2bd" } modify_external_catalogs: true
I20250115 10:12:06.116678 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1f48d0ecc51145e4bb8f429b9177a2bd" } modify_external_catalogs: true
I20250115 10:12:06.117514 3541 raft_consensus.cc:3054] T 0d5cf0e380d348f1ae2f05db1a010a19 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.118496 3484 consensus_peers.cc:487] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.119807 4587 raft_consensus.cc:491] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.119853 4587 raft_consensus.cc:513] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.119938 4587 leader_election.cc:290] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.120061 4475 catalog_manager.cc:5808] Not sending DeleteTablet requests; no consensus state for tablet b8bf65e2c03f4e4487d44b6ce278cd23
W20250115 10:12:06.120158 3350 leader_election.cc:343] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 9077d0eed1974bc898370b5d5554be71
W20250115 10:12:06.120496 3350 leader_election.cc:343] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 9077d0eed1974bc898370b5d5554be71
I20250115 10:12:06.120551 3350 leader_election.cc:304] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.120620 4587 raft_consensus.cc:2743] T 9077d0eed1974bc898370b5d5554be71 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.122092 4569 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.122136 4569 ts_tablet_manager.cc:1397] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:06.122270 4569 raft_consensus.cc:357] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.122325 4569 raft_consensus.cc:383] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.122342 4569 raft_consensus.cc:738] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.122380 4569 consensus_queue.cc:260] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.122465 4569 ts_tablet_manager.cc:1428] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.122520 4569 tablet_bootstrap.cc:492] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.122933 4569 tablet_bootstrap.cc:654] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.123656 4557 tablet_bootstrap.cc:492] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.123705 4557 ts_tablet_manager.cc:1397] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:06.123886 4335 consensus_queue.cc:1035] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.123906 4557 raft_consensus.cc:357] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.123965 4557 raft_consensus.cc:383] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.123981 4557 raft_consensus.cc:738] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.124013 4557 consensus_queue.cc:260] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.124094 4557 ts_tablet_manager.cc:1428] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.124138 4557 tablet_bootstrap.cc:492] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.124531 4557 tablet_bootstrap.cc:654] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.125622 4575 tablet_bootstrap.cc:492] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.125669 4575 ts_tablet_manager.cc:1397] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:06.125815 4575 raft_consensus.cc:357] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.125881 4575 raft_consensus.cc:383] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.125905 4575 raft_consensus.cc:738] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.125946 4575 consensus_queue.cc:260] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.126034 4575 ts_tablet_manager.cc:1428] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.126096 4575 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.126567 4575 tablet_bootstrap.cc:654] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.127947 4575 tablet_bootstrap.cc:492] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.127991 4575 ts_tablet_manager.cc:1397] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.128058 4557 tablet_bootstrap.cc:492] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.128103 4557 ts_tablet_manager.cc:1397] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:06.128142 4575 raft_consensus.cc:357] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.128196 4575 raft_consensus.cc:383] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.128235 4575 raft_consensus.cc:738] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.128254 4557 raft_consensus.cc:357] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.128278 4575 consensus_queue.cc:260] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.128314 4557 raft_consensus.cc:383] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.128338 4557 raft_consensus.cc:738] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.128389 4575 ts_tablet_manager.cc:1428] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.128383 4557 consensus_queue.cc:260] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.128453 4575 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.128490 4557 ts_tablet_manager.cc:1428] T e356bc69b8f3414f99d7a6f804310da8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.128551 4569 tablet_bootstrap.cc:492] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.128564 4557 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.128592 4569 ts_tablet_manager.cc:1397] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:06.128765 4569 raft_consensus.cc:357] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.128829 4569 raft_consensus.cc:383] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.128847 4569 raft_consensus.cc:738] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.128890 4575 tablet_bootstrap.cc:654] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.128903 4569 consensus_queue.cc:260] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.129014 4557 tablet_bootstrap.cc:654] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.129020 4569 ts_tablet_manager.cc:1428] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.129094 4569 tablet_bootstrap.cc:492] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.129524 4569 tablet_bootstrap.cc:654] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.129822 4575 tablet_bootstrap.cc:492] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.129824 4335 raft_consensus.cc:491] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.129855 4575 ts_tablet_manager.cc:1397] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.129860 4335 raft_consensus.cc:513] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.129948 4335 leader_election.cc:290] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.129971 4575 raft_consensus.cc:357] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.130010 4575 raft_consensus.cc:383] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.130025 4575 raft_consensus.cc:738] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.130084 4575 consensus_queue.cc:260] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.130182 4575 ts_tablet_manager.cc:1428] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.130234 4575 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.130460 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f88fd5f4cb14241ba611291d76ed79b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.130559 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f88fd5f4cb14241ba611291d76ed79b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.130744 4475 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_da80d7c2bd9a4955a1d674908d1b02ad" } modify_external_catalogs: true
I20250115 10:12:06.130811 4475 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_da80d7c2bd9a4955a1d674908d1b02ad" } modify_external_catalogs: true
I20250115 10:12:06.131204 4575 tablet_bootstrap.cc:654] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.131639 4557 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.131695 4557 ts_tablet_manager.cc:1397] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:06.131881 4557 raft_consensus.cc:357] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.132025 3215 leader_election.cc:343] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.132200 3214 leader_election.cc:343] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.132246 3214 leader_election.cc:304] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.132318 5155 raft_consensus.cc:2743] T 5f88fd5f4cb14241ba611291d76ed79b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.132889 4557 raft_consensus.cc:383] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.132933 4557 raft_consensus.cc:738] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.132907 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f" } modify_external_catalogs: true
I20250115 10:12:06.132983 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f" } modify_external_catalogs: true
I20250115 10:12:06.133018 4557 consensus_queue.cc:260] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.133128 5155 raft_consensus.cc:491] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.133139 4557 ts_tablet_manager.cc:1428] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.133198 4557 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.133170 5155 raft_consensus.cc:513] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.133265 5155 leader_election.cc:290] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.133543 4557 tablet_bootstrap.cc:654] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.133525 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c21c9b21c7c4aed981029846b28aee5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.133666 3214 leader_election.cc:343] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.133911 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet e90df067a820456db899065f0c04fe6b
I20250115 10:12:06.134552 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet e90df067a820456db899065f0c04fe6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.134554 4335 consensus_queue.cc:1035] T fd76846bc164480d9b77aa3d096260cb P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.134660 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet e90df067a820456db899065f0c04fe6b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.134647 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c21c9b21c7c4aed981029846b28aee5" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.135161 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet e90df067a820456db899065f0c04fe6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e90df067a820456db899065f0c04fe6b already in progress: creating tablet
W20250115 10:12:06.135164 3215 leader_election.cc:343] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.135210 3215 leader_election.cc:304] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.135315 4335 raft_consensus.cc:2743] T 9c21c9b21c7c4aed981029846b28aee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.135569 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 28861e966ce645878983bec6476255bb
I20250115 10:12:06.136125 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 28861e966ce645878983bec6476255bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.136176 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 28861e966ce645878983bec6476255bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.136224 4589 tablet_replica.cc:331] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.136283 4589 raft_consensus.cc:2238] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.136320 4589 raft_consensus.cc:2267] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.136438 4589 ts_tablet_manager.cc:1905] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.136448 4551 tablet_replica.cc:331] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.136505 4551 raft_consensus.cc:2238] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.136525 4557 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.136550 4551 raft_consensus.cc:2267] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.136566 4557 ts_tablet_manager.cc:1397] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.136659 4551 ts_tablet_manager.cc:1905] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.136689 4557 raft_consensus.cc:357] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.136731 4557 raft_consensus.cc:383] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.136747 4557 raft_consensus.cc:738] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.136780 4557 consensus_queue.cc:260] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.136868 4557 ts_tablet_manager.cc:1428] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.136938 4557 tablet_bootstrap.cc:492] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.137313 4557 tablet_bootstrap.cc:654] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.137959 4589 ts_tablet_manager.cc:1918] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.137960 4551 ts_tablet_manager.cc:1918] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.138002 4551 log.cc:1198] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/28861e966ce645878983bec6476255bb
I20250115 10:12:06.138022 4589 log.cc:1198] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/28861e966ce645878983bec6476255bb
I20250115 10:12:06.138206 4589 ts_tablet_manager.cc:1939] T 28861e966ce645878983bec6476255bb P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.138330 4335 consensus_queue.cc:1035] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:06.138360 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet e90df067a820456db899065f0c04fe6b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e90df067a820456db899065f0c04fe6b already in progress: creating tablet
I20250115 10:12:06.138823 4338 consensus_queue.cc:1035] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.139353 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]) successfully deleted
I20250115 10:12:06.139882 4551 ts_tablet_manager.cc:1939] T 28861e966ce645878983bec6476255bb P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:06.140377 3214 consensus_peers.cc:487] T 5778f29ace314ea18b42afd0b7c1642b P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.141803 4587 consensus_queue.cc:1035] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.143239 4434 consensus_queue.cc:1035] T f8114f64577245c2b3ce70e4399de0c8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.144340 5155 raft_consensus.cc:491] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.144392 5155 raft_consensus.cc:513] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.144487 5155 leader_election.cc:290] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.144587 4875 consensus_queue.cc:1035] T ee6597804e5c41618870133c9d4ad1b3 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.144707 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a4478e2e094f789cc9dc95da58c321" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.144860 3214 leader_election.cc:343] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.145021 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1a4478e2e094f789cc9dc95da58c321" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.145251 3215 leader_election.cc:343] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.145325 3215 leader_election.cc:304] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.145668 4908 raft_consensus.cc:2743] T c1a4478e2e094f789cc9dc95da58c321 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.147506 4557 tablet_bootstrap.cc:492] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.147549 4557 ts_tablet_manager.cc:1397] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:06.147701 4557 raft_consensus.cc:357] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.147775 4557 raft_consensus.cc:383] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.147797 4557 raft_consensus.cc:738] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.147837 4557 consensus_queue.cc:260] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.147852 3350 consensus_peers.cc:487] T bc3658cad19e46969abecacf490f43f1 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc3658cad19e46969abecacf490f43f1. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.147941 4557 ts_tablet_manager.cc:1428] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.148000 4557 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.148393 4557 tablet_bootstrap.cc:654] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.148447 4569 tablet_bootstrap.cc:492] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.148487 4569 ts_tablet_manager.cc:1397] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.000s
I20250115 10:12:06.148649 4569 raft_consensus.cc:357] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.148708 4569 raft_consensus.cc:383] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.148728 4569 raft_consensus.cc:738] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.148777 4569 consensus_queue.cc:260] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.148859 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 28861e966ce645878983bec6476255bb (table default.Table_6b6c19b6dacc44ee82db8d27cbe5e42f [id=e245a6f0af0845e184e8e980f82a8333]) successfully deleted
I20250115 10:12:06.148866 4569 ts_tablet_manager.cc:1428] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.148931 4569 tablet_bootstrap.cc:492] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.149297 4569 tablet_bootstrap.cc:654] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.150048 4569 tablet_bootstrap.cc:492] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.150094 4569 ts_tablet_manager.cc:1397] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.150203 4569 raft_consensus.cc:357] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.150249 4569 raft_consensus.cc:383] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.150264 4569 raft_consensus.cc:738] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.150303 4569 consensus_queue.cc:260] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.150390 4569 ts_tablet_manager.cc:1428] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.150439 4569 tablet_bootstrap.cc:492] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.150789 4569 tablet_bootstrap.cc:654] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.151505 4569 tablet_bootstrap.cc:492] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.151540 4569 ts_tablet_manager.cc:1397] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.151674 4569 raft_consensus.cc:357] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.151747 4569 raft_consensus.cc:383] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.151772 4569 raft_consensus.cc:738] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.151803 4569 consensus_queue.cc:260] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.151875 4569 ts_tablet_manager.cc:1428] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.151928 4569 tablet_bootstrap.cc:492] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.152297 4569 tablet_bootstrap.cc:654] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.152360 4575 tablet_bootstrap.cc:492] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.152405 4575 ts_tablet_manager.cc:1397] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.000s
I20250115 10:12:06.152546 4575 raft_consensus.cc:357] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.152616 4575 raft_consensus.cc:383] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.152638 4575 raft_consensus.cc:738] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.152678 4575 consensus_queue.cc:260] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.152776 4569 tablet_bootstrap.cc:492] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.152778 4575 ts_tablet_manager.cc:1428] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.152808 4569 ts_tablet_manager.cc:1397] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.152848 4575 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.152920 4569 raft_consensus.cc:357] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.152974 4569 raft_consensus.cc:383] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.152993 4569 raft_consensus.cc:738] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.153031 4569 consensus_queue.cc:260] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.153119 4569 ts_tablet_manager.cc:1428] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.153188 4569 tablet_bootstrap.cc:492] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.153332 4575 tablet_bootstrap.cc:654] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.153594 4569 tablet_bootstrap.cc:654] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.153971 4811 consensus_queue.cc:1035] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.154709 4575 tablet_bootstrap.cc:492] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.154759 4575 ts_tablet_manager.cc:1397] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.154894 4575 raft_consensus.cc:357] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.154938 4575 raft_consensus.cc:383] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.154932 4557 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.154956 4575 raft_consensus.cc:738] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.154970 4557 ts_tablet_manager.cc:1397] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:06.154989 4575 consensus_queue.cc:260] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.155068 4575 ts_tablet_manager.cc:1428] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.155122 4575 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.155110 4557 raft_consensus.cc:357] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.155160 4557 raft_consensus.cc:383] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.155176 4557 raft_consensus.cc:738] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.155210 4557 consensus_queue.cc:260] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.155287 4557 ts_tablet_manager.cc:1428] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.155335 4557 tablet_bootstrap.cc:492] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.155503 4575 tablet_bootstrap.cc:654] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.155791 4557 tablet_bootstrap.cc:654] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.156038 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_581f09765dce491ca96069c0d429565f" } modify_external_catalogs: true
I20250115 10:12:06.156116 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_581f09765dce491ca96069c0d429565f" } modify_external_catalogs: true
I20250115 10:12:06.157922 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet b114b291fd734797bd6622d89e309925
I20250115 10:12:06.158171 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet b114b291fd734797bd6622d89e309925 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.158262 4589 tablet_replica.cc:331] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.158310 4589 raft_consensus.cc:2238] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:06.158396 4589 raft_consensus.cc:2267] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.158553 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet b114b291fd734797bd6622d89e309925 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.158627 4551 tablet_replica.cc:331] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.158680 4551 raft_consensus.cc:2238] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.158717 4551 raft_consensus.cc:2267] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.158972 4551 ts_tablet_manager.cc:1905] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.159359 4557 tablet_bootstrap.cc:492] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.159396 4557 ts_tablet_manager.cc:1397] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20250115 10:12:06.159520 4557 raft_consensus.cc:357] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.159590 4557 raft_consensus.cc:383] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.159610 4557 raft_consensus.cc:738] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.159648 4557 consensus_queue.cc:260] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.159765 4557 ts_tablet_manager.cc:1428] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.159829 4557 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.160181 4557 tablet_bootstrap.cc:654] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.160427 4551 ts_tablet_manager.cc:1918] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.160470 4551 log.cc:1198] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/b114b291fd734797bd6622d89e309925
I20250115 10:12:06.160647 4551 ts_tablet_manager.cc:1939] T b114b291fd734797bd6622d89e309925 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.161226 4338 consensus_queue.cc:1035] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.162317 4335 consensus_queue.cc:1035] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.163105 4589 ts_tablet_manager.cc:1905] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.164485 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet f778154f3bc3420abe9eb87608228bc3 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.165774 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet f778154f3bc3420abe9eb87608228bc3
I20250115 10:12:06.165846 4475 catalog_manager.cc:6596] ReplaceTablet: tablet f778154f3bc3420abe9eb87608228bc3 deleted and replaced by tablet 5385b03385c54e6f94d80b293dfe39f5
I20250115 10:12:06.166060 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet f778154f3bc3420abe9eb87608228bc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5385b03385c54e6f94d80b293dfe39f5) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.166090 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet f778154f3bc3420abe9eb87608228bc3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5385b03385c54e6f94d80b293dfe39f5) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.166574 3410 raft_consensus.cc:3054] T 1650bac5bd96467fb3d586b23ebd77be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.166841 4569 tablet_bootstrap.cc:492] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.166877 4569 ts_tablet_manager.cc:1397] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20250115 10:12:06.167062 4569 raft_consensus.cc:357] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.167119 4569 raft_consensus.cc:383] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.167151 4569 raft_consensus.cc:738] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.167187 4569 consensus_queue.cc:260] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.167285 4569 ts_tablet_manager.cc:1428] T 31b8334f3d734968a0a7ba148bd90d72 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.167330 4569 tablet_bootstrap.cc:492] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.167625 4569 tablet_bootstrap.cc:654] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.168097 3770 consensus_queue.cc:1035] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.168221 4569 tablet_bootstrap.cc:492] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.168259 4569 ts_tablet_manager.cc:1397] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.168395 4569 raft_consensus.cc:357] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.168452 4569 raft_consensus.cc:383] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.168471 4569 raft_consensus.cc:738] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.168467 4875 raft_consensus.cc:491] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.168501 4569 consensus_queue.cc:260] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.168531 4875 raft_consensus.cc:513] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.168594 4569 ts_tablet_manager.cc:1428] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.168627 4875 leader_election.cc:290] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.168639 4569 tablet_bootstrap.cc:492] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.169031 4569 tablet_bootstrap.cc:654] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.169075 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.169361 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60cc9a1b2c4348ada0d8dab958aded09" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.169512 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0556f36b9bc7462fadcbdbd50479b0db" } new_table_name: "default.Table_81c7eaf4518c46a698de4d243e2c34c6" modify_external_catalogs: true
W20250115 10:12:06.170053 3350 consensus_peers.cc:487] T 97bb29eb3de04d65aa91e7ae8c652170 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97bb29eb3de04d65aa91e7ae8c652170. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.170153 3350 leader_election.cc:304] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.170215 4699 raft_consensus.cc:2743] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.170895 4338 consensus_queue.cc:1035] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.171833 5156 consensus_queue.cc:1035] T e178610c1a394217b152082dfd6bb8d0 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:06.172066 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1aa20c364a35456390841abdc2975001 consensus state has no leader
I20250115 10:12:06.172503 4589 ts_tablet_manager.cc:1918] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.172545 4589 log.cc:1198] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/b114b291fd734797bd6622d89e309925
I20250115 10:12:06.172731 4589 ts_tablet_manager.cc:1939] T b114b291fd734797bd6622d89e309925 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.173484 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet b114b291fd734797bd6622d89e309925 (table default.Table_581f09765dce491ca96069c0d429565f [id=a49d7416b0c84365bc92418b8d448a65]) successfully deleted
W20250115 10:12:06.173561 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet f778154f3bc3420abe9eb87608228bc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f778154f3bc3420abe9eb87608228bc3 already in progress: creating tablet
I20250115 10:12:06.173626 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet b114b291fd734797bd6622d89e309925 (table default.Table_581f09765dce491ca96069c0d429565f [id=a49d7416b0c84365bc92418b8d448a65]) successfully deleted
W20250115 10:12:06.173666 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet f778154f3bc3420abe9eb87608228bc3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f778154f3bc3420abe9eb87608228bc3 already in progress: creating tablet
I20250115 10:12:06.174144 4875 consensus_queue.cc:1035] T cd8c55fd071d42b880becb81e6f70f27 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.174476 4575 tablet_bootstrap.cc:492] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.174520 4575 ts_tablet_manager.cc:1397] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20250115 10:12:06.174650 4575 raft_consensus.cc:357] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.174696 4575 raft_consensus.cc:383] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.174712 4575 raft_consensus.cc:738] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.174752 4575 consensus_queue.cc:260] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.174854 4575 ts_tablet_manager.cc:1428] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.174901 4575 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.175268 4575 tablet_bootstrap.cc:654] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.176015 4557 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.176059 4557 ts_tablet_manager.cc:1397] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.000s
I20250115 10:12:06.176205 4557 raft_consensus.cc:357] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.176260 4557 raft_consensus.cc:383] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.176282 4557 raft_consensus.cc:738] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.176318 4557 consensus_queue.cc:260] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.176409 4557 ts_tablet_manager.cc:1428] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.176680 4569 tablet_bootstrap.cc:492] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.176728 4569 ts_tablet_manager.cc:1397] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20250115 10:12:06.176820 4557 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.176923 4569 raft_consensus.cc:357] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.176985 4569 raft_consensus.cc:383] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.177007 4569 raft_consensus.cc:738] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.177049 4569 consensus_queue.cc:260] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.177166 4569 ts_tablet_manager.cc:1428] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:06.177264 4557 tablet_bootstrap.cc:654] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.177709 4569 tablet_bootstrap.cc:492] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.178208 4569 tablet_bootstrap.cc:654] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.178362 4434 raft_consensus.cc:491] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.178421 4434 raft_consensus.cc:513] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.178512 4434 leader_election.cc:290] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:06.179092 3485 leader_election.cc:343] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8a3ebf56500b4c97b7553644d62fe83a
W20250115 10:12:06.179131 3484 leader_election.cc:343] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 8a3ebf56500b4c97b7553644d62fe83a
I20250115 10:12:06.179154 3485 leader_election.cc:304] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.179208 4884 raft_consensus.cc:2743] T 8a3ebf56500b4c97b7553644d62fe83a P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.179214 3410 raft_consensus.cc:3054] T 7144ec81e9244eb49715450aeda5f82f P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.179247 4884 consensus_queue.cc:1035] T 14a9663596174aa1b72ce71e49183a2b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.180261 4434 consensus_queue.cc:1035] T 7144ec81e9244eb49715450aeda5f82f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.180359 3770 consensus_queue.cc:1035] T 1650bac5bd96467fb3d586b23ebd77be P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.181579 4557 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.181618 4557 ts_tablet_manager.cc:1397] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:06.181792 4575 tablet_bootstrap.cc:492] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.181828 4575 ts_tablet_manager.cc:1397] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:06.181962 4575 raft_consensus.cc:357] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.182024 4575 raft_consensus.cc:383] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.182042 4575 raft_consensus.cc:738] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.182076 4575 consensus_queue.cc:260] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.182157 4575 ts_tablet_manager.cc:1428] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.182212 4575 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.182317 4569 tablet_bootstrap.cc:492] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.182353 4569 ts_tablet_manager.cc:1397] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:06.182403 4434 raft_consensus.cc:491] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.182443 4434 raft_consensus.cc:513] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.182531 4434 leader_election.cc:290] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.182513 4569 raft_consensus.cc:357] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.182564 4569 raft_consensus.cc:383] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.182583 4569 raft_consensus.cc:738] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.182627 4569 consensus_queue.cc:260] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.182726 4575 tablet_bootstrap.cc:654] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.182740 4569 ts_tablet_manager.cc:1428] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.182807 4569 tablet_bootstrap.cc:492] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.183197 4569 tablet_bootstrap.cc:654] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.183205 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.183775 4557 raft_consensus.cc:357] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.183864 4557 raft_consensus.cc:383] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.183885 4557 raft_consensus.cc:738] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.183920 4557 consensus_queue.cc:260] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.184017 4557 ts_tablet_manager.cc:1428] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.184509 4557 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.185029 4884 raft_consensus.cc:491] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.185070 4884 raft_consensus.cc:513] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.185137 4557 tablet_bootstrap.cc:654] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.185165 4884 leader_election.cc:290] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.185400 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f682c7942a454d86a5df19eeac533361" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.185528 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_917623c2758441459e6b366741de339e" } new_table_name: "default.Table_cb88a998c86145808bce1b4052783199" modify_external_catalogs: true
I20250115 10:12:06.185577 3484 leader_election.cc:304] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.185639 4884 raft_consensus.cc:2743] T f682c7942a454d86a5df19eeac533361 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.185727 3542 raft_consensus.cc:3054] T 707f0e47915e4a8998a97a8680394e5d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.185827 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.185797 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_bf6a203d719442ad816a26e499b2bf1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.185914 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf6a203d719442ad816a26e499b2bf1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.186056 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d02e33022c3840c28623200adb56e3bc" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.186201 3485 leader_election.cc:304] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.186280 4884 raft_consensus.cc:2743] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.187316 4557 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.187363 4557 ts_tablet_manager.cc:1397] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.187479 4557 raft_consensus.cc:357] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.187523 4557 raft_consensus.cc:383] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.187538 4557 raft_consensus.cc:738] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.187572 4557 consensus_queue.cc:260] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.187645 4557 ts_tablet_manager.cc:1428] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.187688 4557 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.188107 4557 tablet_bootstrap.cc:654] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.190286 3410 raft_consensus.cc:3054] T 2cff85958d3c46069b1dd9bf5cb75ca4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.190893 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 6eb1552d8cb541a6a2df109ea111c23f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.191018 4557 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.191056 4557 ts_tablet_manager.cc:1397] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.191175 4557 raft_consensus.cc:357] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.191217 4557 raft_consensus.cc:383] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.191248 4557 raft_consensus.cc:738] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.191293 4557 consensus_queue.cc:260] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.191366 4557 ts_tablet_manager.cc:1428] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.191411 4557 tablet_bootstrap.cc:492] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.191915 4557 tablet_bootstrap.cc:654] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.192200 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_cb24d4a436924601a50109294be169b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:06.192289 4873 tablet.cc:1721] T 7f6244234f7447debe9cdce30e4919b6 P 89067c97cc1c45e699ee9f690cb3014f: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20250115 10:12:06.192313 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb24d4a436924601a50109294be169b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.193320 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6eb1552d8cb541a6a2df109ea111c23f
I20250115 10:12:06.193418 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 6eb1552d8cb541a6a2df109ea111c23f deleted and replaced by tablet a9662d8ee56b4957a8afa4c11bdafcb4
I20250115 10:12:06.194064 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eb1552d8cb541a6a2df109ea111c23f with delete_type TABLET_DATA_DELETED (replaced by tablet a9662d8ee56b4957a8afa4c11bdafcb4) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.194140 4589 tablet_replica.cc:331] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.194185 4589 raft_consensus.cc:2238] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.194211 4589 raft_consensus.cc:2267] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.194423 4589 ts_tablet_manager.cc:1905] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.195430 4662 tablet.cc:1721] T 7f6244234f7447debe9cdce30e4919b6 P 4c9ab337b4ea47d18b4208d424cf5fd1: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20250115 10:12:06.195874 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eb1552d8cb541a6a2df109ea111c23f with delete_type TABLET_DATA_DELETED (replaced by tablet a9662d8ee56b4957a8afa4c11bdafcb4) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.195897 4589 ts_tablet_manager.cc:1918] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:06.195940 4589 log.cc:1198] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6eb1552d8cb541a6a2df109ea111c23f
I20250115 10:12:06.196105 4589 ts_tablet_manager.cc:1939] T 6eb1552d8cb541a6a2df109ea111c23f P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.198395 4557 tablet_bootstrap.cc:492] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.198434 4557 ts_tablet_manager.cc:1397] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:06.198503 4434 consensus_queue.cc:1035] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.198556 4557 raft_consensus.cc:357] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.198598 4557 raft_consensus.cc:383] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.198613 4557 raft_consensus.cc:738] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.198643 4557 consensus_queue.cc:260] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.198707 4557 ts_tablet_manager.cc:1428] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.199553 4557 tablet_bootstrap.cc:492] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.200062 4557 tablet_bootstrap.cc:654] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.200583 4335 raft_consensus.cc:491] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.200625 4335 raft_consensus.cc:513] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.200722 4335 leader_election.cc:290] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.201267 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cc55da8a4c4da2b94321a912418747" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.201447 3214 leader_election.cc:343] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.202843 4575 tablet_bootstrap.cc:492] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.202891 4575 ts_tablet_manager.cc:1397] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20250115 10:12:06.203034 4575 raft_consensus.cc:357] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.203087 4575 raft_consensus.cc:383] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.203105 4575 raft_consensus.cc:738] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.203159 4575 consensus_queue.cc:260] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.203264 4575 ts_tablet_manager.cc:1428] T 17837499b096462394d993f39efce677 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.203330 4575 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.203691 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cc55da8a4c4da2b94321a912418747" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.203774 3542 raft_consensus.cc:2463] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.203801 4575 tablet_bootstrap.cc:654] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.204159 4335 raft_consensus.cc:491] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.204216 4335 raft_consensus.cc:513] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.204298 4575 tablet_bootstrap.cc:492] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.204330 4335 leader_election.cc:290] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.204351 4575 ts_tablet_manager.cc:1397] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.204465 4575 raft_consensus.cc:357] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.204509 4575 raft_consensus.cc:383] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.204524 4575 raft_consensus.cc:738] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.204557 4575 consensus_queue.cc:260] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.204630 4575 ts_tablet_manager.cc:1428] T 0e033d609eef46a792b1a568ec2936de P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.204671 4575 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.204813 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1a8c8ad0ca84fc3aec22cd825579e6d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.205055 4575 tablet_bootstrap.cc:654] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.205058 3214 leader_election.cc:343] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.205353 4569 tablet_bootstrap.cc:492] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.205387 4569 ts_tablet_manager.cc:1397] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20250115 10:12:06.205508 3215 leader_election.cc:304] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.205581 4335 raft_consensus.cc:2798] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.205564 4569 raft_consensus.cc:357] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.205607 4335 raft_consensus.cc:491] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.205634 4569 raft_consensus.cc:383] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.205647 4335 raft_consensus.cc:3054] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.205726 3350 consensus_peers.cc:487] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e55b7e2b95b4eb895da942829c4556f. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.205988 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1a8c8ad0ca84fc3aec22cd825579e6d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.206396 4335 raft_consensus.cc:513] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.206514 4335 leader_election.cc:290] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.205657 4569 raft_consensus.cc:738] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.206693 4569 consensus_queue.cc:260] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.206743 3215 leader_election.cc:343] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.206784 3215 leader_election.cc:304] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.206800 4569 ts_tablet_manager.cc:1428] T f22785e218cb4a54ba56757c8251cfd7 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.206812 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cc55da8a4c4da2b94321a912418747" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.206864 5156 raft_consensus.cc:2743] T d1a8c8ad0ca84fc3aec22cd825579e6d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.206873 4569 tablet_bootstrap.cc:492] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.207098 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61cc55da8a4c4da2b94321a912418747" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.207140 3542 raft_consensus.cc:3054] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.207494 4569 tablet_bootstrap.cc:654] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.207823 3214 leader_election.cc:343] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.207898 3542 raft_consensus.cc:2463] T 61cc55da8a4c4da2b94321a912418747 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.208108 4569 tablet_bootstrap.cc:492] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.208150 4569 ts_tablet_manager.cc:1397] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.208212 3215 leader_election.cc:304] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.208276 4569 raft_consensus.cc:357] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.208326 4569 raft_consensus.cc:383] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.208360 4569 raft_consensus.cc:738] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.208393 4569 consensus_queue.cc:260] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.208493 4569 ts_tablet_manager.cc:1428] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.208500 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_9f0ac088111e458cbfa9f307456bba2f" } new_table_name: "default.Table_60d04e3ed8e3490aa27143c1b5cfc62f" modify_external_catalogs: true
I20250115 10:12:06.208549 4569 tablet_bootstrap.cc:492] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.208545 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6f3a6bf472224813af905ab387e0dc01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.208628 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f3a6bf472224813af905ab387e0dc01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.208477 4471 master_service.cc:946] ReplaceTablet: received request to replace tablet 0e1465bcc80e40cdad4e0722eb0d74c3 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.208480 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6eb1552d8cb541a6a2df109ea111c23f (table default.Table_d60729676fcc4f469e553b563bb6bafa [id=f473bb79920947c8a4c16ceef1992e2a]) successfully deleted
I20250115 10:12:06.208921 4569 tablet_bootstrap.cc:654] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.208986 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 6eb1552d8cb541a6a2df109ea111c23f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6eb1552d8cb541a6a2df109ea111c23f already in progress: creating tablet
I20250115 10:12:06.209445 3410 raft_consensus.cc:3054] T 8967b15f8b6a4587bd56a2dfd68b9fe9 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.209560 4575 tablet_bootstrap.cc:492] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.209597 4575 ts_tablet_manager.cc:1397] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:06.209725 4575 raft_consensus.cc:357] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.209779 4575 raft_consensus.cc:383] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.209795 4575 raft_consensus.cc:738] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.209818 4575 consensus_queue.cc:260] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.209996 4575 ts_tablet_manager.cc:1428] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.210052 4575 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.210450 4575 tablet_bootstrap.cc:654] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.210860 4557 tablet_bootstrap.cc:492] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.210899 4557 ts_tablet_manager.cc:1397] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:06.211002 4434 raft_consensus.cc:491] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.211040 4557 raft_consensus.cc:357] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.211097 4557 raft_consensus.cc:383] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.211114 4557 raft_consensus.cc:738] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.211153 4557 consensus_queue.cc:260] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.211254 4557 ts_tablet_manager.cc:1428] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.211325 4557 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.211679 4557 tablet_bootstrap.cc:654] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.212190 5155 raft_consensus.cc:491] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.212246 5155 raft_consensus.cc:513] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.212339 5155 leader_election.cc:290] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.212481 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8da7533f8041768533184ef0a33d3f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.212888 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb8da7533f8041768533184ef0a33d3f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.213083 3215 leader_election.cc:343] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.213894 3214 leader_election.cc:343] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.213948 3214 leader_election.cc:304] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.211047 4434 raft_consensus.cc:513] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.214047 5156 raft_consensus.cc:2743] T cb8da7533f8041768533184ef0a33d3f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.214071 4434 leader_election.cc:290] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.208391 3770 raft_consensus.cc:2798] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.214227 3770 raft_consensus.cc:695] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.214264 3770 consensus_queue.cc:237] T 61cc55da8a4c4da2b94321a912418747 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.214303 3410 raft_consensus.cc:3054] T 4f6baabd5aba4363ae13e5da601a9de8 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.214510 5156 consensus_queue.cc:1035] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.215531 4569 tablet_bootstrap.cc:492] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.215577 4569 ts_tablet_manager.cc:1397] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20250115 10:12:06.215932 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7af3da67d9348d7bc890b7981d8b5e8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.215706 4569 raft_consensus.cc:357] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.216130 4569 raft_consensus.cc:383] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.216154 4569 raft_consensus.cc:738] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.216188 4569 consensus_queue.cc:260] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.216289 4569 ts_tablet_manager.cc:1428] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.216349 4569 tablet_bootstrap.cc:492] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.216398 4884 consensus_queue.cc:1035] T 4f6baabd5aba4363ae13e5da601a9de8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.216496 3413 raft_consensus.cc:3054] T 3ec19ae50a374ef3a5e7b00cfcadeee2 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.216814 3350 consensus_peers.cc:487] T 2e55b7e2b95b4eb895da942829c4556f P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e55b7e2b95b4eb895da942829c4556f. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.216920 4569 tablet_bootstrap.cc:654] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.217394 3275 raft_consensus.cc:2463] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.217919 3485 leader_election.cc:304] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.217957 4575 tablet_bootstrap.cc:492] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.217993 4575 ts_tablet_manager.cc:1397] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20250115 10:12:06.218143 4575 raft_consensus.cc:357] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.218209 4575 raft_consensus.cc:383] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.218232 4575 raft_consensus.cc:738] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.218266 4434 raft_consensus.cc:2798] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.218267 4575 consensus_queue.cc:260] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.218295 4434 raft_consensus.cc:491] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.218315 4434 raft_consensus.cc:3054] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.218370 4575 ts_tablet_manager.cc:1428] T 7f6244234f7447debe9cdce30e4919b6 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.218421 4575 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.218779 4575 tablet_bootstrap.cc:654] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.219084 4434 raft_consensus.cc:513] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.219183 4434 leader_election.cc:290] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.219398 4587 consensus_queue.cc:1035] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.219456 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7af3da67d9348d7bc890b7981d8b5e8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.219594 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7af3da67d9348d7bc890b7981d8b5e8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.219645 3275 raft_consensus.cc:3054] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.220160 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7af3da67d9348d7bc890b7981d8b5e8" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.220407 3275 raft_consensus.cc:2463] T d7af3da67d9348d7bc890b7981d8b5e8 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.220474 4468 master_service.cc:946] ReplaceTablet: received request to replace tablet 6eb1552d8cb541a6a2df109ea111c23f from {username='slave'} at 127.0.0.1:46438
W20250115 10:12:06.221047 3484 leader_election.cc:343] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.221115 3484 leader_election.cc:343] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.221205 3485 leader_election.cc:304] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.221344 4884 raft_consensus.cc:2798] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.221392 4884 raft_consensus.cc:695] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.221424 4884 consensus_queue.cc:237] T d7af3da67d9348d7bc890b7981d8b5e8 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.221609 5156 raft_consensus.cc:491] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.221655 5156 raft_consensus.cc:513] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.221745 5156 leader_election.cc:290] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.221910 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c05e81b1354e26900949537465cf08" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.222148 3215 leader_election.cc:343] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.222355 5156 raft_consensus.cc:491] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.222409 5156 raft_consensus.cc:513] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.222496 5156 leader_election.cc:290] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.222610 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_efea3aa2bf48438c875eac9783634b15" } new_table_name: "default.Table_b100c7c106e340d9956c766f24a736cc" modify_external_catalogs: true
I20250115 10:12:06.222726 4557 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.222769 4557 ts_tablet_manager.cc:1397] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:06.222944 4557 raft_consensus.cc:357] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.222973 5155 consensus_queue.cc:1035] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.223013 4557 raft_consensus.cc:383] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.223035 4557 raft_consensus.cc:738] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.223065 4557 consensus_queue.cc:260] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.223110 3550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3e1f44b1794f398f07bf767d54652f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.223188 4557 ts_tablet_manager.cc:1428] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20250115 10:12:06.223248 4557 tablet_bootstrap.cc:492] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:06.223518 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8def1d79286c4b8b8077121a24abee44 consensus state has no leader
I20250115 10:12:06.223608 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18c05e81b1354e26900949537465cf08" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.223652 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 0e1465bcc80e40cdad4e0722eb0d74c3
I20250115 10:12:06.223667 4557 tablet_bootstrap.cc:654] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.223712 4471 catalog_manager.cc:6596] ReplaceTablet: tablet 0e1465bcc80e40cdad4e0722eb0d74c3 deleted and replaced by tablet f98840ed8bc744c58dbc74a5ad835ea4
W20250115 10:12:06.223822 3214 leader_election.cc:343] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.223860 3214 leader_election.cc:304] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.223927 5155 raft_consensus.cc:2743] T 18c05e81b1354e26900949537465cf08 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.224329 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c3e1f44b1794f398f07bf767d54652f" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.224428 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f98840ed8bc744c58dbc74a5ad835ea4) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.224620 4589 tablet_replica.cc:331] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.224673 4589 raft_consensus.cc:2238] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.224700 4589 raft_consensus.cc:2267] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.225029 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1465bcc80e40cdad4e0722eb0d74c3 with delete_type TABLET_DATA_DELETED (replaced by tablet f98840ed8bc744c58dbc74a5ad835ea4) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.225114 4551 tablet_replica.cc:331] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.225159 4589 ts_tablet_manager.cc:1905] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.225188 4551 raft_consensus.cc:2238] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.225229 4551 raft_consensus.cc:2267] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.225426 4551 ts_tablet_manager.cc:1905] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.226658 4589 ts_tablet_manager.cc:1918] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.226715 4589 log.cc:1198] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/0e1465bcc80e40cdad4e0722eb0d74c3
I20250115 10:12:06.226799 4569 tablet_bootstrap.cc:492] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.226841 4569 ts_tablet_manager.cc:1397] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20250115 10:12:06.226868 4551 ts_tablet_manager.cc:1918] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.226912 4551 log.cc:1198] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/0e1465bcc80e40cdad4e0722eb0d74c3
I20250115 10:12:06.226920 4589 ts_tablet_manager.cc:1939] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.226979 4569 raft_consensus.cc:357] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.227046 4569 raft_consensus.cc:383] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.227070 4569 raft_consensus.cc:738] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.227067 4699 raft_consensus.cc:491] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.227118 4551 ts_tablet_manager.cc:1939] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.227128 4569 consensus_queue.cc:260] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.227113 4699 raft_consensus.cc:513] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.227224 4699 leader_election.cc:290] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.227255 4569 ts_tablet_manager.cc:1428] T 18bb0a4436354a58976f610fab166bcf P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:06.227344 4569 tablet_bootstrap.cc:492] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:06.227550 3215 leader_election.cc:343] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.227761 4569 tablet_bootstrap.cc:654] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.227905 4434 raft_consensus.cc:491] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.227963 4434 raft_consensus.cc:513] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.228057 4434 leader_election.cc:290] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.228085 4433 raft_consensus.cc:491] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.228124 4433 raft_consensus.cc:513] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.228219 4433 leader_election.cc:290] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.228088 4434 raft_consensus.cc:491] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.228368 4434 raft_consensus.cc:513] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.228428 4434 leader_election.cc:290] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.228868 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (table default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]) successfully deleted
W20250115 10:12:06.228875 4474 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3d9f966e26174800b640a4762bcd8306 consensus state has no leader
I20250115 10:12:06.229184 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900475e1e900423c9b9205540f67e5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.229246 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.229247 3276 raft_consensus.cc:2463] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:06.229677 3485 leader_election.cc:343] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:06.230021 3485 leader_election.cc:304] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.230082 4434 raft_consensus.cc:2798] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.230116 4434 raft_consensus.cc:491] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.230132 4434 raft_consensus.cc:3054] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.230722 4434 raft_consensus.cc:513] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.230834 4434 leader_election.cc:290] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.231514 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900475e1e900423c9b9205540f67e5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.231575 3276 raft_consensus.cc:3054] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.231884 3541 raft_consensus.cc:3054] T d02e33022c3840c28623200adb56e3bc P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.232283 3276 raft_consensus.cc:2463] T 900475e1e900423c9b9205540f67e5de P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.232982 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.233023 3485 leader_election.cc:304] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.233105 4884 raft_consensus.cc:2798] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.233160 4884 raft_consensus.cc:695] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.233193 4884 consensus_queue.cc:237] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.233565 3415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c66363913e47399c4e1e8533bdadd0" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.233654 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900475e1e900423c9b9205540f67e5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.233767 3214 leader_election.cc:343] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.233805 3214 leader_election.cc:304] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.233932 4731 raft_consensus.cc:2743] T 7c3e1f44b1794f398f07bf767d54652f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.233911 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "900475e1e900423c9b9205540f67e5de" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.234006 4731 consensus_queue.cc:1035] T b9c28bb9d70940a59449ad5afb4a6313 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.235149 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2a5f74cccdaf4f0f9aa78596860133bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.235275 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a5f74cccdaf4f0f9aa78596860133bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.235559 3546 raft_consensus.cc:3054] T 77b422773c3346199383ca64330719c6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.236824 3484 leader_election.cc:304] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.236915 4884 raft_consensus.cc:2743] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250115 10:12:06.236922 3484 leader_election.cc:343] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.237052 3484 leader_election.cc:343] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: f6fe9bedd4b74166a4f4c34ec0b87f26
I20250115 10:12:06.237082 3484 leader_election.cc:304] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
W20250115 10:12:06.237169 3484 leader_election.cc:343] T 900475e1e900423c9b9205540f67e5de P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.237314 4887 raft_consensus.cc:2743] T f6fe9bedd4b74166a4f4c34ec0b87f26 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.237543 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2230f6de9a54e98aa83435d37f68807" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.238047 3350 leader_election.cc:304] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.238148 4811 raft_consensus.cc:491] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.238178 4875 consensus_queue.cc:1035] T 7a9d422fdac347ff85eca778c29858e8 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.238206 4811 raft_consensus.cc:513] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.238250 4875 raft_consensus.cc:2743] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.238291 4811 leader_election.cc:290] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.239048 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.240648 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 0e1465bcc80e40cdad4e0722eb0d74c3 (table default.Table_17ae29bb107c41b6add9cf42fc2508c4 [id=2882f9bf633c4cb59134134316cc0458]) successfully deleted
I20250115 10:12:06.240648 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 1aa20c364a35456390841abdc2975001 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.240795 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a0811cad8454c2e871aad2101224f34" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.240864 3275 raft_consensus.cc:2388] T 4a0811cad8454c2e871aad2101224f34 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25d7e460cb6d4ddabf387dc672cc26b3 in current term 1: Already voted for candidate 89067c97cc1c45e699ee9f690cb3014f in this term.
I20250115 10:12:06.241032 3350 leader_election.cc:304] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.241108 4587 raft_consensus.cc:3054] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.241819 4587 raft_consensus.cc:2743] T 4a0811cad8454c2e871aad2101224f34 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.244344 4699 raft_consensus.cc:491] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.244400 4699 raft_consensus.cc:513] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.244493 4699 leader_election.cc:290] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.244625 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.244951 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aef601e6f3ef4ba387164c239c1139b0" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.245076 3411 raft_consensus.cc:3054] T 54d9aaaa37d540cab41de4a083b36917 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.245479 4884 raft_consensus.cc:491] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.245540 4884 raft_consensus.cc:513] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.245668 4884 leader_election.cc:290] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.245682 4474 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 1aa20c364a35456390841abdc2975001
I20250115 10:12:06.245767 4474 catalog_manager.cc:6596] ReplaceTablet: tablet 1aa20c364a35456390841abdc2975001 deleted and replaced by tablet 64d480498c4b4279963c7169ce2e343f
I20250115 10:12:06.246029 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.246196 3350 leader_election.cc:304] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
W20250115 10:12:06.246217 3484 leader_election.cc:343] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.246296 4699 raft_consensus.cc:2743] T aef601e6f3ef4ba387164c239c1139b0 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.246802 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa20c364a35456390841abdc2975001 with delete_type TABLET_DATA_DELETED (replaced by tablet 64d480498c4b4279963c7169ce2e343f) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.247098 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 1aa20c364a35456390841abdc2975001 with delete_type TABLET_DATA_DELETED (replaced by tablet 64d480498c4b4279963c7169ce2e343f) from {username='slave'} at 127.0.0.1:54164
W20250115 10:12:06.247220 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 1aa20c364a35456390841abdc2975001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa20c364a35456390841abdc2975001 already in progress: creating tablet
I20250115 10:12:06.247293 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.247339 3275 raft_consensus.cc:2463] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.247550 3485 leader_election.cc:304] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.247635 4434 raft_consensus.cc:2798] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.247684 4434 raft_consensus.cc:491] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.247711 4434 raft_consensus.cc:3054] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.248147 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 1aa20c364a35456390841abdc2975001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1aa20c364a35456390841abdc2975001 already in progress: creating tablet
I20250115 10:12:06.248396 4434 raft_consensus.cc:513] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.248495 4569 tablet_bootstrap.cc:492] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.248503 4434 leader_election.cc:290] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.248536 4569 ts_tablet_manager.cc:1397] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:06.248692 4569 raft_consensus.cc:357] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.248749 4569 raft_consensus.cc:383] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.248766 4569 raft_consensus.cc:738] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.248749 4575 tablet_bootstrap.cc:492] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.248800 4575 ts_tablet_manager.cc:1397] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.000s
I20250115 10:12:06.248804 4569 consensus_queue.cc:260] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.248893 4569 ts_tablet_manager.cc:1428] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.248947 4569 tablet_bootstrap.cc:492] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.248930 4575 raft_consensus.cc:357] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.249006 4575 raft_consensus.cc:383] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.249027 4575 raft_consensus.cc:738] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.249068 4575 consensus_queue.cc:260] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.249155 4575 ts_tablet_manager.cc:1428] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.249397 4569 tablet_bootstrap.cc:654] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.249456 4575 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.249506 4335 consensus_queue.cc:1035] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.249747 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.249838 4575 tablet_bootstrap.cc:654] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.249819 4587 consensus_queue.cc:1035] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250115 10:12:06.250769 3484 leader_election.cc:343] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.250840 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87fa663159fc4c95a8499a84f7b6faed" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.250893 3275 raft_consensus.cc:3054] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.251422 4557 tablet_bootstrap.cc:492] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.251420 4335 raft_consensus.cc:491] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.251469 4557 ts_tablet_manager.cc:1397] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.000s
I20250115 10:12:06.251475 4335 raft_consensus.cc:513] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.251574 4335 leader_election.cc:290] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.251617 3275 raft_consensus.cc:2463] T 87fa663159fc4c95a8499a84f7b6faed P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.251619 4557 raft_consensus.cc:357] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.251665 4557 raft_consensus.cc:383] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.251685 4557 raft_consensus.cc:738] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.251858 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4732608c02834f5891a70d4ec91b9e4b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.251962 3542 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4732608c02834f5891a70d4ec91b9e4b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.252106 3214 leader_election.cc:343] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.252146 3215 leader_election.cc:343] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.252190 3215 leader_election.cc:304] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.252250 4908 raft_consensus.cc:2743] T 4732608c02834f5891a70d4ec91b9e4b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.252287 3485 leader_election.cc:304] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.252444 4884 raft_consensus.cc:2798] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.252506 4884 raft_consensus.cc:695] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.252548 4884 consensus_queue.cc:237] T 87fa663159fc4c95a8499a84f7b6faed P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.251716 4557 consensus_queue.cc:260] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.253129 4557 ts_tablet_manager.cc:1428] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:06.253192 4557 tablet_bootstrap.cc:492] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.253573 4557 tablet_bootstrap.cc:654] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.254060 4714 consensus_queue.cc:1035] T afebbabd8d914cd0804a0c64830ef84e P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.254894 3411 raft_consensus.cc:3054] T 4d31f180a3fc499fbd505c986593a7f5 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.255115 4569 tablet_bootstrap.cc:492] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.255157 4569 ts_tablet_manager.cc:1397] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:06.255277 4569 raft_consensus.cc:357] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.255329 4569 raft_consensus.cc:383] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.255344 4569 raft_consensus.cc:738] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.255375 4569 consensus_queue.cc:260] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.255474 4569 ts_tablet_manager.cc:1428] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.255537 4569 tablet_bootstrap.cc:492] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.255978 4569 tablet_bootstrap.cc:654] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.256373 4575 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.256373 5156 consensus_queue.cc:1035] T 4d31f180a3fc499fbd505c986593a7f5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.256420 4575 ts_tablet_manager.cc:1397] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:06.256558 4575 raft_consensus.cc:357] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.256623 4575 raft_consensus.cc:383] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.256660 4575 raft_consensus.cc:738] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.256935 4575 consensus_queue.cc:260] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.257052 4575 ts_tablet_manager.cc:1428] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.257102 4575 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.257509 4575 tablet_bootstrap.cc:654] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.257841 4908 consensus_queue.cc:1035] T f96f4c52a2124c05b0e124a89eacaa71 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.259020 4557 tablet_bootstrap.cc:492] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.259074 4557 ts_tablet_manager.cc:1397] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20250115 10:12:06.259196 4557 raft_consensus.cc:357] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.259248 4557 raft_consensus.cc:383] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.259269 4557 raft_consensus.cc:738] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.259305 4557 consensus_queue.cc:260] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.259392 4557 ts_tablet_manager.cc:1428] T 5f88fd5f4cb14241ba611291d76ed79b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.259446 4557 tablet_bootstrap.cc:492] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.260547 4569 tablet_bootstrap.cc:492] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.260553 4557 tablet_bootstrap.cc:654] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.260587 4569 ts_tablet_manager.cc:1397] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:06.260721 4569 raft_consensus.cc:357] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.260775 4569 raft_consensus.cc:383] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.260814 4569 raft_consensus.cc:738] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.260874 4569 consensus_queue.cc:260] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.261006 4569 ts_tablet_manager.cc:1428] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.261071 4569 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.261495 4569 tablet_bootstrap.cc:654] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.261581 4557 tablet_bootstrap.cc:492] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.261622 4557 ts_tablet_manager.cc:1397] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.261758 4557 raft_consensus.cc:357] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.261812 4557 raft_consensus.cc:383] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.261834 4557 raft_consensus.cc:738] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.261873 4557 consensus_queue.cc:260] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.261940 4575 tablet_bootstrap.cc:492] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.261974 4575 ts_tablet_manager.cc:1397] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:06.261976 4557 ts_tablet_manager.cc:1428] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.262042 4557 tablet_bootstrap.cc:492] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.262089 4575 raft_consensus.cc:357] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.262130 4575 raft_consensus.cc:383] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.262143 4575 raft_consensus.cc:738] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.262174 4575 consensus_queue.cc:260] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.262260 4575 ts_tablet_manager.cc:1428] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.262305 4575 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.262429 4557 tablet_bootstrap.cc:654] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.262708 4575 tablet_bootstrap.cc:654] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.264393 4557 tablet_bootstrap.cc:492] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.264430 4557 ts_tablet_manager.cc:1397] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.264536 4557 raft_consensus.cc:357] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.264577 4557 raft_consensus.cc:383] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.264593 4557 raft_consensus.cc:738] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.264617 4557 consensus_queue.cc:260] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.264629 4877 raft_consensus.cc:491] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.264676 4877 raft_consensus.cc:513] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.264717 4557 ts_tablet_manager.cc:1428] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.264770 4557 tablet_bootstrap.cc:492] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.264770 4877 leader_election.cc:290] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.264815 4434 consensus_queue.cc:1035] T d16a22c6f2be4f8c83c3ef073ee6ff7e P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.264914 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.265070 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5778f29ace314ea18b42afd0b7c1642b" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.265139 4557 tablet_bootstrap.cc:654] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.265333 3350 leader_election.cc:304] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.265403 4877 raft_consensus.cc:2743] T 5778f29ace314ea18b42afd0b7c1642b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.265800 4557 tablet_bootstrap.cc:492] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.265838 4557 ts_tablet_manager.cc:1397] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.265959 4557 raft_consensus.cc:357] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.266016 4557 raft_consensus.cc:383] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.266038 4557 raft_consensus.cc:738] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.266068 4557 consensus_queue.cc:260] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.266167 4557 ts_tablet_manager.cc:1428] T 31b8334f3d734968a0a7ba148bd90d72 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.266228 4557 tablet_bootstrap.cc:492] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.266611 4557 tablet_bootstrap.cc:654] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.267421 4569 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.267458 4569 ts_tablet_manager.cc:1397] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:06.267593 4569 raft_consensus.cc:357] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.267640 4569 raft_consensus.cc:383] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.267656 4569 raft_consensus.cc:738] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.267705 4569 consensus_queue.cc:260] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.267882 4569 ts_tablet_manager.cc:1428] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:06.267956 4569 tablet_bootstrap.cc:492] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.268366 4569 tablet_bootstrap.cc:654] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.268877 4474 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_d93d63dc24474413af7dbd49a6a8b6d6" } new_table_name: "default.Table_9c86cc9f4efe44b8b36d6c99374bbea2" modify_external_catalogs: true
I20250115 10:12:06.268965 4557 tablet_bootstrap.cc:492] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.268998 4557 ts_tablet_manager.cc:1397] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.269124 4557 raft_consensus.cc:357] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.269163 4557 raft_consensus.cc:383] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.269179 4557 raft_consensus.cc:738] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.269209 4557 consensus_queue.cc:260] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.269284 4557 ts_tablet_manager.cc:1428] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.269340 4557 tablet_bootstrap.cc:492] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.269708 4877 raft_consensus.cc:491] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.269754 4557 tablet_bootstrap.cc:654] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.269763 4877 raft_consensus.cc:513] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.269865 4877 leader_election.cc:290] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.270228 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.270293 3546 raft_consensus.cc:2463] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.270850 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.270918 3276 raft_consensus.cc:2463] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
W20250115 10:12:06.271003 3484 consensus_peers.cc:487] T ec9406dc72bb4e489d76011a69ee2838 P 89067c97cc1c45e699ee9f690cb3014f -> Peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Couldn't send request to peer 25d7e460cb6d4ddabf387dc672cc26b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec9406dc72bb4e489d76011a69ee2838. This is attempt 11: this message will repeat every 5th retry.
I20250115 10:12:06.271929 4557 tablet_bootstrap.cc:492] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.271967 4557 ts_tablet_manager.cc:1397] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.272091 4557 raft_consensus.cc:357] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.272143 4557 raft_consensus.cc:383] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.272163 4557 raft_consensus.cc:738] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.272194 4557 consensus_queue.cc:260] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.272269 4557 ts_tablet_manager.cc:1428] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.272334 4557 tablet_bootstrap.cc:492] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.272686 4557 tablet_bootstrap.cc:654] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.272713 4877 raft_consensus.cc:491] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.272782 4877 raft_consensus.cc:513] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.272883 4877 leader_election.cc:290] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.273592 3350 leader_election.cc:304] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.273811 4557 tablet_bootstrap.cc:492] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.273844 4557 ts_tablet_manager.cc:1397] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.273972 4557 raft_consensus.cc:357] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.274024 4557 raft_consensus.cc:383] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.274042 4557 raft_consensus.cc:738] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.274091 4557 consensus_queue.cc:260] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.274197 4557 ts_tablet_manager.cc:1428] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.274245 4557 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.274598 4557 tablet_bootstrap.cc:654] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.274907 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.276450 4557 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.276496 4557 ts_tablet_manager.cc:1397] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.276640 4557 raft_consensus.cc:357] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.276693 4557 raft_consensus.cc:383] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.276722 4557 raft_consensus.cc:738] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.276772 4557 consensus_queue.cc:260] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.276859 4557 ts_tablet_manager.cc:1428] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.276916 4557 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.277186 4587 raft_consensus.cc:2798] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.277230 4587 raft_consensus.cc:491] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.277249 4587 raft_consensus.cc:3054] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.277407 4557 tablet_bootstrap.cc:654] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.277982 4587 raft_consensus.cc:513] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.278095 4587 leader_election.cc:290] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.278879 4557 tablet_bootstrap.cc:492] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.278911 4557 ts_tablet_manager.cc:1397] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.279024 4557 raft_consensus.cc:357] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.279065 4557 raft_consensus.cc:383] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.279084 4557 raft_consensus.cc:738] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.279117 4557 consensus_queue.cc:260] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.279224 4557 ts_tablet_manager.cc:1428] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.279271 4557 tablet_bootstrap.cc:492] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.279621 4557 tablet_bootstrap.cc:654] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.279740 4908 raft_consensus.cc:491] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.279759 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "367694b5edf143ef81e99e348543659a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.279805 4908 raft_consensus.cc:513] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.279922 4908 leader_election.cc:290] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.279995 4908 raft_consensus.cc:491] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.280030 4908 raft_consensus.cc:513] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.280097 4908 leader_election.cc:290] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.280268 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bee9d860f64bf5937ea9bdb095391b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.280336 4557 tablet_bootstrap.cc:492] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.280373 4557 ts_tablet_manager.cc:1397] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.279762 5155 raft_consensus.cc:491] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.280403 5155 raft_consensus.cc:513] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.280496 5155 leader_election.cc:290] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.280504 4557 raft_consensus.cc:357] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.280555 4557 raft_consensus.cc:383] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.280572 4557 raft_consensus.cc:738] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.280594 4884 raft_consensus.cc:491] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.280624 4884 raft_consensus.cc:513] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.280676 4434 raft_consensus.cc:491] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.280710 4884 leader_election.cc:290] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.280702 4434 raft_consensus.cc:513] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.280758 4434 leader_election.cc:290] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.280987 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08bee9d860f64bf5937ea9bdb095391b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.281066 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f778154f3bc3420abe9eb87608228bc3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.281096 3549 raft_consensus.cc:2463] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.281126 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.281261 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.281311 3350 leader_election.cc:304] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.281322 3280 raft_consensus.cc:2463] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.281349 3541 raft_consensus.cc:3054] T 63980fabd5634bf39c41215740cd4d72 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.281414 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f778154f3bc3420abe9eb87608228bc3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.281440 4714 raft_consensus.cc:2743] T 367694b5edf143ef81e99e348543659a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.281488 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb2fb9983c4f45f98291c411ba9ab748" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.281824 3215 leader_election.cc:343] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.281876 3215 leader_election.cc:304] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.281919 3276 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
W20250115 10:12:06.281955 3214 leader_election.cc:343] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.281976 3276 raft_consensus.cc:3054] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.281996 3214 leader_election.cc:304] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.282295 4731 raft_consensus.cc:2798] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.282326 4731 raft_consensus.cc:491] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.282342 4731 raft_consensus.cc:3054] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.282445 3214 leader_election.cc:343] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.282533 3214 leader_election.cc:343] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.282583 5156 raft_consensus.cc:2743] T 08bee9d860f64bf5937ea9bdb095391b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.282680 3276 raft_consensus.cc:2463] T b7a6ec9020494019a32cfb428554bd07 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
W20250115 10:12:06.282949 3484 leader_election.cc:343] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.283026 3484 leader_election.cc:343] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 36b19ae7373c4de688ae30eb7e1d9eab
I20250115 10:12:06.283051 4731 raft_consensus.cc:513] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.283147 4731 leader_election.cc:290] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.283274 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7a6ec9020494019a32cfb428554bd07" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.283331 3549 raft_consensus.cc:3054] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.280627 4557 consensus_queue.cc:260] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.283746 4474 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_ab082477ba1b464691c44f58c276d320"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:06.283875 4557 ts_tablet_manager.cc:1428] T 4732608c02834f5891a70d4ec91b9e4b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
W20250115 10:12:06.283890 4474 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab082477ba1b464691c44f58c276d320 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.283929 4557 tablet_bootstrap.cc:492] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.283975 3549 raft_consensus.cc:2463] T b7a6ec9020494019a32cfb428554bd07 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.284220 3485 leader_election.cc:304] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
W20250115 10:12:06.284299 3485 leader_election.cc:343] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 36b19ae7373c4de688ae30eb7e1d9eab
I20250115 10:12:06.284327 3485 leader_election.cc:304] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.284330 3350 leader_election.cc:304] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.284459 4884 raft_consensus.cc:2798] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.284504 4884 raft_consensus.cc:491] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.284524 4884 raft_consensus.cc:3054] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.284729 4887 raft_consensus.cc:2743] T 36b19ae7373c4de688ae30eb7e1d9eab P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.284768 4877 raft_consensus.cc:2798] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.284827 4877 raft_consensus.cc:695] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:06.284864 4877 consensus_queue.cc:237] T b7a6ec9020494019a32cfb428554bd07 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.285154 4884 raft_consensus.cc:513] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.285240 4884 leader_election.cc:290] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.285261 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_b3480033553e4ac3990cd5d4b866a2cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.285367 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3480033553e4ac3990cd5d4b866a2cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.285559 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_479e6e28c64c4cf089101799cfe8abb1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.285640 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_479e6e28c64c4cf089101799cfe8abb1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.284327 4557 tablet_bootstrap.cc:654] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.286146 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.286211 3280 raft_consensus.cc:3054] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.286499 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be17e049a138457fb70bfa2e3ec2f378" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.286854 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f778154f3bc3420abe9eb87608228bc3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.286921 3546 raft_consensus.cc:3054] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.286942 3280 raft_consensus.cc:2463] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.287190 4557 tablet_bootstrap.cc:492] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.287211 3485 leader_election.cc:304] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.287230 4557 ts_tablet_manager.cc:1397] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:06.287416 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb2fb9983c4f45f98291c411ba9ab748" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.287482 3549 raft_consensus.cc:2463] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.287456 4557 raft_consensus.cc:357] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.287515 4557 raft_consensus.cc:383] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.287536 4557 raft_consensus.cc:738] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.287595 4557 consensus_queue.cc:260] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.287688 4557 ts_tablet_manager.cc:1428] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.287603 4884 raft_consensus.cc:2798] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.287962 4884 raft_consensus.cc:695] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.287993 4884 consensus_queue.cc:237] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.288205 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f778154f3bc3420abe9eb87608228bc3" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.288241 3414 raft_consensus.cc:3054] T f2230f6de9a54e98aa83435d37f68807 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.288329 4557 tablet_bootstrap.cc:492] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:06.288691 3484 leader_election.cc:343] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.288728 4557 tablet_bootstrap.cc:654] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.290086 3215 leader_election.cc:304] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.290172 4908 raft_consensus.cc:2798] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.290206 4908 raft_consensus.cc:491] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.290223 4908 raft_consensus.cc:3054] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.290680 3214 leader_election.cc:343] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.290814 4908 raft_consensus.cc:513] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.290911 4908 leader_election.cc:290] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.291215 4908 raft_consensus.cc:491] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89067c97cc1c45e699ee9f690cb3014f)
I20250115 10:12:06.291275 4908 raft_consensus.cc:513] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.291347 4908 leader_election.cc:290] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.291821 3410 raft_consensus.cc:3054] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.292425 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb2fb9983c4f45f98291c411ba9ab748" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.292645 4890 tablet.cc:1721] T ef7f182c4bde468d919523c44fdf3ea4 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20250115 10:12:06.292663 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb2fb9983c4f45f98291c411ba9ab748" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.292721 3541 raft_consensus.cc:3054] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.293335 3541 raft_consensus.cc:2463] T eb2fb9983c4f45f98291c411ba9ab748 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.287540 3546 raft_consensus.cc:2463] T f778154f3bc3420abe9eb87608228bc3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.293831 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_d091d845615248528e9198bc5b1bc1c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.293944 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d091d845615248528e9198bc5b1bc1c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20250115 10:12:06.294546 3215 leader_election.cc:343] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:12:06.294600 3215 leader_election.cc:304] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.294646 3215 leader_election.cc:304] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.294651 5156 raft_consensus.cc:2798] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.294710 5156 raft_consensus.cc:695] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.294741 5156 consensus_queue.cc:237] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.294937 5156 raft_consensus.cc:2798] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.294976 5156 raft_consensus.cc:695] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.295018 5156 consensus_queue.cc:237] T f778154f3bc3420abe9eb87608228bc3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.296924 3214 leader_election.cc:343] T eb2fb9983c4f45f98291c411ba9ab748 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.296998 3214 leader_election.cc:343] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Not found: Tablet not found: 6034c750d47744ff8eb4d62c7c135ed7
I20250115 10:12:06.297034 3214 leader_election.cc:304] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.297122 4908 raft_consensus.cc:2743] T 6034c750d47744ff8eb4d62c7c135ed7 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250115 10:12:06.298801 4557 tablet_bootstrap.cc:492] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.298853 4557 ts_tablet_manager.cc:1397] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20250115 10:12:06.298992 4557 raft_consensus.cc:357] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.299052 4557 raft_consensus.cc:383] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.299067 4557 raft_consensus.cc:738] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.299101 4557 consensus_queue.cc:260] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.299218 4557 ts_tablet_manager.cc:1428] T 18bb0a4436354a58976f610fab166bcf P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.299307 4557 tablet_bootstrap.cc:492] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.299739 4557 tablet_bootstrap.cc:654] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.300818 4557 tablet_bootstrap.cc:492] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.300856 4557 ts_tablet_manager.cc:1397] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.300979 4557 raft_consensus.cc:357] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.301023 4557 raft_consensus.cc:383] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.301038 4557 raft_consensus.cc:738] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.301076 4557 consensus_queue.cc:260] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.301154 4557 ts_tablet_manager.cc:1428] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.301192 4557 tablet_bootstrap.cc:492] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.301542 4557 tablet_bootstrap.cc:654] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.302870 3770 raft_consensus.cc:491] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.302918 3770 raft_consensus.cc:513] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.303004 3770 leader_election.cc:290] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.303146 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13cfdf73dea14543aff0e564c5fa51b6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.303156 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13cfdf73dea14543aff0e564c5fa51b6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.303210 3541 raft_consensus.cc:2463] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:06.303319 3214 leader_election.cc:343] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.303401 3215 leader_election.cc:304] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.303617 3770 raft_consensus.cc:2798] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.303675 3770 raft_consensus.cc:491] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.303695 3770 raft_consensus.cc:3054] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.304486 3770 raft_consensus.cc:513] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.304591 3770 leader_election.cc:290] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.304697 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13cfdf73dea14543aff0e564c5fa51b6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.304751 3541 raft_consensus.cc:3054] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.305171 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13cfdf73dea14543aff0e564c5fa51b6" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.305367 3214 leader_election.cc:343] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.305383 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_2bb0b1e14a8f4d97abc21e76b50767dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:06.305447 3541 raft_consensus.cc:2463] T 13cfdf73dea14543aff0e564c5fa51b6 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:06.305531 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2bb0b1e14a8f4d97abc21e76b50767dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.305575 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_6231329e6eae43e5827d75e7ece27904"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.305676 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6231329e6eae43e5827d75e7ece27904 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.305907 4557 tablet_bootstrap.cc:492] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.305949 4557 ts_tablet_manager.cc:1397] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20250115 10:12:06.306042 3215 leader_election.cc:304] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.306120 4557 raft_consensus.cc:357] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.306183 4557 raft_consensus.cc:383] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.306202 4557 raft_consensus.cc:738] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.306288 4557 consensus_queue.cc:260] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.306445 4557 ts_tablet_manager.cc:1428] T d5490db43ba14c039847a9326a7620c4 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.306512 4557 tablet_bootstrap.cc:492] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.306499 4908 raft_consensus.cc:2798] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.306543 4908 raft_consensus.cc:695] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.306589 4908 consensus_queue.cc:237] T 13cfdf73dea14543aff0e564c5fa51b6 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.306769 4908 raft_consensus.cc:491] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.306804 4908 raft_consensus.cc:513] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.306887 4908 leader_election.cc:290] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.306939 4557 tablet_bootstrap.cc:654] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.308285 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d9a01abd314d0e9f60df4f6736985b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.308638 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d9a01abd314d0e9f60df4f6736985b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.308676 3214 leader_election.cc:343] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.308701 3541 raft_consensus.cc:2463] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.308797 3215 leader_election.cc:304] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.308882 5155 raft_consensus.cc:2798] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.308903 5155 raft_consensus.cc:491] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.308923 5155 raft_consensus.cc:3054] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.309545 5155 raft_consensus.cc:513] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.309640 5155 leader_election.cc:290] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.309870 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d9a01abd314d0e9f60df4f6736985b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.309921 3541 raft_consensus.cc:3054] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.309933 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29d9a01abd314d0e9f60df4f6736985b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.310462 3541 raft_consensus.cc:2463] T 29d9a01abd314d0e9f60df4f6736985b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:06.310649 3214 leader_election.cc:343] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.310791 3215 leader_election.cc:304] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.310807 5155 raft_consensus.cc:491] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.310853 5155 raft_consensus.cc:513] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.310890 4908 raft_consensus.cc:491] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.310938 5155 leader_election.cc:290] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.310917 4908 raft_consensus.cc:513] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.310966 5155 raft_consensus.cc:2798] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.310988 5155 raft_consensus.cc:695] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.311028 5155 consensus_queue.cc:237] T 29d9a01abd314d0e9f60df4f6736985b P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.310988 4908 leader_election.cc:290] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.311242 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4088e4c8b4774d9e996844102c1b0d02" } modify_external_catalogs: true
I20250115 10:12:06.311319 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_4088e4c8b4774d9e996844102c1b0d02" } modify_external_catalogs: true
I20250115 10:12:06.311506 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc03234954824a64aa8d8abd5fc1dc29" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.311514 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffe30b01774a4345992fa0b29ee7f418" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.312501 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 6a285009787f4acb810a1829ca37a845
I20250115 10:12:06.312739 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a285009787f4acb810a1829ca37a845 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.312830 4589 tablet_replica.cc:331] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.312824 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a285009787f4acb810a1829ca37a845 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.312896 4589 raft_consensus.cc:2238] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.312904 4551 tablet_replica.cc:331] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.312929 4589 raft_consensus.cc:2267] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.312965 4551 raft_consensus.cc:2238] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.313014 4551 raft_consensus.cc:2267] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.313057 4589 ts_tablet_manager.cc:1905] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:06.313105 3214 leader_election.cc:343] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.313153 3214 leader_election.cc:343] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.313189 4551 ts_tablet_manager.cc:1905] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.313319 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc03234954824a64aa8d8abd5fc1dc29" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.313432 3215 leader_election.cc:343] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.313460 3215 leader_election.cc:304] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.313817 4908 raft_consensus.cc:2743] T bc03234954824a64aa8d8abd5fc1dc29 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.313864 4908 raft_consensus.cc:491] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.313887 4908 raft_consensus.cc:513] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.313968 4908 leader_election.cc:290] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.314163 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a16e074cf07c42e9b5e5596e81b4bd94" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.314296 3215 leader_election.cc:343] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.314479 4589 ts_tablet_manager.cc:1918] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:06.314509 4589 log.cc:1198] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/6a285009787f4acb810a1829ca37a845
I20250115 10:12:06.314586 4551 ts_tablet_manager.cc:1918] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:06.314618 4589 ts_tablet_manager.cc:1939] T 6a285009787f4acb810a1829ca37a845 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.314630 4551 log.cc:1198] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/6a285009787f4acb810a1829ca37a845
I20250115 10:12:06.314695 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a16e074cf07c42e9b5e5596e81b4bd94" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.314795 4551 ts_tablet_manager.cc:1939] T 6a285009787f4acb810a1829ca37a845 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
W20250115 10:12:06.314880 3214 leader_election.cc:343] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.314914 3214 leader_election.cc:304] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.314921 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffe30b01774a4345992fa0b29ee7f418" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.314970 3546 raft_consensus.cc:2463] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.314985 4908 raft_consensus.cc:2743] T a16e074cf07c42e9b5e5596e81b4bd94 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.315258 3215 leader_election.cc:304] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.315331 4908 raft_consensus.cc:2798] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.315368 4908 raft_consensus.cc:491] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.315389 4908 raft_consensus.cc:3054] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.316054 4908 raft_consensus.cc:513] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.316183 4908 leader_election.cc:290] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.316468 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffe30b01774a4345992fa0b29ee7f418" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.316526 3546 raft_consensus.cc:3054] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.316661 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffe30b01774a4345992fa0b29ee7f418" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.316848 3214 leader_election.cc:343] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.317137 3546 raft_consensus.cc:2463] T ffe30b01774a4345992fa0b29ee7f418 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.317227 4575 tablet_bootstrap.cc:492] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.317268 4575 ts_tablet_manager.cc:1397] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.000s
I20250115 10:12:06.317309 3215 leader_election.cc:304] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.317404 4908 raft_consensus.cc:2798] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.317471 4908 raft_consensus.cc:695] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.317447 4575 raft_consensus.cc:357] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.317526 4575 raft_consensus.cc:383] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.317515 4908 consensus_queue.cc:237] T ffe30b01774a4345992fa0b29ee7f418 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.317553 4575 raft_consensus.cc:738] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.317596 4575 consensus_queue.cc:260] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.317708 4575 ts_tablet_manager.cc:1428] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.317781 4575 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
W20250115 10:12:06.318156 3350 consensus_peers.cc:487] T 0e1465bcc80e40cdad4e0722eb0d74c3 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e1465bcc80e40cdad4e0722eb0d74c3. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.318271 4575 tablet_bootstrap.cc:654] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.319214 4569 tablet_bootstrap.cc:492] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.319265 4569 ts_tablet_manager.cc:1397] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20250115 10:12:06.319414 4569 raft_consensus.cc:357] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.319473 4569 raft_consensus.cc:383] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.319494 4569 raft_consensus.cc:738] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.319533 4569 consensus_queue.cc:260] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.319643 4569 ts_tablet_manager.cc:1428] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.319705 4569 tablet_bootstrap.cc:492] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.320176 4569 tablet_bootstrap.cc:654] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.320557 4338 raft_consensus.cc:491] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.320602 4338 raft_consensus.cc:513] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.320711 4338 leader_election.cc:290] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.320869 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa25f3b8144f407c9c437be6676379b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.320933 3274 raft_consensus.cc:2463] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.320936 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa25f3b8144f407c9c437be6676379b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.321295 4557 tablet_bootstrap.cc:492] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.321345 4557 ts_tablet_manager.cc:1397] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250115 10:12:06.321482 4557 raft_consensus.cc:357] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.321537 4557 raft_consensus.cc:383] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.321552 4557 raft_consensus.cc:738] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.321583 4557 consensus_queue.cc:260] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.321666 4557 ts_tablet_manager.cc:1428] T f22785e218cb4a54ba56757c8251cfd7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.321724 4557 tablet_bootstrap.cc:492] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.321834 3485 leader_election.cc:304] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.321935 4887 raft_consensus.cc:2798] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.321966 4887 raft_consensus.cc:491] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.321982 4887 raft_consensus.cc:3054] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.322149 4557 tablet_bootstrap.cc:654] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.322666 4887 raft_consensus.cc:513] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.322817 4887 leader_election.cc:290] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.322958 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa25f3b8144f407c9c437be6676379b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.323028 3274 raft_consensus.cc:3054] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.323673 3274 raft_consensus.cc:2463] T aa25f3b8144f407c9c437be6676379b2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.323880 3485 leader_election.cc:304] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.323953 4338 raft_consensus.cc:2798] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.323999 4338 raft_consensus.cc:695] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.324031 4338 consensus_queue.cc:237] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.324272 3484 leader_election.cc:343] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.324787 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa25f3b8144f407c9c437be6676379b2" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.324970 3484 leader_election.cc:343] T aa25f3b8144f407c9c437be6676379b2 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.325973 5155 raft_consensus.cc:491] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.326027 5155 raft_consensus.cc:513] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.326124 5155 leader_election.cc:290] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.326349 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c5eb11332cb4489ade8f441158eb958" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.326359 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c5eb11332cb4489ade8f441158eb958" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.326412 3410 raft_consensus.cc:2463] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.326419 3541 raft_consensus.cc:2463] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.326584 3214 leader_election.cc:304] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.326653 5155 raft_consensus.cc:2798] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.326686 5155 raft_consensus.cc:491] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.326701 5155 raft_consensus.cc:3054] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.327296 5155 raft_consensus.cc:513] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.327399 5155 leader_election.cc:290] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.327630 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c5eb11332cb4489ade8f441158eb958" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.327689 3410 raft_consensus.cc:3054] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.327746 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c5eb11332cb4489ade8f441158eb958" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.327816 3546 raft_consensus.cc:3054] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.328330 3410 raft_consensus.cc:2463] T 0c5eb11332cb4489ade8f441158eb958 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.328430 3546 raft_consensus.cc:2463] T 0c5eb11332cb4489ade8f441158eb958 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.328516 3214 leader_election.cc:304] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.328601 5155 raft_consensus.cc:2798] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.328632 5155 raft_consensus.cc:695] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.328660 5155 consensus_queue.cc:237] T 0c5eb11332cb4489ade8f441158eb958 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.329046 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 6a285009787f4acb810a1829ca37a845 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]) successfully deleted
I20250115 10:12:06.329159 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 6a285009787f4acb810a1829ca37a845 (table default.Table_4088e4c8b4774d9e996844102c1b0d02 [id=e128e09ce4a545f88f9924e19b48510b]) successfully deleted
I20250115 10:12:06.329185 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1c3356d340b54d349223311a44e03f7b" } modify_external_catalogs: true
I20250115 10:12:06.329250 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_1c3356d340b54d349223311a44e03f7b" } modify_external_catalogs: true
I20250115 10:12:06.332243 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 3119c276fa7a4363a1d5299f6cfb842e
I20250115 10:12:06.332633 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet 3119c276fa7a4363a1d5299f6cfb842e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.332684 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet 3119c276fa7a4363a1d5299f6cfb842e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.332837 4887 raft_consensus.cc:491] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.332882 4887 raft_consensus.cc:513] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.332970 4887 leader_election.cc:290] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:06.333181 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 3119c276fa7a4363a1d5299f6cfb842e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3119c276fa7a4363a1d5299f6cfb842e already in progress: creating tablet
I20250115 10:12:06.333204 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a729d69595f47bd9872d46068acc98f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.333276 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 3119c276fa7a4363a1d5299f6cfb842e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3119c276fa7a4363a1d5299f6cfb842e already in progress: creating tablet
W20250115 10:12:06.333361 3484 leader_election.cc:343] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.333590 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a729d69595f47bd9872d46068acc98f" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
W20250115 10:12:06.333809 3485 leader_election.cc:343] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.333853 3485 leader_election.cc:304] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.333902 4887 raft_consensus.cc:2743] T 1a729d69595f47bd9872d46068acc98f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.334358 4569 tablet_bootstrap.cc:492] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.334406 4569 ts_tablet_manager.cc:1397] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20250115 10:12:06.334446 4557 tablet_bootstrap.cc:492] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.334484 4557 ts_tablet_manager.cc:1397] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:06.334574 4569 raft_consensus.cc:357] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.334635 4569 raft_consensus.cc:383] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.334620 4557 raft_consensus.cc:357] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.334656 4569 raft_consensus.cc:738] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.334666 4557 raft_consensus.cc:383] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.334681 4557 raft_consensus.cc:738] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.334695 4569 consensus_queue.cc:260] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.334715 4557 consensus_queue.cc:260] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.334801 4569 ts_tablet_manager.cc:1428] T 1a729d69595f47bd9872d46068acc98f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.334825 4557 ts_tablet_manager.cc:1428] T 8def1d79286c4b8b8077121a24abee44 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.334868 4569 tablet_bootstrap.cc:492] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.334883 4557 tablet_bootstrap.cc:492] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.335250 4569 tablet_bootstrap.cc:654] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.335258 4557 tablet_bootstrap.cc:654] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.336406 4472 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0e782126bee84bd3ba6a5be9ae46c96c" } modify_external_catalogs: true
I20250115 10:12:06.336477 4472 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_0e782126bee84bd3ba6a5be9ae46c96c" } modify_external_catalogs: true
I20250115 10:12:06.336717 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_253a0050b6cf43e3953c8d5affcbe231" } modify_external_catalogs: true
I20250115 10:12:06.336781 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_253a0050b6cf43e3953c8d5affcbe231" } modify_external_catalogs: true
I20250115 10:12:06.337870 4575 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.337937 4575 ts_tablet_manager.cc:1397] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.001s
I20250115 10:12:06.338110 4575 raft_consensus.cc:357] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.338173 4575 raft_consensus.cc:383] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.338212 4575 raft_consensus.cc:738] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.338258 4575 consensus_queue.cc:260] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.338361 4575 ts_tablet_manager.cc:1428] T 203486455372404aa0a735cd219934be P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.338423 4575 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.338871 4575 tablet_bootstrap.cc:654] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.340349 4887 raft_consensus.cc:491] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.340412 4887 raft_consensus.cc:513] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.340503 4887 leader_election.cc:290] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.341082 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46aacb7a8c9b42588e67e6e4aef7613d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.341405 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet ca2e043501b04096b648d179a13e8653
I20250115 10:12:06.341506 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet be17e049a138457fb70bfa2e3ec2f378
I20250115 10:12:06.340893 4569 tablet_bootstrap.cc:492] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.341609 4569 ts_tablet_manager.cc:1397] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:06.341900 3244 tablet_service.cc:1514] Processing DeleteTablet for tablet ca2e043501b04096b648d179a13e8653 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.341905 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet be17e049a138457fb70bfa2e3ec2f378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.341954 3530 tablet_service.cc:1514] Processing DeleteTablet for tablet ca2e043501b04096b648d179a13e8653 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.342008 4589 tablet_replica.cc:331] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.342023 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet be17e049a138457fb70bfa2e3ec2f378 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.342065 4551 tablet_replica.cc:331] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.342080 4589 raft_consensus.cc:2238] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.342113 4551 raft_consensus.cc:2238] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.342115 4589 raft_consensus.cc:2267] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.342142 4551 raft_consensus.cc:2267] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.342329 4589 ts_tablet_manager.cc:1905] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
W20250115 10:12:06.342428 3484 leader_election.cc:343] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.342810 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46aacb7a8c9b42588e67e6e4aef7613d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.342888 3274 raft_consensus.cc:2463] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.343113 4551 ts_tablet_manager.cc:1905] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.343740 3485 leader_election.cc:304] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.343955 4589 ts_tablet_manager.cc:1918] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.344009 4589 log.cc:1198] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/ca2e043501b04096b648d179a13e8653
I20250115 10:12:06.344200 4589 ts_tablet_manager.cc:1939] T ca2e043501b04096b648d179a13e8653 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.344338 3414 raft_consensus.cc:3054] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.344460 4589 tablet_replica.cc:331] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.344523 4589 raft_consensus.cc:2238] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.344553 4589 raft_consensus.cc:2267] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.344714 4551 ts_tablet_manager.cc:1918] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.344769 4551 log.cc:1198] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/ca2e043501b04096b648d179a13e8653
I20250115 10:12:06.344780 4589 ts_tablet_manager.cc:1905] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.344956 4551 ts_tablet_manager.cc:1939] T ca2e043501b04096b648d179a13e8653 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.345170 4551 tablet_replica.cc:331] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.345222 4551 raft_consensus.cc:2238] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:06.345268 4551 pending_rounds.cc:62] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Trying to abort 1 pending ops.
I20250115 10:12:06.345285 4551 pending_rounds.cc:69] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7114489554075729920 op_type: NO_OP noop_request { }
I20250115 10:12:06.341778 4569 raft_consensus.cc:357] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.345320 4551 raft_consensus.cc:2883] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20250115 10:12:06.345331 4569 raft_consensus.cc:383] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.345345 4551 raft_consensus.cc:2267] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.345360 4569 raft_consensus.cc:738] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.345395 4569 consensus_queue.cc:260] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.345506 4569 ts_tablet_manager.cc:1428] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:06.345631 4434 raft_consensus.cc:2798] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.345681 4434 raft_consensus.cc:491] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.345707 4434 raft_consensus.cc:3054] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.345795 4551 ts_tablet_manager.cc:1905] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.345818 4890 tablet.cc:1721] T 60cc9a1b2c4348ada0d8dab958aded09 P 25d7e460cb6d4ddabf387dc672cc26b3: Alter schema from (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
0:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20250115 10:12:06.346099 4569 tablet_bootstrap.cc:492] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.346414 4434 raft_consensus.cc:513] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.346534 4434 leader_election.cc:290] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.346643 4569 tablet_bootstrap.cc:654] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.346868 3350 consensus_peers.cc:487] T 28861e966ce645878983bec6476255bb P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28861e966ce645878983bec6476255bb. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.347057 4551 ts_tablet_manager.cc:1918] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20250115 10:12:06.347070 4557 tablet_bootstrap.cc:492] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.347106 4551 log.cc:1198] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/be17e049a138457fb70bfa2e3ec2f378
I20250115 10:12:06.347116 4557 ts_tablet_manager.cc:1397] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.000s
I20250115 10:12:06.347319 4551 ts_tablet_manager.cc:1939] T be17e049a138457fb70bfa2e3ec2f378 P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.347281 4557 raft_consensus.cc:357] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.347364 4557 raft_consensus.cc:383] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.347395 4557 raft_consensus.cc:738] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.347442 4557 consensus_queue.cc:260] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.347536 4557 ts_tablet_manager.cc:1428] T c1a4478e2e094f789cc9dc95da58c321 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.347546 3274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46aacb7a8c9b42588e67e6e4aef7613d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.347590 4557 tablet_bootstrap.cc:492] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.347596 3274 raft_consensus.cc:3054] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.347884 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]) successfully deleted
I20250115 10:12:06.347870 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46aacb7a8c9b42588e67e6e4aef7613d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.347951 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet ca2e043501b04096b648d179a13e8653 (table default.Table_0e782126bee84bd3ba6a5be9ae46c96c [id=6ecef90a16be43e7b76d3c3363c61a1b]) successfully deleted
I20250115 10:12:06.348006 4557 tablet_bootstrap.cc:654] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.348445 3484 leader_election.cc:343] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.348971 4589 ts_tablet_manager.cc:1918] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20250115 10:12:06.349025 4589 log.cc:1198] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/be17e049a138457fb70bfa2e3ec2f378
I20250115 10:12:06.349223 4589 ts_tablet_manager.cc:1939] T be17e049a138457fb70bfa2e3ec2f378 P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.349218 4884 raft_consensus.cc:491] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.349256 4884 raft_consensus.cc:513] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.349350 4884 leader_election.cc:290] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.349689 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c045349a48644eda41ea8965b16174d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.349756 3412 raft_consensus.cc:2463] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
W20250115 10:12:06.350157 3485 leader_election.cc:343] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8c045349a48644eda41ea8965b16174d
I20250115 10:12:06.350406 3484 leader_election.cc:304] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.350519 4338 raft_consensus.cc:2798] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.350545 4338 raft_consensus.cc:491] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.350561 4338 raft_consensus.cc:3054] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.351142 4338 raft_consensus.cc:513] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.351239 4338 leader_election.cc:290] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
W20250115 10:12:06.352103 3485 leader_election.cc:343] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 8c045349a48644eda41ea8965b16174d
I20250115 10:12:06.352479 3274 raft_consensus.cc:2463] T 46aacb7a8c9b42588e67e6e4aef7613d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.352802 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet be17e049a138457fb70bfa2e3ec2f378 (table default.Table_253a0050b6cf43e3953c8d5affcbe231 [id=71bc62f4531e48e9b39082ccd7fec4ee]) successfully deleted
I20250115 10:12:06.352877 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet be17e049a138457fb70bfa2e3ec2f378 (table default.Table_253a0050b6cf43e3953c8d5affcbe231 [id=71bc62f4531e48e9b39082ccd7fec4ee]) successfully deleted
I20250115 10:12:06.353266 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c045349a48644eda41ea8965b16174d" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.353332 3412 raft_consensus.cc:3054] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.354087 3412 raft_consensus.cc:2463] T 8c045349a48644eda41ea8965b16174d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.354661 3484 leader_election.cc:304] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.354780 4433 raft_consensus.cc:2798] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.354815 4433 raft_consensus.cc:695] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.354847 4433 consensus_queue.cc:237] T 8c045349a48644eda41ea8965b16174d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.354959 3485 leader_election.cc:304] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters: 25d7e460cb6d4ddabf387dc672cc26b3
I20250115 10:12:06.355033 4433 raft_consensus.cc:2798] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.355064 4433 raft_consensus.cc:695] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.355093 4433 consensus_queue.cc:237] T 46aacb7a8c9b42588e67e6e4aef7613d P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.358659 4575 tablet_bootstrap.cc:492] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.358708 4575 ts_tablet_manager.cc:1397] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.000s
I20250115 10:12:06.358870 4575 raft_consensus.cc:357] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.358925 4575 raft_consensus.cc:383] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.358943 4575 raft_consensus.cc:738] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.358981 4575 consensus_queue.cc:260] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.359102 4575 ts_tablet_manager.cc:1428] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.359163 4575 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.359566 4575 tablet_bootstrap.cc:654] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.360034 4471 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6a3d89b055284572b6f730115eb59e6d" } modify_external_catalogs: true
I20250115 10:12:06.360108 4471 catalog_manager.cc:2646] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_6a3d89b055284572b6f730115eb59e6d" } modify_external_catalogs: true
W20250115 10:12:06.360390 3215 consensus_peers.cc:487] T 575f1a39f8a54c4cb21cd17d562c0542 P 4c9ab337b4ea47d18b4208d424cf5fd1 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 575f1a39f8a54c4cb21cd17d562c0542. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.361620 4471 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 5185ff7621e742eb81fa8964ec9ff20b
I20250115 10:12:06.362323 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 5185ff7621e742eb81fa8964ec9ff20b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.362402 4589 tablet_replica.cc:331] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.362468 4589 raft_consensus.cc:2238] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:06.362532 4589 raft_consensus.cc:2267] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.362728 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 5185ff7621e742eb81fa8964ec9ff20b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-01-15 10:12:06 UTC) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.362843 4551 tablet_replica.cc:331] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.362839 4589 ts_tablet_manager.cc:1905] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.362898 4551 raft_consensus.cc:2238] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.362944 4551 raft_consensus.cc:2267] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.363276 4551 ts_tablet_manager.cc:1905] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.364333 4589 ts_tablet_manager.cc:1918] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:12:06.364384 4589 log.cc:1198] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/5185ff7621e742eb81fa8964ec9ff20b
I20250115 10:12:06.364559 4589 ts_tablet_manager.cc:1939] T 5185ff7621e742eb81fa8964ec9ff20b P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.365018 4551 ts_tablet_manager.cc:1918] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20250115 10:12:06.365065 4551 log.cc:1198] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/5185ff7621e742eb81fa8964ec9ff20b
I20250115 10:12:06.365247 4551 ts_tablet_manager.cc:1939] T 5185ff7621e742eb81fa8964ec9ff20b P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.366480 4575 tablet_bootstrap.cc:492] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.366531 4575 ts_tablet_manager.cc:1397] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20250115 10:12:06.366717 4575 raft_consensus.cc:357] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.366779 4575 raft_consensus.cc:383] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.366797 4575 raft_consensus.cc:738] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.366822 4575 consensus_queue.cc:260] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.366927 4575 ts_tablet_manager.cc:1428] T 6a285009787f4acb810a1829ca37a845 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.366981 4575 tablet_bootstrap.cc:492] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.367422 4575 tablet_bootstrap.cc:654] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.368683 4557 tablet_bootstrap.cc:492] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.368734 4557 ts_tablet_manager.cc:1397] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.001s
I20250115 10:12:06.368902 4569 tablet_bootstrap.cc:492] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.368891 4557 raft_consensus.cc:357] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.368942 4557 raft_consensus.cc:383] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.368963 4569 ts_tablet_manager.cc:1397] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20250115 10:12:06.368976 4557 raft_consensus.cc:738] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.369071 4557 consensus_queue.cc:260] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.369168 4557 ts_tablet_manager.cc:1428] T 9c21c9b21c7c4aed981029846b28aee5 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.369164 4569 raft_consensus.cc:357] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.369225 4557 tablet_bootstrap.cc:492] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.369228 4569 raft_consensus.cc:383] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.369247 4569 raft_consensus.cc:738] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.369277 4569 consensus_queue.cc:260] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.369374 4569 ts_tablet_manager.cc:1428] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.369429 4569 tablet_bootstrap.cc:492] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.369626 4557 tablet_bootstrap.cc:654] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.369871 4569 tablet_bootstrap.cc:654] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.369899 4575 tablet_bootstrap.cc:492] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.369938 4575 ts_tablet_manager.cc:1397] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20250115 10:12:06.370074 4575 raft_consensus.cc:357] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.370136 4575 raft_consensus.cc:383] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.370155 4575 raft_consensus.cc:738] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.370222 4575 consensus_queue.cc:260] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.370309 4575 ts_tablet_manager.cc:1428] T d1a8c8ad0ca84fc3aec22cd825579e6d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20250115 10:12:06.370359 4575 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.370756 4575 tablet_bootstrap.cc:654] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.372712 4575 tablet_bootstrap.cc:492] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.372766 4575 ts_tablet_manager.cc:1397] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.372874 4575 raft_consensus.cc:357] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.372920 4575 raft_consensus.cc:383] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.372936 4575 raft_consensus.cc:738] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.372994 4575 consensus_queue.cc:260] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.373077 4575 ts_tablet_manager.cc:1428] T 87fa663159fc4c95a8499a84f7b6faed P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.373136 4575 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.373509 4575 tablet_bootstrap.cc:654] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.373755 4557 tablet_bootstrap.cc:492] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.373798 4557 ts_tablet_manager.cc:1397] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:06.373854 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_6a3d89b055284572b6f730115eb59e6d [id=147b41dfa10b45599d423ceac25e8094]) successfully deleted
I20250115 10:12:06.373883 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_267cadbaca5042b591ea75c7a6273863" } new_table_name: "default.Table_1e18dc5221b14368b173cdfe0afe6640" modify_external_catalogs: true
I20250115 10:12:06.373943 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 5185ff7621e742eb81fa8964ec9ff20b (table default.Table_6a3d89b055284572b6f730115eb59e6d [id=147b41dfa10b45599d423ceac25e8094]) successfully deleted
I20250115 10:12:06.373940 4557 raft_consensus.cc:357] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.374038 4557 raft_consensus.cc:383] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.374056 4557 raft_consensus.cc:738] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.374094 4557 consensus_queue.cc:260] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.374189 4557 ts_tablet_manager.cc:1428] T a16e074cf07c42e9b5e5596e81b4bd94 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.374248 4557 tablet_bootstrap.cc:492] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.374661 4557 tablet_bootstrap.cc:654] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.375118 4557 tablet_bootstrap.cc:492] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.375169 4557 ts_tablet_manager.cc:1397] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20250115 10:12:06.375319 4557 raft_consensus.cc:357] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.375372 4557 raft_consensus.cc:383] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.375389 4557 raft_consensus.cc:738] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.375422 4557 consensus_queue.cc:260] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.375536 4557 ts_tablet_manager.cc:1428] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.375602 4557 tablet_bootstrap.cc:492] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.376048 4557 tablet_bootstrap.cc:654] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.376174 4569 tablet_bootstrap.cc:492] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.376216 4569 ts_tablet_manager.cc:1397] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:06.376356 4569 raft_consensus.cc:357] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.376403 4569 raft_consensus.cc:383] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.376422 4569 raft_consensus.cc:738] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.376462 4569 consensus_queue.cc:260] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.376547 4569 ts_tablet_manager.cc:1428] T 8def1d79286c4b8b8077121a24abee44 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.376600 4569 tablet_bootstrap.cc:492] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.377030 4569 tablet_bootstrap.cc:654] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.379406 3411 raft_consensus.cc:3054] T b110fe6c13204cf295abb29839f3380b P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.379685 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet a076172bba8e4878978c318d441577bd from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.380575 4557 tablet_bootstrap.cc:492] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
W20250115 10:12:06.380594 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6bea4b18a1824c9d98f8f5ae5163f2e6 consensus state has no leader
I20250115 10:12:06.380625 4557 ts_tablet_manager.cc:1397] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20250115 10:12:06.380784 4557 raft_consensus.cc:357] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.380834 4557 raft_consensus.cc:383] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.380849 4557 raft_consensus.cc:738] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.380887 4557 consensus_queue.cc:260] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.380992 4557 ts_tablet_manager.cc:1428] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.381040 4557 tablet_bootstrap.cc:492] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
W20250115 10:12:06.381171 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/outbound_call.cc:307 for 13171ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:06.381438 4557 tablet_bootstrap.cc:654] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.381573 4569 tablet_bootstrap.cc:492] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.381610 4569 ts_tablet_manager.cc:1397] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:06.381727 4569 raft_consensus.cc:357] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.381800 4569 raft_consensus.cc:383] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.381822 4569 raft_consensus.cc:738] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.381868 4569 consensus_queue.cc:260] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.381964 4569 ts_tablet_manager.cc:1428] T 04c5352e522a49ceb65bf409111b7969 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.382023 4569 tablet_bootstrap.cc:492] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.382542 4569 tablet_bootstrap.cc:654] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.385411 3546 raft_consensus.cc:3054] T 98e5519e80144b7582d76b7f9d8d6ffa P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.386466 4575 tablet_bootstrap.cc:492] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.386521 4575 ts_tablet_manager.cc:1397] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20250115 10:12:06.386703 4575 raft_consensus.cc:357] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.386763 4575 raft_consensus.cc:383] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.386787 4575 raft_consensus.cc:738] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.386828 4575 consensus_queue.cc:260] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.386953 4575 ts_tablet_manager.cc:1428] T f778154f3bc3420abe9eb87608228bc3 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.387023 4575 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.387583 4575 tablet_bootstrap.cc:654] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.388162 4434 raft_consensus.cc:491] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.388214 4434 raft_consensus.cc:513] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.388341 4434 leader_election.cc:290] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.388706 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b83ca446824b88978e3dc3269d43a3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.388726 3485 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 63b83ca446824b88978e3dc3269d43a3
I20250115 10:12:06.388777 3411 raft_consensus.cc:2463] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.388906 3484 leader_election.cc:304] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1
I20250115 10:12:06.388995 4434 raft_consensus.cc:2798] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.389020 4434 raft_consensus.cc:491] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.389036 4434 raft_consensus.cc:3054] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.389081 4569 tablet_bootstrap.cc:492] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.389117 4569 ts_tablet_manager.cc:1397] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:06.389235 4569 raft_consensus.cc:357] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.389302 4569 raft_consensus.cc:383] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.389318 4569 raft_consensus.cc:738] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.389350 4569 consensus_queue.cc:260] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.389426 4569 ts_tablet_manager.cc:1428] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.389483 4569 tablet_bootstrap.cc:492] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.389679 4434 raft_consensus.cc:513] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.389786 4434 leader_election.cc:290] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.389890 4569 tablet_bootstrap.cc:654] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.390933 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63b83ca446824b88978e3dc3269d43a3" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.390995 3411 raft_consensus.cc:3054] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.391662 3411 raft_consensus.cc:2463] T 63b83ca446824b88978e3dc3269d43a3 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.392021 3484 leader_election.cc:304] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.392087 4471 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_17ae29bb107c41b6add9cf42fc2508c4" } new_table_name: "default.Table_6dcafed315bc4e54b930ced81982dda9" modify_external_catalogs: true
I20250115 10:12:06.392143 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_554568fab130401a998c14e76a41a8aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.392278 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_554568fab130401a998c14e76a41a8aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.392526 4434 raft_consensus.cc:2798] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.392570 4434 raft_consensus.cc:695] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.392606 4434 consensus_queue.cc:237] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
W20250115 10:12:06.393133 3485 leader_election.cc:343] T 63b83ca446824b88978e3dc3269d43a3 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 63b83ca446824b88978e3dc3269d43a3
W20250115 10:12:06.393528 4471 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f98840ed8bc744c58dbc74a5ad835ea4 has no consensus state
I20250115 10:12:06.395654 4557 tablet_bootstrap.cc:492] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.395702 4557 ts_tablet_manager.cc:1397] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20250115 10:12:06.395887 4557 raft_consensus.cc:357] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.395941 4557 raft_consensus.cc:383] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.395972 4557 raft_consensus.cc:738] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.396006 4557 consensus_queue.cc:260] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.396108 4557 ts_tablet_manager.cc:1428] T 10c5cf464dcd484191838d56253ded0b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.396173 4557 tablet_bootstrap.cc:492] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.396672 4557 tablet_bootstrap.cc:654] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.397038 4338 raft_consensus.cc:491] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.397079 4338 raft_consensus.cc:513] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.397168 4569 tablet_bootstrap.cc:492] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.397189 4338 leader_election.cc:290] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.397207 4569 ts_tablet_manager.cc:1397] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:06.397325 4569 raft_consensus.cc:357] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.397372 4569 raft_consensus.cc:383] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.397387 4569 raft_consensus.cc:738] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.397428 4569 consensus_queue.cc:260] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.397519 4569 ts_tablet_manager.cc:1428] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.397581 4569 tablet_bootstrap.cc:492] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.397958 4569 tablet_bootstrap.cc:654] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.398931 4575 tablet_bootstrap.cc:492] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.398972 4575 ts_tablet_manager.cc:1397] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20250115 10:12:06.399096 4575 raft_consensus.cc:357] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.399138 4575 raft_consensus.cc:383] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.399153 4575 raft_consensus.cc:738] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.399175 4575 consensus_queue.cc:260] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.399248 4575 ts_tablet_manager.cc:1428] T be17e049a138457fb70bfa2e3ec2f378 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.399302 4575 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.399680 4575 tablet_bootstrap.cc:654] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.401110 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.401185 3412 raft_consensus.cc:2463] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.401485 3484 leader_election.cc:304] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.401564 4338 raft_consensus.cc:2798] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.401588 4338 raft_consensus.cc:491] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.401604 4338 raft_consensus.cc:3054] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.401674 4472 master_service.cc:946] ReplaceTablet: received request to replace tablet 71c23863beb24d27b337fa039d7f04cd from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.402031 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.402097 3280 raft_consensus.cc:2463] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.402236 4338 raft_consensus.cc:513] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.402338 4338 leader_election.cc:290] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.403218 3770 raft_consensus.cc:491] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.403276 3770 raft_consensus.cc:513] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.403416 3770 leader_election.cc:290] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.403544 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96506d095fe74ea8941b760814e393f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.403750 3215 leader_election.cc:343] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.403903 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.403952 3411 raft_consensus.cc:3054] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.403985 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96506d095fe74ea8941b760814e393f2" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
W20250115 10:12:06.404361 3214 leader_election.cc:343] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.404399 3214 leader_election.cc:304] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.404451 4472 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 71c23863beb24d27b337fa039d7f04cd
I20250115 10:12:06.404515 4472 catalog_manager.cc:6596] ReplaceTablet: tablet 71c23863beb24d27b337fa039d7f04cd deleted and replaced by tablet d0f85f4f5b964bdfbb9433dda48acd79
I20250115 10:12:06.404517 3770 raft_consensus.cc:2743] T 96506d095fe74ea8941b760814e393f2 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.404563 3411 raft_consensus.cc:2463] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.404776 4569 tablet_bootstrap.cc:492] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.404816 4569 ts_tablet_manager.cc:1397] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.000s
I20250115 10:12:06.404964 4569 raft_consensus.cc:357] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.405005 4569 raft_consensus.cc:383] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.405026 4569 raft_consensus.cc:738] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.405076 4569 consensus_queue.cc:260] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.405192 4569 ts_tablet_manager.cc:1428] T 3125a457c6c24954a547ace659eefc19 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.405299 4569 tablet_bootstrap.cc:492] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.405882 4569 tablet_bootstrap.cc:654] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.406519 4557 tablet_bootstrap.cc:492] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.406574 4557 ts_tablet_manager.cc:1397] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20250115 10:12:06.406733 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d8cdd91b54444a6a6fe4cbf6fd16182" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.406737 4557 raft_consensus.cc:357] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.406800 4557 raft_consensus.cc:383] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.406811 3280 raft_consensus.cc:3054] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.406828 4557 raft_consensus.cc:738] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.406855 4557 consensus_queue.cc:260] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.406950 4557 ts_tablet_manager.cc:1428] T bc03234954824a64aa8d8abd5fc1dc29 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.407016 4557 tablet_bootstrap.cc:492] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.407413 4557 tablet_bootstrap.cc:654] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.407564 3280 raft_consensus.cc:2463] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.407856 4569 tablet_bootstrap.cc:492] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.407915 4569 ts_tablet_manager.cc:1397] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:06.408015 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c23863beb24d27b337fa039d7f04cd with delete_type TABLET_DATA_DELETED (replaced by tablet d0f85f4f5b964bdfbb9433dda48acd79) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.408100 4589 tablet_replica.cc:331] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: stopping tablet replica
I20250115 10:12:06.408089 4569 raft_consensus.cc:357] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.408179 4569 raft_consensus.cc:383] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.408193 4589 raft_consensus.cc:2238] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Raft consensus shutting down.
I20250115 10:12:06.408284 4589 raft_consensus.cc:2267] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.408408 4589 ts_tablet_manager.cc:1905] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.408892 3485 leader_election.cc:304] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.409797 4589 ts_tablet_manager.cc:1918] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.409838 4589 log.cc:1198] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-0/wal/wals/71c23863beb24d27b337fa039d7f04cd
I20250115 10:12:06.410018 4589 ts_tablet_manager.cc:1939] T 71c23863beb24d27b337fa039d7f04cd P 4c9ab337b4ea47d18b4208d424cf5fd1: Deleting consensus metadata
I20250115 10:12:06.410132 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c23863beb24d27b337fa039d7f04cd with delete_type TABLET_DATA_DELETED (replaced by tablet d0f85f4f5b964bdfbb9433dda48acd79) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.410202 4434 raft_consensus.cc:491] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.410243 4434 raft_consensus.cc:513] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.410351 4434 leader_election.cc:290] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.410405 4434 raft_consensus.cc:2798] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.410439 4434 raft_consensus.cc:695] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.410475 4434 consensus_queue.cc:237] T 8d8cdd91b54444a6a6fe4cbf6fd16182 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.410522 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5b5194bcc4fcabe77b9ef2abf80be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.410584 3280 raft_consensus.cc:2463] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.410773 3485 leader_election.cc:304] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.410907 4433 raft_consensus.cc:2798] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.410936 4433 raft_consensus.cc:491] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.410951 4433 raft_consensus.cc:3054] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.410950 4472 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1376d738ff354d8e8f596db5eb43ee04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.411062 4472 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1376d738ff354d8e8f596db5eb43ee04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.411644 4433 raft_consensus.cc:513] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.411784 4433 leader_election.cc:290] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.410204 4551 tablet_replica.cc:331] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: stopping tablet replica
I20250115 10:12:06.411933 4551 raft_consensus.cc:2238] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 10:12:06.411906 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5b5194bcc4fcabe77b9ef2abf80be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.411969 3280 raft_consensus.cc:3054] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.411980 4551 raft_consensus.cc:2267] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 10:12:06.412086 4551 ts_tablet_manager.cc:1905] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 10:12:06.412541 3280 raft_consensus.cc:2463] T bae5b5194bcc4fcabe77b9ef2abf80be P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.412807 3485 leader_election.cc:304] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.413283 4557 tablet_bootstrap.cc:492] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.413322 4557 ts_tablet_manager.cc:1397] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:06.413458 4557 raft_consensus.cc:357] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.413511 4551 ts_tablet_manager.cc:1918] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20250115 10:12:06.413564 4551 log.cc:1198] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Deleting WAL directory at /tmp/dist-test-taskjHaIeY/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1736935910734870-2918-0/minicluster-data/ts-2/wal/wals/71c23863beb24d27b337fa039d7f04cd
I20250115 10:12:06.413771 4551 ts_tablet_manager.cc:1939] T 71c23863beb24d27b337fa039d7f04cd P 89067c97cc1c45e699ee9f690cb3014f: Deleting consensus metadata
I20250115 10:12:06.413941 3541 raft_consensus.cc:3054] T 82c66363913e47399c4e1e8533bdadd0 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.414577 4884 raft_consensus.cc:2798] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.414636 4884 raft_consensus.cc:695] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.414672 4884 consensus_queue.cc:237] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.415469 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5b5194bcc4fcabe77b9ef2abf80be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.413512 4557 raft_consensus.cc:383] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.415644 4557 raft_consensus.cc:738] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.415683 4557 consensus_queue.cc:260] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.415799 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bae5b5194bcc4fcabe77b9ef2abf80be" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.408198 4569 raft_consensus.cc:738] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.416000 4569 consensus_queue.cc:260] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.416105 4569 ts_tablet_manager.cc:1428] T 78313248b1a74c60882d27cd7649048b P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:06.416167 4569 tablet_bootstrap.cc:492] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.416607 4569 tablet_bootstrap.cc:654] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.417099 4557 ts_tablet_manager.cc:1428] T cc37ef40aab243c4ab4057ef2ff657e7 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20250115 10:12:06.417164 4557 tablet_bootstrap.cc:492] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.417551 4557 tablet_bootstrap.cc:654] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.415818 3484 leader_election.cc:343] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.417948 3484 leader_election.cc:343] T bae5b5194bcc4fcabe77b9ef2abf80be P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.418011 4884 raft_consensus.cc:491] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.418040 4884 raft_consensus.cc:513] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.418123 4884 leader_election.cc:290] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.418596 3770 raft_consensus.cc:491] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.418642 3770 raft_consensus.cc:513] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.418737 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e90df067a820456db899065f0c04fe6b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.418797 3275 raft_consensus.cc:2463] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.418742 3770 leader_election.cc:290] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.418946 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e90df067a820456db899065f0c04fe6b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.419255 3485 leader_election.cc:304] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.419275 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6855da12502047aba54041f663c44f86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.419380 3546 raft_consensus.cc:2463] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
W20250115 10:12:06.419416 3484 leader_election.cc:343] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.419497 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6855da12502047aba54041f663c44f86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.419592 4433 raft_consensus.cc:2798] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.419620 4433 raft_consensus.cc:491] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.419636 4433 raft_consensus.cc:3054] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.420253 4433 raft_consensus.cc:513] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.420353 4433 leader_election.cc:290] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.420388 4433 raft_consensus.cc:491] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.420415 4433 raft_consensus.cc:513] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.420475 4433 leader_election.cc:290] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.420667 3215 leader_election.cc:304] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.420735 3770 raft_consensus.cc:2798] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.420796 3770 raft_consensus.cc:491] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.420819 3770 raft_consensus.cc:3054] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.420914 4569 tablet_bootstrap.cc:492] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.420943 4569 ts_tablet_manager.cc:1397] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:06.421065 4569 raft_consensus.cc:357] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.421134 4569 raft_consensus.cc:383] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.421149 4569 raft_consensus.cc:738] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.421182 4569 consensus_queue.cc:260] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.421262 4569 ts_tablet_manager.cc:1428] T 341e075964894a8682f2cf603420009f P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.421283 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.421425 3280 raft_consensus.cc:2463] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.421523 3770 raft_consensus.cc:513] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.421612 3770 leader_election.cc:290] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.421677 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e90df067a820456db899065f0c04fe6b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.421723 3275 raft_consensus.cc:3054] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.421336 4569 tablet_bootstrap.cc:492] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.422076 3546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6855da12502047aba54041f663c44f86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.422130 3546 raft_consensus.cc:3054] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.422343 3275 raft_consensus.cc:2463] T e90df067a820456db899065f0c04fe6b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.422385 4569 tablet_bootstrap.cc:654] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.422420 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.422470 3414 raft_consensus.cc:2463] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 0.
I20250115 10:12:06.422791 3546 raft_consensus.cc:2463] T 6855da12502047aba54041f663c44f86 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:06.422971 3214 leader_election.cc:343] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.423089 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e90df067a820456db899065f0c04fe6b" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.423965 3215 leader_election.cc:304] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.424081 4908 raft_consensus.cc:2798] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.424136 4908 raft_consensus.cc:695] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.424178 4908 consensus_queue.cc:237] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.424217 4463 catalog_manager.cc:4872] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]) successfully deleted
I20250115 10:12:06.424361 4908 raft_consensus.cc:491] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.424398 4908 raft_consensus.cc:513] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.424474 4908 leader_election.cc:290] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.424585 3485 leader_election.cc:304] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.424660 3485 leader_election.cc:304] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.424633 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9e04c866114cefbddc1bdb54d31cff" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.424775 4434 raft_consensus.cc:2798] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.424803 4434 raft_consensus.cc:491] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.424824 4434 raft_consensus.cc:3054] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.425415 4434 raft_consensus.cc:513] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.425541 4434 leader_election.cc:290] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.425575 4434 raft_consensus.cc:2798] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.425606 4434 raft_consensus.cc:695] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
I20250115 10:12:06.425642 4434 consensus_queue.cc:237] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
W20250115 10:12:06.425922 3484 leader_election.cc:343] T e90df067a820456db899065f0c04fe6b P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.426134 5156 raft_consensus.cc:491] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.426180 5156 raft_consensus.cc:513] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.426285 5156 leader_election.cc:290] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883)
I20250115 10:12:06.426818 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6855da12502047aba54041f663c44f86" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.427026 3215 leader_election.cc:343] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.427093 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ca42518736949a78609ff22b6f5bdce" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.427337 3215 leader_election.cc:343] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.427441 4463 catalog_manager.cc:4872] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): tablet 71c23863beb24d27b337fa039d7f04cd (table default.Table_34a23834dae942e6a8ae09b65269eb96 [id=7eef8ce2d7e843cb926a1a6a9a223ddc]) successfully deleted
I20250115 10:12:06.427688 4472 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_a9c119acee6b4b71bf1aa582ed92fda3" } new_table_name: "default.Table_b272805cfa0c474abffff656d81e95b1" modify_external_catalogs: true
I20250115 10:12:06.427932 4557 tablet_bootstrap.cc:492] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.427968 4557 ts_tablet_manager.cc:1397] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20250115 10:12:06.428171 4557 raft_consensus.cc:357] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.428215 4557 raft_consensus.cc:383] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.428229 4557 raft_consensus.cc:738] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.428258 4557 consensus_queue.cc:260] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.427784 4471 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_3845e624b75f48298bbc4cea2b5b42b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250115 10:12:06.428328 4557 ts_tablet_manager.cc:1428] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20250115 10:12:06.428333 4471 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3845e624b75f48298bbc4cea2b5b42b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.428369 4557 tablet_bootstrap.cc:492] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.428788 4557 tablet_bootstrap.cc:654] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.429068 4569 tablet_bootstrap.cc:492] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.429102 4569 ts_tablet_manager.cc:1397] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.000s
I20250115 10:12:06.429275 4569 raft_consensus.cc:357] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.429322 4569 raft_consensus.cc:383] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.429337 4569 raft_consensus.cc:738] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.429454 4569 consensus_queue.cc:260] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.429541 4569 ts_tablet_manager.cc:1428] T 6aa7b604904145c3ac45082b76426ee5 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.429600 4569 tablet_bootstrap.cc:492] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
W20250115 10:12:06.429600 3350 consensus_peers.cc:487] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Couldn't send request to peer 89067c97cc1c45e699ee9f690cb3014f. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca2e043501b04096b648d179a13e8653. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.430068 4475 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46438:
table { table_name: "default.Table_c5392bdd434949c4bda797e323e1adb1" } new_table_name: "default.Table_7135047caa87410c839001abd4b1a040" modify_external_catalogs: true
I20250115 10:12:06.430127 4569 tablet_bootstrap.cc:654] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.430127 4474 master_service.cc:946] ReplaceTablet: received request to replace tablet 2e55b7e2b95b4eb895da942829c4556f from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.430739 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
W20250115 10:12:06.430764 3214 leader_election.cc:343] T 6855da12502047aba54041f663c44f86 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.430764 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c9e04c866114cefbddc1bdb54d31cff" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.430804 3412 raft_consensus.cc:3054] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.431520 4557 tablet_bootstrap.cc:492] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.431560 4557 ts_tablet_manager.cc:1397] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20250115 10:12:06.431560 3412 raft_consensus.cc:2463] T 616fe62efc124fc0ace2ff557f42dcec P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.430805 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ca42518736949a78609ff22b6f5bdce" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.431703 4557 raft_consensus.cc:357] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.432360 4557 raft_consensus.cc:383] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.432391 4557 raft_consensus.cc:738] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.432418 4557 consensus_queue.cc:260] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.432531 4557 ts_tablet_manager.cc:1428] T 698b856949484ae092d198e64e00634b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.432580 4557 tablet_bootstrap.cc:492] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.432989 4557 tablet_bootstrap.cc:654] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.433177 4475 catalog_manager.cc:5786] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0311a54e0644e3787c44106cd41fc4e consensus state has no leader
W20250115 10:12:06.433441 3214 leader_election.cc:343] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.433445 3484 leader_election.cc:304] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.433491 3214 leader_election.cc:304] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.433523 4434 raft_consensus.cc:2798] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.433555 4434 raft_consensus.cc:695] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [term 1 LEADER]: Becoming Leader. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Running, Role: LEADER
W20250115 10:12:06.433573 3214 leader_election.cc:343] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.433595 3214 leader_election.cc:304] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.433593 4434 consensus_queue.cc:237] T 616fe62efc124fc0ace2ff557f42dcec P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.433681 5156 raft_consensus.cc:2743] T 7c9e04c866114cefbddc1bdb54d31cff P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.433779 5156 raft_consensus.cc:2743] T 4ca42518736949a78609ff22b6f5bdce P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.435128 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616fe62efc124fc0ace2ff557f42dcec" candidate_uuid: "89067c97cc1c45e699ee9f690cb3014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.435189 3275 raft_consensus.cc:3054] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.435844 3275 raft_consensus.cc:2463] T 616fe62efc124fc0ace2ff557f42dcec P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89067c97cc1c45e699ee9f690cb3014f in term 1.
I20250115 10:12:06.436574 3770 raft_consensus.cc:491] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.436625 3770 raft_consensus.cc:513] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.436749 3770 leader_election.cc:290] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.436862 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba5371af45cc4382bea26abd9df1094d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.436932 3541 raft_consensus.cc:2463] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.437032 3215 leader_election.cc:304] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.437395 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba5371af45cc4382bea26abd9df1094d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.437450 3770 raft_consensus.cc:2798] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.437485 3770 raft_consensus.cc:491] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.437502 3770 raft_consensus.cc:3054] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.437611 3214 leader_election.cc:343] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.437853 4475 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46438:
name: "default.Table_1dac1f33424e4f5d8635eedd9cb14924"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 10:12:06.437954 4475 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dac1f33424e4f5d8635eedd9cb14924 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 10:12:06.438117 4557 tablet_bootstrap.cc:492] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.438153 4557 ts_tablet_manager.cc:1397] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20250115 10:12:06.438180 3770 raft_consensus.cc:513] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.438273 4557 raft_consensus.cc:357] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.438293 3770 leader_election.cc:290] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.438315 4557 raft_consensus.cc:383] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.438331 4557 raft_consensus.cc:738] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.438365 4557 consensus_queue.cc:260] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.438447 4557 ts_tablet_manager.cc:1428] T cb8da7533f8041768533184ef0a33d3f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.438453 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba5371af45cc4382bea26abd9df1094d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.438536 3541 raft_consensus.cc:3054] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.438934 4433 consensus_queue.cc:1035] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.439208 3541 raft_consensus.cc:2463] T ba5371af45cc4382bea26abd9df1094d P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.439208 3414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba5371af45cc4382bea26abd9df1094d" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.439821 3215 leader_election.cc:304] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.439886 4731 raft_consensus.cc:2798] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.439920 4731 raft_consensus.cc:695] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.439952 4731 consensus_queue.cc:237] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.440297 3214 leader_election.cc:343] T ba5371af45cc4382bea26abd9df1094d P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.438500 4557 tablet_bootstrap.cc:492] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.442178 4557 tablet_bootstrap.cc:654] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.442216 3074 kernel_stack_watchdog.cc:198] Thread 3087 stuck at /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:249 for 13171ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x7f41d3a1d980 (unknown) at ??:0
@ 0x7f41d3a1cd50 __GI___nanosleep at ??:0
@ 0x7f41d4e2ffe9 kudu::master::TableInfo::AbortTasks() at ??:0
@ 0x7f41d4e390e3 kudu::master::TableInfo::~TableInfo() at ??:0
@ 0x7f41d4e448c8 kudu::master::TabletInfo::~TabletInfo() at ??:0
@ 0x7f41d4e8ea38 kudu::master::PickLeaderReplica::~PickLeaderReplica() at ??:0
@ 0x7f41d4e90a94 kudu::master::AsyncAlterTable::~AsyncAlterTable() at ??:0
@ 0x7f41d4e33370 kudu::master::TableInfo::RemoveTask() at ??:0
@ 0x7f41d4e3343d kudu::master::RetryingTSRpcTask::UnregisterAsyncTask() at ??:0
@ 0x7f41d4e33746 kudu::master::RetryingTSRpcTask::RpcCallback() at ??:0
@ 0x7f41d3c8e7cf _ZNSt17_Function_handlerIFvvEZN4kudu3rpc5Proxy12AsyncRequestERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEERKN6google8protobuf7MessageEPSE_PNS2_13RpcControllerERKSt8functionIS0_EEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f41d3c886ab kudu::rpc::OutboundCall::CallCallback() at ??:0
@ 0x7f41d3c8ab0d kudu::rpc::OutboundCall::SetResponse() at ??:0
@ 0x7f41d3c735e2 kudu::rpc::Connection::HandleCallResponse() at ??:0
@ 0x7f41d3c73f5c kudu::rpc::Connection::ReadHandler() at ??:0
@ 0x7f41cce4dd5e ev_invoke_pending at ??:0
I20250115 10:12:06.443230 4557 tablet_bootstrap.cc:492] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.443272 4557 ts_tablet_manager.cc:1397] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.000s
I20250115 10:12:06.443411 4557 raft_consensus.cc:357] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.443470 4557 raft_consensus.cc:383] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.443490 4557 raft_consensus.cc:738] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.443518 4557 consensus_queue.cc:260] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.443598 4557 ts_tablet_manager.cc:1428] T dacd2778d9e54877b8ef6d52529c3539 P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.444016 4575 tablet_bootstrap.cc:492] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.444059 4575 ts_tablet_manager.cc:1397] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.000s
I20250115 10:12:06.444217 4575 raft_consensus.cc:357] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.444263 4575 raft_consensus.cc:383] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.444279 4575 raft_consensus.cc:738] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.444317 4575 consensus_queue.cc:260] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.444407 4575 ts_tablet_manager.cc:1428] T 2e3186fbc8414cb989481b59e9cae04d P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.444479 4575 tablet_bootstrap.cc:492] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.444869 4575 tablet_bootstrap.cc:654] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.445070 4434 consensus_queue.cc:1035] T 4a0811cad8454c2e871aad2101224f34 P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.445456 4569 tablet_bootstrap.cc:492] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.445525 4575 tablet_bootstrap.cc:492] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3: No bootstrap required, opened a new log
I20250115 10:12:06.445523 4569 ts_tablet_manager.cc:1397] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20250115 10:12:06.445561 4575 ts_tablet_manager.cc:1397] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.445689 4575 raft_consensus.cc:357] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.445685 4569 raft_consensus.cc:357] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.445739 4569 raft_consensus.cc:383] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.445737 4575 raft_consensus.cc:383] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.445758 4569 raft_consensus.cc:738] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.445772 4575 raft_consensus.cc:738] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.445801 4569 consensus_queue.cc:260] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.445808 4575 consensus_queue.cc:260] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.445896 4569 ts_tablet_manager.cc:1428] T eb79611319a8480da63394d0a77c1488 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.445895 4575 ts_tablet_manager.cc:1428] T 18c05e81b1354e26900949537465cf08 P 25d7e460cb6d4ddabf387dc672cc26b3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.445946 4575 tablet_bootstrap.cc:492] T 900475e1e900423c9b9205540f67e5de P 25d7e460cb6d4ddabf387dc672cc26b3: Bootstrap starting.
I20250115 10:12:06.445950 4569 tablet_bootstrap.cc:492] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.446430 4569 tablet_bootstrap.cc:654] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.446512 4575 tablet_bootstrap.cc:654] T 900475e1e900423c9b9205540f67e5de P 25d7e460cb6d4ddabf387dc672cc26b3: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.448124 4475 master_service.cc:946] ReplaceTablet: received request to replace tablet 541482be183541e0ab5b9c482f208024 from {username='slave'} at 127.0.0.1:46438
I20250115 10:12:06.448977 4557 tablet_bootstrap.cc:492] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.449246 4475 catalog_manager.cc:5813] T 00000000000000000000000000000000 P 88f5e7c003a641128acc22b394ab62c7: Sending DeleteTablet for 3 replicas of tablet 541482be183541e0ab5b9c482f208024
I20250115 10:12:06.449337 4475 catalog_manager.cc:6596] ReplaceTablet: tablet 541482be183541e0ab5b9c482f208024 deleted and replaced by tablet 634540f471cc4f0b9bd93f8ec431f0e4
I20250115 10:12:06.449926 3257 tablet_service.cc:1514] Processing DeleteTablet for tablet 541482be183541e0ab5b9c482f208024 with delete_type TABLET_DATA_DELETED (replaced by tablet 634540f471cc4f0b9bd93f8ec431f0e4) from {username='slave'} at 127.0.0.1:43854
I20250115 10:12:06.450098 4731 raft_consensus.cc:491] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.450141 4731 raft_consensus.cc:513] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.450230 4731 leader_election.cc:290] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.450361 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e143f851a88f45f0908152069c6a558b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
W20250115 10:12:06.450498 3215 leader_election.cc:343] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.450491 4463 catalog_manager.cc:4852] TS 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): delete failed for tablet 541482be183541e0ab5b9c482f208024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 541482be183541e0ab5b9c482f208024 already in progress: creating tablet
I20250115 10:12:06.450604 4557 tablet_bootstrap.cc:654] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.450665 4731 raft_consensus.cc:491] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.450704 4731 raft_consensus.cc:513] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.450800 4731 leader_election.cc:290] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.450964 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3956317a32b04585a84629c209935898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.451023 3541 raft_consensus.cc:2463] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.451081 3513 tablet_service.cc:1514] Processing DeleteTablet for tablet 541482be183541e0ab5b9c482f208024 with delete_type TABLET_DATA_DELETED (replaced by tablet 634540f471cc4f0b9bd93f8ec431f0e4) from {username='slave'} at 127.0.0.1:54164
I20250115 10:12:06.451241 3215 leader_election.cc:304] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
W20250115 10:12:06.451238 4463 catalog_manager.cc:4852] TS 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): delete failed for tablet 541482be183541e0ab5b9c482f208024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 541482be183541e0ab5b9c482f208024 already in progress: creating tablet
I20250115 10:12:06.451311 4731 raft_consensus.cc:2798] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.451357 4731 raft_consensus.cc:491] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.451376 4731 raft_consensus.cc:3054] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.452111 4731 raft_consensus.cc:513] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.452211 4731 leader_election.cc:290] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.452261 4557 tablet_bootstrap.cc:492] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.452298 4557 ts_tablet_manager.cc:1397] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:06.452419 4884 consensus_queue.cc:1035] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.452507 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3956317a32b04585a84629c209935898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.452576 3541 raft_consensus.cc:3054] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.452793 4557 raft_consensus.cc:357] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.452891 4557 raft_consensus.cc:383] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.452940 4557 raft_consensus.cc:738] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.453002 4557 consensus_queue.cc:260] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.453150 4587 raft_consensus.cc:491] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.453169 4557 ts_tablet_manager.cc:1428] T 7c3e1f44b1794f398f07bf767d54652f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20250115 10:12:06.453187 3541 raft_consensus.cc:2463] T 3956317a32b04585a84629c209935898 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
I20250115 10:12:06.453197 4587 raft_consensus.cc:513] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.453267 4557 tablet_bootstrap.cc:492] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.453286 4587 leader_election.cc:290] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.453510 3215 leader_election.cc:304] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.453634 3770 raft_consensus.cc:2798] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.453678 3770 raft_consensus.cc:695] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.453712 3770 consensus_queue.cc:237] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.454023 3350 leader_election.cc:343] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: 9fbcd4787a734c5bba29f8a600abf874
W20250115 10:12:06.454216 3350 leader_election.cc:343] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 9fbcd4787a734c5bba29f8a600abf874
I20250115 10:12:06.454255 3350 leader_election.cc:304] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.454320 4587 raft_consensus.cc:2743] T 9fbcd4787a734c5bba29f8a600abf874 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.454402 4731 raft_consensus.cc:491] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.454439 4731 raft_consensus.cc:513] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.454533 4731 leader_election.cc:290] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.454627 4557 tablet_bootstrap.cc:654] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.454859 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f0fe74b55740dd94f97eaf27992e70" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.454927 3541 raft_consensus.cc:2463] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 0.
I20250115 10:12:06.455056 3215 leader_election.cc:304] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.455161 4731 raft_consensus.cc:2798] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.455125 3410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3956317a32b04585a84629c209935898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.455159 3413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f0fe74b55740dd94f97eaf27992e70" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.455191 4731 raft_consensus.cc:491] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.455209 4731 raft_consensus.cc:3054] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.455257 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e143f851a88f45f0908152069c6a558b" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.455305 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3956317a32b04585a84629c209935898" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.455839 4731 raft_consensus.cc:513] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.455960 4731 leader_election.cc:290] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Requested vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.456104 4587 raft_consensus.cc:491] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.456156 4587 raft_consensus.cc:513] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.456147 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f0fe74b55740dd94f97eaf27992e70" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.456218 3541 raft_consensus.cc:3054] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.456254 4587 leader_election.cc:290] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
W20250115 10:12:06.456698 3350 leader_election.cc:343] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Not found: Tablet not found: f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:06.456843 3541 raft_consensus.cc:2463] T 80f0fe74b55740dd94f97eaf27992e70 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c9ab337b4ea47d18b4208d424cf5fd1 in term 1.
W20250115 10:12:06.457012 3350 leader_election.cc:343] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: f9256780f6e94b7ebd1276df07baf19d
I20250115 10:12:06.457049 3350 leader_election.cc:304] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3; no voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.457129 4875 raft_consensus.cc:2743] T f9256780f6e94b7ebd1276df07baf19d P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.457114 3215 leader_election.cc:304] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.457231 4731 raft_consensus.cc:2798] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.457273 4731 raft_consensus.cc:695] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Running, Role: LEADER
I20250115 10:12:06.457311 4731 consensus_queue.cc:237] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.457508 4557 tablet_bootstrap.cc:492] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.457549 4557 ts_tablet_manager.cc:1397] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s
W20250115 10:12:06.457612 3214 leader_election.cc:343] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
W20250115 10:12:06.457687 3214 leader_election.cc:343] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.457687 4557 raft_consensus.cc:357] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.457739 3214 leader_election.cc:343] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.457755 4557 raft_consensus.cc:383] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.457777 3214 leader_election.cc:304] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.457775 4557 raft_consensus.cc:738] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
W20250115 10:12:06.457839 3214 leader_election.cc:343] T 3956317a32b04585a84629c209935898 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.457823 4557 consensus_queue.cc:260] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.457868 4731 raft_consensus.cc:2743] T e143f851a88f45f0908152069c6a558b P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.457933 4557 ts_tablet_manager.cc:1428] T 08bee9d860f64bf5937ea9bdb095391b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.457993 4557 tablet_bootstrap.cc:492] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.458249 4433 consensus_queue.cc:1035] T 2d5da557a18648719980469579c3979f P 89067c97cc1c45e699ee9f690cb3014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 10:12:06.458370 4557 tablet_bootstrap.cc:654] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.458731 3411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f0fe74b55740dd94f97eaf27992e70" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3"
I20250115 10:12:06.459473 4587 raft_consensus.cc:491] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250115 10:12:06.459481 3214 leader_election.cc:343] T 80f0fe74b55740dd94f97eaf27992e70 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.459528 4587 raft_consensus.cc:513] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.459619 4587 leader_election.cc:290] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.459911 4731 raft_consensus.cc:491] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.459976 4731 raft_consensus.cc:513] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.460063 4731 leader_election.cc:290] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.460403 4557 tablet_bootstrap.cc:492] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.460444 4557 ts_tablet_manager.cc:1397] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20250115 10:12:06.460563 4557 raft_consensus.cc:357] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.460589 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b401233481b445bbf0f394083719ed1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.460561 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab498e7789d4ae18a9f62be2fa2514a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.460614 4557 raft_consensus.cc:383] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.460631 4557 raft_consensus.cc:738] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.460635 3275 raft_consensus.cc:2463] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.460659 4557 consensus_queue.cc:260] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
W20250115 10:12:06.460700 3350 leader_election.cc:343] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4ab498e7789d4ae18a9f62be2fa2514a
W20250115 10:12:06.460726 3215 leader_election.cc:343] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.460747 3350 leader_election.cc:304] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.460755 4557 ts_tablet_manager.cc:1428] T 6eb1552d8cb541a6a2df109ea111c23f P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.460803 4557 tablet_bootstrap.cc:492] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.460908 3412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b401233481b445bbf0f394083719ed1" candidate_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" is_pre_election: true
I20250115 10:12:06.461162 4557 tablet_bootstrap.cc:654] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
W20250115 10:12:06.461315 3214 leader_election.cc:343] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25d7e460cb6d4ddabf387dc672cc26b3 (127.2.217.130:35883): Illegal state: must be running to vote when last-logged opid is not known
I20250115 10:12:06.461350 3214 leader_election.cc:304] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.461416 4731 raft_consensus.cc:2743] T 0b401233481b445bbf0f394083719ed1 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250115 10:12:06.461441 4875 raft_consensus.cc:2798] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.461475 4875 raft_consensus.cc:491] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.461491 4875 raft_consensus.cc:3054] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.462167 4875 raft_consensus.cc:513] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.462270 4875 leader_election.cc:290] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.462918 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ab498e7789d4ae18a9f62be2fa2514a" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.462999 3275 raft_consensus.cc:3054] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
W20250115 10:12:06.463150 3350 leader_election.cc:343] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229): Not found: Tablet not found: 4ab498e7789d4ae18a9f62be2fa2514a
W20250115 10:12:06.463214 3350 consensus_peers.cc:487] T ca2e043501b04096b648d179a13e8653 P 25d7e460cb6d4ddabf387dc672cc26b3 -> Peer 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457): Couldn't send request to peer 4c9ab337b4ea47d18b4208d424cf5fd1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca2e043501b04096b648d179a13e8653. This is attempt 1: this message will repeat every 5th retry.
I20250115 10:12:06.463349 4557 tablet_bootstrap.cc:492] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.463392 4557 ts_tablet_manager.cc:1397] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20250115 10:12:06.463383 4587 raft_consensus.cc:491] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.463426 4587 raft_consensus.cc:513] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.463550 4587 leader_election.cc:290] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.463537 4557 raft_consensus.cc:357] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.463603 4557 raft_consensus.cc:383] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.463626 4557 raft_consensus.cc:738] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.463665 4557 consensus_queue.cc:260] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.463675 3275 raft_consensus.cc:2463] T 4ab498e7789d4ae18a9f62be2fa2514a P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.463701 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.463773 3280 raft_consensus.cc:2463] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.463789 4557 ts_tablet_manager.cc:1428] T 7c9e04c866114cefbddc1bdb54d31cff P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.463853 4557 tablet_bootstrap.cc:492] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.464262 4557 tablet_bootstrap.cc:654] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.464303 3350 leader_election.cc:304] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters: 89067c97cc1c45e699ee9f690cb3014f
I20250115 10:12:06.464390 3350 leader_election.cc:304] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.464426 4587 raft_consensus.cc:2798] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.464479 4587 raft_consensus.cc:695] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:06.464514 4811 raft_consensus.cc:2798] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.464550 4811 raft_consensus.cc:491] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.464567 4811 raft_consensus.cc:3054] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.464902 4569 tablet_bootstrap.cc:492] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1: No bootstrap required, opened a new log
I20250115 10:12:06.464946 4569 ts_tablet_manager.cc:1397] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
I20250115 10:12:06.465071 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.465086 4569 raft_consensus.cc:357] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.465131 3541 raft_consensus.cc:2463] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.465147 4569 raft_consensus.cc:383] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.465168 4569 raft_consensus.cc:738] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9ab337b4ea47d18b4208d424cf5fd1, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.465211 4569 consensus_queue.cc:260] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.465229 4811 raft_consensus.cc:513] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.465308 4569 ts_tablet_manager.cc:1428] T 5f809e15894942839dea32dcab30efa3 P 4c9ab337b4ea47d18b4208d424cf5fd1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.465327 4811 leader_election.cc:290] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457), 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229)
I20250115 10:12:06.465381 4569 tablet_bootstrap.cc:492] T 8eec0ec85d5040168145d8ecf6a48184 P 4c9ab337b4ea47d18b4208d424cf5fd1: Bootstrap starting.
I20250115 10:12:06.464522 4587 consensus_queue.cc:237] T 4ab498e7789d4ae18a9f62be2fa2514a P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } }
I20250115 10:12:06.465546 4557 tablet_bootstrap.cc:492] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.465584 4557 ts_tablet_manager.cc:1397] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20250115 10:12:06.465714 4557 raft_consensus.cc:357] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.465761 4557 raft_consensus.cc:383] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.465798 4557 raft_consensus.cc:738] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.465830 4557 consensus_queue.cc:260] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.465854 4569 tablet_bootstrap.cc:654] T 8eec0ec85d5040168145d8ecf6a48184 P 4c9ab337b4ea47d18b4208d424cf5fd1: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.465924 4557 ts_tablet_manager.cc:1428] T e143f851a88f45f0908152069c6a558b P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.466001 4557 tablet_bootstrap.cc:492] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.466259 4587 raft_consensus.cc:491] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.466300 4587 raft_consensus.cc:513] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.466370 4587 leader_election.cc:290] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.466463 4557 tablet_bootstrap.cc:654] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.467175 4557 tablet_bootstrap.cc:492] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.467211 4557 ts_tablet_manager.cc:1397] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20250115 10:12:06.467334 4557 raft_consensus.cc:357] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.467387 4557 raft_consensus.cc:383] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.467404 4557 raft_consensus.cc:738] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.467440 4557 consensus_queue.cc:260] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.467543 4557 ts_tablet_manager.cc:1428] T 4ca42518736949a78609ff22b6f5bdce P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.467603 4557 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.467793 3275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbc7f2fbfc9a4cd9b88965e6725a69ad" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" is_pre_election: true
I20250115 10:12:06.467840 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.467860 3275 raft_consensus.cc:2463] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.467882 3280 raft_consensus.cc:3054] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.468019 4557 tablet_bootstrap.cc:654] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.468587 3280 raft_consensus.cc:2463] T 31964c90876c4d289d68b6be6ebb8c12 P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.468731 3541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31964c90876c4d289d68b6be6ebb8c12" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.468786 3541 raft_consensus.cc:3054] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.469269 3350 leader_election.cc:304] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.469344 4587 raft_consensus.cc:2798] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 10:12:06.469393 4587 raft_consensus.cc:491] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 10:12:06.469408 4587 raft_consensus.cc:3054] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.469437 3541 raft_consensus.cc:2463] T 31964c90876c4d289d68b6be6ebb8c12 P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.469514 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbc7f2fbfc9a4cd9b88965e6725a69ad" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f" is_pre_election: true
I20250115 10:12:06.469345 3350 leader_election.cc:304] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 4c9ab337b4ea47d18b4208d424cf5fd1; no voters:
I20250115 10:12:06.469564 3549 raft_consensus.cc:2463] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 0.
I20250115 10:12:06.469733 4557 tablet_bootstrap.cc:492] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f: No bootstrap required, opened a new log
I20250115 10:12:06.469771 4557 ts_tablet_manager.cc:1397] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20250115 10:12:06.469920 4557 raft_consensus.cc:357] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.469964 4557 raft_consensus.cc:383] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 10:12:06.469980 4557 raft_consensus.cc:738] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89067c97cc1c45e699ee9f690cb3014f, State: Initialized, Role: FOLLOWER
I20250115 10:12:06.470016 4557 consensus_queue.cc:260] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.470082 4587 raft_consensus.cc:513] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.470108 4557 ts_tablet_manager.cc:1428] T 203486455372404aa0a735cd219934be P 89067c97cc1c45e699ee9f690cb3014f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20250115 10:12:06.470161 4557 tablet_bootstrap.cc:492] T 80e2361a4e7040feae312bda88851e77 P 89067c97cc1c45e699ee9f690cb3014f: Bootstrap starting.
I20250115 10:12:06.470172 4587 leader_election.cc:290] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Requested vote from peers 89067c97cc1c45e699ee9f690cb3014f (127.2.217.131:38229), 4c9ab337b4ea47d18b4208d424cf5fd1 (127.2.217.129:46457)
I20250115 10:12:06.470217 4587 raft_consensus.cc:2798] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.470252 4587 raft_consensus.cc:695] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:06.470283 4587 consensus_queue.cc:237] T 31964c90876c4d289d68b6be6ebb8c12 P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } }
I20250115 10:12:06.470551 4557 tablet_bootstrap.cc:654] T 80e2361a4e7040feae312bda88851e77 P 89067c97cc1c45e699ee9f690cb3014f: Neither blocks nor log segments found. Creating new log.
I20250115 10:12:06.471029 3549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbc7f2fbfc9a4cd9b88965e6725a69ad" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89067c97cc1c45e699ee9f690cb3014f"
I20250115 10:12:06.471040 3280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbc7f2fbfc9a4cd9b88965e6725a69ad" candidate_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1"
I20250115 10:12:06.471081 3549 raft_consensus.cc:3054] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.471101 3280 raft_consensus.cc:3054] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 0 FOLLOWER]: Advancing to term 1
I20250115 10:12:06.471690 3549 raft_consensus.cc:2463] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 89067c97cc1c45e699ee9f690cb3014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.471787 3280 raft_consensus.cc:2463] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 4c9ab337b4ea47d18b4208d424cf5fd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25d7e460cb6d4ddabf387dc672cc26b3 in term 1.
I20250115 10:12:06.471957 3350 leader_election.cc:304] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25d7e460cb6d4ddabf387dc672cc26b3, 89067c97cc1c45e699ee9f690cb3014f; no voters:
I20250115 10:12:06.472043 4714 raft_consensus.cc:2798] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 10:12:06.472096 4714 raft_consensus.cc:695] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [term 1 LEADER]: Becoming Leader. State: Replica: 25d7e460cb6d4ddabf387dc672cc26b3, State: Running, Role: LEADER
I20250115 10:12:06.472128 4714 consensus_queue.cc:237] T dbc7f2fbfc9a4cd9b88965e6725a69ad P 25d7e460cb6d4ddabf387dc672cc26b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130" port: 35883 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } }
I20250115 10:12:06.472182 4433 raft_consensus.cc:491] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 10:12:06.472223 4433 raft_consensus.cc:513] T 2e3186fbc8414cb989481b59e9cae04d P 89067c97cc1c45e699ee9f690cb3014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c9ab337b4ea47d18b4208d424cf5fd1" member_type: VOTER last_known_addr { host: "127.2.217.129" port: 46457 } } peers { permanent_uuid: "89067c97cc1c45e699ee9f690cb3014f" member_type: VOTER last_known_addr { host: "127.2.217.131" port: 38229 } } peers { permanent_uuid: "25d7e460cb6d4ddabf387dc672cc26b3" member_type: VOTER last_known_addr { host: "127.2.217.130